Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260928 14:50:14.999431 8916 test_util.cc:268] Using random seed: 789558613
2026-09-28T14:50:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T14:50:15Z Disabled control of system clock
I20260928 14:50:15.027740 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.62:43149
--webserver_interface=127.8.181.62
--webserver_port=0
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 14:50:15.345287 8924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:15.345592 8924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:15.345726 8924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:15.353895 8924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:15.353996 8924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:15.354069 8924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:15.354153 8924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 14:50:15.363164 8924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.62:43149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.181.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:15.364408 8924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:15.366119 8924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 14:50:15.377967 8930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:15.378033 8929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:15.378010 8932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:15.378561 8924 server_base.cc:1034] running on GCE node
I20260928 14:50:15.379292 8924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:15.380535 8924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:15.381733 8924 hybrid_clock.cc:648] HybridClock initialized: now 1790607015381673 us; error 40 us; skew 500 ppm
I20260928 14:50:15.382020 8924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:15.384047 8924 webserver.cc:460] Webserver started at http://127.8.181.62:36587/ using document root <none> and password file <none>
I20260928 14:50:15.384662 8924 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:15.384769 8924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:15.385039 8924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:15.387434 8924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data/instance:
uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.388325 8924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal/instance:
uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.393216 8924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260928 14:50:15.396414 8938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:15.397646 8924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260928 14:50:15.397797 8924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal
uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.397958 8924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:15.412477 8924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:15.413178 8924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:15.413427 8924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:15.431303 8924 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.62:43149
I20260928 14:50:15.431336 8991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.62:43149 every 8 connection(s)
I20260928 14:50:15.432485 8924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/data/info.pb
I20260928 14:50:15.435935 8992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:15.439241 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 8924
I20260928 14:50:15.439512 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-0/wal/instance
I20260928 14:50:15.442530 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.61:41417
--webserver_interface=127.8.181.61
--webserver_port=0
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 14:50:15.443291 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:15.459853 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } has no permanent_uuid. Determining permanent_uuid...
W20260928 14:50:15.461014 8940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
W20260928 14:50:15.462519 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.61:41417: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
I20260928 14:50:15.511801 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } attempt: 1
W20260928 14:50:15.513584 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.61:41417: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
I20260928 14:50:15.581820 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } attempt: 2
W20260928 14:50:15.583688 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.61:41417: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
I20260928 14:50:15.674899 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } attempt: 3
W20260928 14:50:15.676749 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.61:41417: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
W20260928 14:50:15.792348 8994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:15.792610 8994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:15.792721 8994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:15.799715 8994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:15.799805 8994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:15.799870 8994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:15.799948 8994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 14:50:15.808753 8994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.61:41417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.181.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:15.809958 8994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:15.811604 8994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 14:50:15.820009 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } attempt: 4
W20260928 14:50:15.822021 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.61:41417: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111)
W20260928 14:50:15.823028 9003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:15.823105 9002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:15.823282 9005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:15.823882 8994 server_base.cc:1034] running on GCE node
I20260928 14:50:15.824587 8994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:15.825836 8994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:15.827044 8994 hybrid_clock.cc:648] HybridClock initialized: now 1790607015826973 us; error 43 us; skew 500 ppm
I20260928 14:50:15.827339 8994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:15.829903 8994 webserver.cc:460] Webserver started at http://127.8.181.61:36355/ using document root <none> and password file <none>
I20260928 14:50:15.830525 8994 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:15.830633 8994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:15.830900 8994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:15.833300 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/instance:
uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.834028 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal/instance:
uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.839489 8994 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260928 14:50:15.843108 9011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:15.844281 8994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:15.844452 8994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:15.844619 8994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:15.860580 8994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:15.861792 8994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:15.862135 8994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:15.887984 8994 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.61:41417
I20260928 14:50:15.888170 9063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.61:41417 every 8 connection(s)
I20260928 14:50:15.889504 8994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
I20260928 14:50:15.893115 9064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:15.897675 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 8994
I20260928 14:50:15.897825 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal/instance
I20260928 14:50:15.899066 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--webserver_interface=127.8.181.60
--webserver_port=0
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 14:50:15.899359 9064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:15.913470 9064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:15.923512 9064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
W20260928 14:50:15.924669 9014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
W20260928 14:50:15.926855 9064 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:15.976215 9064 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 1
W20260928 14:50:15.978082 9064 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.046420 9064 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 2
W20260928 14:50:16.048473 9064 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.121377 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } attempt: 5
I20260928 14:50:16.129840 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
W20260928 14:50:16.132081 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.139778 9064 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 3
W20260928 14:50:16.141650 9064 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.183411 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 1
W20260928 14:50:16.185689 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.253890 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 2
W20260928 14:50:16.255638 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.284915 9064 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 4
W20260928 14:50:16.286701 9064 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
W20260928 14:50:16.314591 9067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:16.314838 9067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:16.314988 9067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:16.322398 9067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:16.322486 9067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:16.322532 9067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:16.322588 9067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 14:50:16.331075 9067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.181.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:16.332181 9067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:16.333818 9067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 14:50:16.344575 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:16.344630 9077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:16.344682 9075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:16.345422 9067 server_base.cc:1034] running on GCE node
I20260928 14:50:16.346160 9067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:16.347600 9067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:16.348824 9067 hybrid_clock.cc:648] HybridClock initialized: now 1790607016348742 us; error 57 us; skew 500 ppm
I20260928 14:50:16.349112 9067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:16.351780 9067 webserver.cc:460] Webserver started at http://127.8.181.60:33241/ using document root <none> and password file <none>
I20260928 14:50:16.352583 9067 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:16.352717 9067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:16.353050 9067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:16.355532 9067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/instance:
uuid: "c6b99976d8024a79a0603523b9d32f29"
format_stamp: "Formatted at 2026-09-28 14:50:16 on dist-test-slave-g607"
I20260928 14:50:16.356225 9067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal/instance:
uuid: "c6b99976d8024a79a0603523b9d32f29"
format_stamp: "Formatted at 2026-09-28 14:50:16 on dist-test-slave-g607"
I20260928 14:50:16.360858 9067 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260928 14:50:16.361830 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 3
W20260928 14:50:16.363502 8992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:16.364367 9083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:16.365602 9067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:16.365752 9067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
uuid: "c6b99976d8024a79a0603523b9d32f29"
format_stamp: "Formatted at 2026-09-28 14:50:16 on dist-test-slave-g607"
I20260928 14:50:16.365904 9067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:16.378746 9067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:16.379416 9067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:16.379678 9067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:16.395439 9067 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.60:39777
I20260928 14:50:16.395476 9135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.60:39777 every 8 connection(s)
I20260928 14:50:16.396560 9067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
I20260928 14:50:16.399901 9136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:16.404907 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 9067
I20260928 14:50:16.405107 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal/instance
I20260928 14:50:16.405664 9136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:16.423276 9136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:16.429912 9136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
I20260928 14:50:16.444931 9136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap starting.
I20260928 14:50:16.448107 9136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:16.449076 9136 log.cc:824] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:16.451623 9136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: No bootstrap required, opened a new log
I20260928 14:50:16.458659 9136 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.458940 9136 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:16.459043 9136 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Initialized, Role: FOLLOWER
I20260928 14:50:16.459522 9136 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.460361 9145 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.460870 9145 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.461189 9136 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: configured and running, proceeding with master startup.
W20260928 14:50:16.469666 9156 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 14:50:16.469779 9156 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 14:50:16.467021 9067 master_runner.cc:186] Error getting master registration for 127.8.181.62:43149: OK, instance_id { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" instance_seqno: 1790607015426529 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 14:50:16.474941 9067 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 14:50:16.540710 8992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 4
I20260928 14:50:16.550881 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Bootstrap starting.
I20260928 14:50:16.553879 8992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:16.554834 8992 log.cc:824] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:16.557426 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: No bootstrap required, opened a new log
I20260928 14:50:16.565858 8992 raft_consensus.cc:348] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.566231 8992 raft_consensus.cc:374] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:16.566352 8992 raft_consensus.cc:729] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c253b9f3f43c4b8ba7cd5c7d4edac656, State: Initialized, Role: FOLLOWER
I20260928 14:50:16.566856 8992 consensus_queue.cc:260] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.567780 9159 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.568233 9159 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.569044 8992 sys_catalog.cc:564] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: configured and running, proceeding with master startup.
W20260928 14:50:16.582525 9170 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 14:50:16.582698 9170 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 14:50:16.585944 9064 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } attempt: 5
I20260928 14:50:16.580524 8924 master_runner.cc:186] Error getting master registration for 127.8.181.61:41417: OK, instance_id { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" instance_seqno: 1790607015880254 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 14:50:16.592701 8924 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 14:50:16.597805 9145 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:16.598109 9145 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.599601 9145 leader_election.cc:288] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417)
I20260928 14:50:16.599929 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Bootstrap starting.
I20260928 14:50:16.600628 8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
I20260928 14:50:16.601590 8966 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6b99976d8024a79a0603523b9d32f29 in term 0.
I20260928 14:50:16.603328 9087 leader_election.cc:302] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c253b9f3f43c4b8ba7cd5c7d4edac656, c6b99976d8024a79a0603523b9d32f29; no voters:
I20260928 14:50:16.603806 9145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:16.604154 9145 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:16.604336 9145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:16.605582 9064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:16.608096 9064 log.cc:824] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:16.608428 9145 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.609503 8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656"
I20260928 14:50:16.609733 8966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:16.612784 8966 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6b99976d8024a79a0603523b9d32f29 in term 1.
I20260928 14:50:16.613205 9087 leader_election.cc:302] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c253b9f3f43c4b8ba7cd5c7d4edac656, c6b99976d8024a79a0603523b9d32f29; no voters:
I20260928 14:50:16.614671 9145 leader_election.cc:288] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 1 election: Requested vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417)
I20260928 14:50:16.615084 9145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:16.615445 9145 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 LEADER]: Becoming Leader. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Running, Role: LEADER
I20260928 14:50:16.616081 9145 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.621181 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: No bootstrap required, opened a new log
W20260928 14:50:16.632200 9089 tablet.cc:2369] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:16.636121 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.636718 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:16.637501 9064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.638085 9064 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:16.638371 9064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d70b1b045bd4ec4b74be2dc2364ecba, State: Initialized, Role: FOLLOWER
I20260928 14:50:16.639511 9064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:16.649996 9175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 14:50:16.650717 9037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
I20260928 14:50:16.650692 9038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" is_pre_election: true
I20260928 14:50:16.651544 9038 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6b99976d8024a79a0603523b9d32f29 in term 0.
I20260928 14:50:16.651474 9064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: configured and running, proceeding with master startup.
I20260928 14:50:16.652354 9175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 14:50:16.653277 9176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.653664 9176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
W20260928 14:50:16.665825 8944 tablet.cc:2369] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:16.672574 9038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:16.676646 9038 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 1 FOLLOWER]: Refusing update from remote peer c6b99976d8024a79a0603523b9d32f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:16.678972 9173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:16.687414 8966 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Refusing update from remote peer c6b99976d8024a79a0603523b9d32f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:16.688269 9173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:16.698922 9159 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.699203 9159 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.703048 9179 mvcc.cc:205] Tried to move back new op lower bound from 7334326340278509568 to 7334326340070522880. Current Snapshot: MvccSnapshot[applied={T|T < 7334326340278509568}]
I20260928 14:50:16.713555 9176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.713825 9176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.714692 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.714771 9159 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.714969 9159 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.714993 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:16.715777 9175 catalog_manager.cc:1347] Generated new cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:16.715869 9175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 14:50:16.716435 9185 mvcc.cc:205] Tried to move back new op lower bound from 7334326340278509568 to 7334326340070522880. Current Snapshot: MvccSnapshot[applied={T|T < 7334326340278509568 or (T in {7334326340278509568})}]
I20260928 14:50:16.717617 9145 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.718040 9145 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:16.720579 9183 mvcc.cc:205] Tried to move back new op lower bound from 7334326340278509568 to 7334326340070522880. Current Snapshot: MvccSnapshot[applied={T|T < 7334326340278509568}]
I20260928 14:50:16.737665 9175 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 14:50:16.737654 9176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:16.737884 9176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:16.739439 9175 catalog_manager.cc:1504] Loading token signing keys...
I20260928 14:50:16.767840 9175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Generated new TSK 0
I20260928 14:50:16.768715 9175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 14:50:16.772927 9196 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:16.773013 9196 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: loading cluster ID for follower catalog manager: success
I20260928 14:50:16.777002 9196 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: acquiring CA information for follower catalog manager: success
I20260928 14:50:16.779498 9196 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 14:50:16.799782 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.181.1:0
--local_ip_for_outbound_sockets=127.8.181.1
--webserver_interface=127.8.181.1
--webserver_port=0
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260928 14:50:17.260820 9198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:17.261159 9198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:17.261312 9198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:17.269076 9198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260928 14:50:17.269017 9202 raft_consensus.cc:482] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
W20260928 14:50:17.269282 9198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.181.1
I20260928 14:50:17.269222 9202 raft_consensus.cc:504] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:17.270114 9203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
I20260928 14:50:17.270690 9203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:17.271174 9202 leader_election.cc:288] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:17.271871 9037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" is_pre_election: true
I20260928 14:50:17.271919 9110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6b99976d8024a79a0603523b9d32f29" is_pre_election: true
I20260928 14:50:17.272241 9037 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c253b9f3f43c4b8ba7cd5c7d4edac656 in term 1.
I20260928 14:50:17.272837 8940 leader_election.cc:302] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c253b9f3f43c4b8ba7cd5c7d4edac656; no voters:
I20260928 14:50:17.273248 9202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 14:50:17.273438 9202 raft_consensus.cc:482] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
I20260928 14:50:17.273604 9202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 1 FOLLOWER]: Advancing to term 2
I20260928 14:50:17.274621 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
I20260928 14:50:17.275462 9110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6b99976d8024a79a0603523b9d32f29" is_pre_election: true
I20260928 14:50:17.276186 9203 leader_election.cc:288] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:17.276800 9202 raft_consensus.cc:504] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:17.277221 8965 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d70b1b045bd4ec4b74be2dc2364ecba in current term 2: Already voted for candidate c253b9f3f43c4b8ba7cd5c7d4edac656 in this term.
I20260928 14:50:17.277858 9110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6b99976d8024a79a0603523b9d32f29"
I20260928 14:50:17.278146 9037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
I20260928 14:50:17.278371 9037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 1 FOLLOWER]: Advancing to term 2
I20260928 14:50:17.278391 9202 leader_election.cc:288] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 2 election: Requested vote from peers 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:17.281514 9037 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c253b9f3f43c4b8ba7cd5c7d4edac656 in term 2.
I20260928 14:50:17.282236 8940 leader_election.cc:302] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c253b9f3f43c4b8ba7cd5c7d4edac656; no voters: c6b99976d8024a79a0603523b9d32f29
I20260928 14:50:17.282300 9015 leader_election.cc:302] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba; no voters: c253b9f3f43c4b8ba7cd5c7d4edac656, c6b99976d8024a79a0603523b9d32f29
I20260928 14:50:17.282708 9202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 14:50:17.283041 9203 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 14:50:17.283500 9202 raft_consensus.cc:686] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 LEADER]: Becoming Leader. State: Replica: c253b9f3f43c4b8ba7cd5c7d4edac656, State: Running, Role: LEADER
I20260928 14:50:17.283742 9198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.181.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.181.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.181.1
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:17.284025 9202 consensus_queue.cc:237] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:17.285377 9198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:17.286032 9204 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.286283 9204 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:17.286912 9205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 14:50:17.287601 9198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 14:50:17.289783 9205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 14:50:17.290939 9205 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:17.291034 9205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 14:50:17.294577 9205 catalog_manager.cc:1504] Loading token signing keys...
I20260928 14:50:17.295885 9205 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Loaded TSK: 0
I20260928 14:50:17.297546 9205 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 14:50:17.303978 9207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:17.303973 9208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:17.307873 9198 server_base.cc:1034] running on GCE node
W20260928 14:50:17.308516 9210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:17.309201 9198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:17.310228 9198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:17.311472 9198 hybrid_clock.cc:648] HybridClock initialized: now 1790607017311394 us; error 57 us; skew 500 ppm
I20260928 14:50:17.311775 9198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:17.314045 9198 webserver.cc:460] Webserver started at http://127.8.181.1:43739/ using document root <none> and password file <none>
I20260928 14:50:17.314736 9198 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:17.314862 9198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:17.315164 9198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:17.317924 9198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data/instance:
uuid: "9b4626c584ad47ffaf346e81daff846b"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.318678 9198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/instance:
uuid: "9b4626c584ad47ffaf346e81daff846b"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.323838 9198 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260928 14:50:17.325999 8965 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 LEADER]: Rejecting Update request from peer c6b99976d8024a79a0603523b9d32f29 for earlier term 1. Current term is 2. Ops: []
I20260928 14:50:17.326633 9216 consensus_queue.cc:1046] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 14:50:17.327147 9216 consensus_queue.cc:1225] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Peer c253b9f3f43c4b8ba7cd5c7d4edac656 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260928 14:50:17.327338 9217 raft_consensus.cc:3032] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 14:50:17.327426 9217 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Running, Role: LEADER
I20260928 14:50:17.327818 9218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.327749 9217 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:17.328186 9217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 1 FOLLOWER]: Advancing to term 2
I20260928 14:50:17.329183 9198 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:17.329329 9198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal
uuid: "9b4626c584ad47ffaf346e81daff846b"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.329514 9198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:17.347373 9198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:17.348354 9198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:17.348788 9198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:17.349881 9198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 14:50:17.351469 9198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 14:50:17.351547 9198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.351646 9198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 14:50:17.351743 9198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.389763 9198 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.1:44023
I20260928 14:50:17.389775 9331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.1:44023 every 8 connection(s)
I20260928 14:50:17.391100 9198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/data/info.pb
I20260928 14:50:17.396189 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 9198
I20260928 14:50:17.396374 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/instance
I20260928 14:50:17.407428 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.181.2:0
--local_ip_for_outbound_sockets=127.8.181.2
--webserver_interface=127.8.181.2
--webserver_port=0
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 14:50:17.424759 9333 heartbeater.cc:347] Connected to a master server at 127.8.181.62:43149
I20260928 14:50:17.425045 9333 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.425561 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:17.425714 9334 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.425941 9333 heartbeater.cc:511] Master 127.8.181.62:43149 requested a full tablet report, sending...
I20260928 14:50:17.426250 9334 heartbeater.cc:511] Master 127.8.181.61:41417 requested a full tablet report, sending...
I20260928 14:50:17.427939 8956 ts_manager.cc:194] Registered new tserver with Master: 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:17.427943 9028 ts_manager.cc:194] Registered new tserver with Master: 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:17.429829 8956 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.181.1:57267
I20260928 14:50:17.432701 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:17.432813 9332 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.433171 9332 heartbeater.cc:511] Master 127.8.181.60:39777 requested a full tablet report, sending...
I20260928 14:50:17.434904 9100 ts_manager.cc:194] Registered new tserver with Master: 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:17.471860 9156 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 14:50:17.683004 9037 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Refusing update from remote peer c253b9f3f43c4b8ba7cd5c7d4edac656: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260928 14:50:17.683694 9204 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 14:50:17.685148 9203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.685479 9203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:17.686690 9202 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.686985 9202 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:17.687666 9110 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Refusing update from remote peer c253b9f3f43c4b8ba7cd5c7d4edac656: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260928 14:50:17.688290 9204 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 14:50:17.688470 9203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.688707 9203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:17.690310 9216 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.690577 9216 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:17.690922 9217 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:17.691138 9217 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 14:50:17.751334 9342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:17.751618 9342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:17.751732 9342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:17.758579 9342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:17.758733 9342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.181.2
I20260928 14:50:17.767819 9342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.181.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.181.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.181.2
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:17.768949 9342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:17.770740 9342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 14:50:17.783026 9350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:17.783200 9353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:17.783200 9351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:17.784065 9342 server_base.cc:1034] running on GCE node
I20260928 14:50:17.784574 9342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:17.785373 9342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:17.786585 9342 hybrid_clock.cc:648] HybridClock initialized: now 1790607017786513 us; error 44 us; skew 500 ppm
I20260928 14:50:17.786877 9342 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:17.788949 9342 webserver.cc:460] Webserver started at http://127.8.181.2:43817/ using document root <none> and password file <none>
I20260928 14:50:17.789597 9342 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:17.789711 9342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:17.789994 9342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:17.792373 9342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data/instance:
uuid: "ae832871bd1142f7af10c084115ffc12"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.793071 9342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/instance:
uuid: "ae832871bd1142f7af10c084115ffc12"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.798046 9342 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260928 14:50:17.801091 9359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.802402 9342 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:17.802577 9342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal
uuid: "ae832871bd1142f7af10c084115ffc12"
format_stamp: "Formatted at 2026-09-28 14:50:17 on dist-test-slave-g607"
I20260928 14:50:17.802759 9342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:17.818989 9342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:17.819754 9342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:17.819996 9342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:17.820823 9342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 14:50:17.822252 9342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 14:50:17.822324 9342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.822434 9342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 14:50:17.822492 9342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:17.854982 9342 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.2:42099
I20260928 14:50:17.855029 9472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.2:42099 every 8 connection(s)
I20260928 14:50:17.856184 9342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/data/info.pb
I20260928 14:50:17.857089 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 9342
I20260928 14:50:17.857271 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/instance
I20260928 14:50:17.862435 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.181.3:0
--local_ip_for_outbound_sockets=127.8.181.3
--webserver_interface=127.8.181.3
--webserver_port=0
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 14:50:17.884428 9474 heartbeater.cc:347] Connected to a master server at 127.8.181.62:43149
I20260928 14:50:17.884514 9473 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:17.884763 9473 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.884449 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:17.884927 9475 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.884761 9474 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:17.885733 9475 heartbeater.cc:511] Master 127.8.181.61:41417 requested a full tablet report, sending...
I20260928 14:50:17.886003 9474 heartbeater.cc:511] Master 127.8.181.62:43149 requested a full tablet report, sending...
I20260928 14:50:17.889971 9473 heartbeater.cc:511] Master 127.8.181.60:39777 requested a full tablet report, sending...
I20260928 14:50:17.890377 8956 ts_manager.cc:194] Registered new tserver with Master: ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:17.891036 9100 ts_manager.cc:194] Registered new tserver with Master: ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:17.891439 8956 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.181.2:45597
I20260928 14:50:17.892599 9028 ts_manager.cc:194] Registered new tserver with Master: ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:17.932475 9333 heartbeater.cc:503] Master 127.8.181.62:43149 was elected leader, sending a full tablet report...
I20260928 14:50:18.187748 9203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c253b9f3f43c4b8ba7cd5c7d4edac656)
I20260928 14:50:18.187927 9203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:18.188551 9203 leader_election.cc:288] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:18.189114 9110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6b99976d8024a79a0603523b9d32f29" is_pre_election: true
I20260928 14:50:18.189119 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
I20260928 14:50:18.189780 9015 leader_election.cc:302] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba; no voters: c253b9f3f43c4b8ba7cd5c7d4edac656, c6b99976d8024a79a0603523b9d32f29
I20260928 14:50:18.190037 9203 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 14:50:18.190251 9217 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c253b9f3f43c4b8ba7cd5c7d4edac656)
I20260928 14:50:18.190418 9217 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:18.191097 9217 leader_election.cc:288] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417)
I20260928 14:50:18.191705 9037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" is_pre_election: true
I20260928 14:50:18.191725 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
I20260928 14:50:18.191931 9037 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6b99976d8024a79a0603523b9d32f29 in term 2.
I20260928 14:50:18.192428 9085 leader_election.cc:302] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c6b99976d8024a79a0603523b9d32f29; no voters: c253b9f3f43c4b8ba7cd5c7d4edac656
I20260928 14:50:18.192664 9217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 14:50:18.192775 9217 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c253b9f3f43c4b8ba7cd5c7d4edac656)
I20260928 14:50:18.192862 9217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 2 FOLLOWER]: Advancing to term 3
I20260928 14:50:18.194692 9217 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:18.195184 9217 leader_election.cc:288] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 3 election: Requested vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417)
I20260928 14:50:18.195559 9037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
I20260928 14:50:18.195633 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656"
I20260928 14:50:18.195766 9037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 2 FOLLOWER]: Advancing to term 3
I20260928 14:50:18.197558 9037 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6b99976d8024a79a0603523b9d32f29 in term 3.
I20260928 14:50:18.197875 9085 leader_election.cc:302] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c6b99976d8024a79a0603523b9d32f29; no voters: c253b9f3f43c4b8ba7cd5c7d4edac656
I20260928 14:50:18.198256 9217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 14:50:18.198770 9217 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 LEADER]: Becoming Leader. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Running, Role: LEADER
I20260928 14:50:18.199151 9217 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:18.200345 9484 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.200789 9484 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
W20260928 14:50:18.200877 9479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:18.201346 9479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260928 14:50:18.201361 9485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260928 14:50:18.201625 9479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 14:50:18.202982 9485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 14:50:18.203780 9485 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:18.203846 9485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 14:50:18.204975 9485 catalog_manager.cc:1504] Loading token signing keys...
I20260928 14:50:18.205726 9485 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Loaded TSK: 0
I20260928 14:50:18.206393 9485 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 14:50:18.209586 9479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:18.209786 9479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.181.3
I20260928 14:50:18.218918 9479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.181.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.181.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.181.3
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:18.220116 9479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:18.221916 9479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 14:50:18.234593 9488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:18.234619 9487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:18.234550 9490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:18.235361 9479 server_base.cc:1034] running on GCE node
I20260928 14:50:18.235877 9479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:18.236711 9479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:18.237917 9479 hybrid_clock.cc:648] HybridClock initialized: now 1790607018237844 us; error 42 us; skew 500 ppm
I20260928 14:50:18.238181 9479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:18.240311 9479 webserver.cc:460] Webserver started at http://127.8.181.3:40503/ using document root <none> and password file <none>
I20260928 14:50:18.240988 9479 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:18.241120 9479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:18.241405 9479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 14:50:18.244009 9479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data/instance:
uuid: "658e483a10314e8d93c2f6e9084f2a91"
format_stamp: "Formatted at 2026-09-28 14:50:18 on dist-test-slave-g607"
I20260928 14:50:18.244714 9479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/instance:
uuid: "658e483a10314e8d93c2f6e9084f2a91"
format_stamp: "Formatted at 2026-09-28 14:50:18 on dist-test-slave-g607"
I20260928 14:50:18.249742 9479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260928 14:50:18.253019 9496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:18.254295 9479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:18.254426 9479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal
uuid: "658e483a10314e8d93c2f6e9084f2a91"
format_stamp: "Formatted at 2026-09-28 14:50:18 on dist-test-slave-g607"
I20260928 14:50:18.254585 9479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:18.278467 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.278909 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:18.279054 9110 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 LEADER]: Rejecting Update request from peer c253b9f3f43c4b8ba7cd5c7d4edac656 for earlier term 2. Current term is 3. Ops: []
I20260928 14:50:18.279963 9502 consensus_queue.cc:1046] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 14:50:18.280431 9502 consensus_queue.cc:1225] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Peer c6b99976d8024a79a0603523b9d32f29 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260928 14:50:18.280612 9501 raft_consensus.cc:3032] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 14:50:18.280730 9501 raft_consensus.cc:729] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c253b9f3f43c4b8ba7cd5c7d4edac656, State: Running, Role: LEADER
I20260928 14:50:18.280720 9479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:18.281116 9501 consensus_queue.cc:260] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:18.281718 9479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:18.281945 9501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 2 FOLLOWER]: Advancing to term 3
I20260928 14:50:18.282073 9479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:18.283176 9479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 14:50:18.284929 9479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 14:50:18.284998 9479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:18.285094 9479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 14:50:18.285135 9479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:18.315279 9479 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.3:44119
I20260928 14:50:18.315318 9613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.3:44119 every 8 connection(s)
I20260928 14:50:18.316404 9479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/data/info.pb
I20260928 14:50:18.321029 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 9479
I20260928 14:50:18.321205 8916 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/instance
I20260928 14:50:18.333112 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:18.333402 9614 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:18.333685 9615 heartbeater.cc:347] Connected to a master server at 127.8.181.62:43149
I20260928 14:50:18.333812 9615 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:18.334265 9614 heartbeater.cc:511] Master 127.8.181.60:39777 requested a full tablet report, sending...
I20260928 14:50:18.334317 9615 heartbeater.cc:511] Master 127.8.181.62:43149 requested a full tablet report, sending...
I20260928 14:50:18.335105 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:18.335227 9616 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:18.335587 9616 heartbeater.cc:511] Master 127.8.181.61:41417 requested a full tablet report, sending...
I20260928 14:50:18.335662 9100 ts_manager.cc:194] Registered new tserver with Master: 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:18.335903 8956 ts_manager.cc:194] Registered new tserver with Master: 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:18.336503 9028 ts_manager.cc:194] Registered new tserver with Master: 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:18.337308 9100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.181.3:57575
I20260928 14:50:18.344290 8916 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 14:50:18.370594 9100 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_6cba99c72b0e4f9db52e0250e99fc169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.370800 9096 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_29da3cc9cf864551818aa1698844d16e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.370870 9098 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_768839606cef48a983caba4e475a25ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.371613 9099 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_39747ef18a9c47e588e4bbfd350ccb51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.372476 9098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768839606cef48a983caba4e475a25ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.372816 9097 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_a86879259afa47e995b992aa89b72db0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.373392 9097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a86879259afa47e995b992aa89b72db0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:18.374140 9096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29da3cc9cf864551818aa1698844d16e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:18.374888 9099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39747ef18a9c47e588e4bbfd350ccb51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.375983 9095 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_3c82efdbe52645b486f286bf068195cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.376657 9095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c82efdbe52645b486f286bf068195cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.376593 9091 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_c0c9576cde8d43d8ad22800120132be6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.377220 9091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0c9576cde8d43d8ad22800120132be6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:18.378358 9100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cba99c72b0e4f9db52e0250e99fc169 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.378106 9094 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_34b9cf67872d4a838f713aa88b8af524"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.378708 9094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34b9cf67872d4a838f713aa88b8af524 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.379956 9093 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_7d14afa6ece846058475ffff64344f28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.380605 9093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d14afa6ece846058475ffff64344f28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.382220 9092 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_c69834856cf0470ba414c6efd0ce2461"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.382784 9092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c69834856cf0470ba414c6efd0ce2461 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.386266 9037 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Refusing update from remote peer c6b99976d8024a79a0603523b9d32f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260928 14:50:18.386710 8965 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Refusing update from remote peer c6b99976d8024a79a0603523b9d32f29: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260928 14:50:18.386876 9484 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 14:50:18.387372 9484 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 14:50:18.394201 9474 heartbeater.cc:503] Master 127.8.181.62:43149 was elected leader, sending a full tablet report...
I20260928 14:50:18.401787 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.402108 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:18.419909 9217 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.420221 9217 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:18.421509 9099 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_29da3cc9cf864551818aa1698844d16e" } new_table_name: "default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e" modify_external_catalogs: true
I20260928 14:50:18.423770 9096 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_768839606cef48a983caba4e475a25ab" } new_table_name: "default.Table_dcd0bd483d494cb1b9761b88cfef0abe" modify_external_catalogs: true
I20260928 14:50:18.426082 9098 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_39747ef18a9c47e588e4bbfd350ccb51" } new_table_name: "default.Table_29cf51e464394e13b0accc884533d3fb" modify_external_catalogs: true
I20260928 14:50:18.426601 9203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b99976d8024a79a0603523b9d32f29. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.426842 9203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:18.429591 9484 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.429829 9484 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:18.434779 9097 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_a86879259afa47e995b992aa89b72db0" } new_table_name: "default.Table_27561646684249339361c90b5ac1894e" modify_external_catalogs: true
I20260928 14:50:18.437004 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.437273 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:18.456411 9203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c6b99976d8024a79a0603523b9d32f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:18.456643 9203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:18.466785 9091 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_3c82efdbe52645b486f286bf068195cb" } new_table_name: "default.Table_0ce655bb76b049b89738d27cdd17f485" modify_external_catalogs: true
I20260928 14:50:18.468568 9093 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_34b9cf67872d4a838f713aa88b8af524" } modify_external_catalogs: true
I20260928 14:50:18.468860 9093 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_34b9cf67872d4a838f713aa88b8af524" } modify_external_catalogs: true
I20260928 14:50:18.469543 9095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_c69834856cf0470ba414c6efd0ce2461" } modify_external_catalogs: true
I20260928 14:50:18.469775 9095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_c69834856cf0470ba414c6efd0ce2461" } modify_external_catalogs: true
I20260928 14:50:18.469970 9100 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_6cba99c72b0e4f9db52e0250e99fc169" } modify_external_catalogs: true
I20260928 14:50:18.470223 9100 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_6cba99c72b0e4f9db52e0250e99fc169" } modify_external_catalogs: true
I20260928 14:50:18.471659 9094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_c0c9576cde8d43d8ad22800120132be6" } modify_external_catalogs: true
I20260928 14:50:18.471859 9094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_c0c9576cde8d43d8ad22800120132be6" } modify_external_catalogs: true
I20260928 14:50:18.472882 9092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_7d14afa6ece846058475ffff64344f28" } modify_external_catalogs: true
I20260928 14:50:18.473088 9092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49748:
table { table_name: "default.Table_7d14afa6ece846058475ffff64344f28" } modify_external_catalogs: true
W20260928 14:50:18.483538 9099 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4484f878a2540799bcee1a35e9a2b69 consensus state has no leader
W20260928 14:50:18.485121 9096 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00b4aec190f94cbab007bd0614588ebd consensus state has no leader
W20260928 14:50:18.486181 9098 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc9c25765bb54a328d903d65ad13802b has no consensus state
I20260928 14:50:18.507967 9408 tablet_service.cc:1467] Processing CreateTablet for tablet e4484f878a2540799bcee1a35e9a2b69 (DEFAULT_TABLE table=default.Table_29da3cc9cf864551818aa1698844d16e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.509577 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4484f878a2540799bcee1a35e9a2b69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:18.510178 9097 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d69b1a90be4f4a1681bd5d83b0228d92 has no consensus state
I20260928 14:50:18.510171 9095 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0586d6cfe0b945c3b55e04f17d6981c9
W20260928 14:50:18.510596 9091 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d800c3135bb44f994baea4732245aea has no consensus state
I20260928 14:50:18.511251 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 00b4aec190f94cbab007bd0614588ebd (DEFAULT_TABLE table=default.Table_768839606cef48a983caba4e475a25ab [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.511636 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b4aec190f94cbab007bd0614588ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.512087 9100 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 28bafedeb85e4667847e89989f089180
I20260928 14:50:18.512538 9093 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0206319b455d4d33bfcf3e424e3ed620
I20260928 14:50:18.513600 9094 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f3112c8ad8454309af4cfe673ae091c4
I20260928 14:50:18.514564 9092 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8bbffd84a13c43128d0c8e1323f859a7
W20260928 14:50:18.515475 9087 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cc9c25765bb54a328d903d65ad13802b has no consensus state
I20260928 14:50:18.540355 9675 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.541152 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 00b4aec190f94cbab007bd0614588ebd (DEFAULT_TABLE table=default.Table_768839606cef48a983caba4e475a25ab [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.542621 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b4aec190f94cbab007bd0614588ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.544617 9675 tablet_bootstrap.cc:654] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.545650 9267 tablet_service.cc:1467] Processing CreateTablet for tablet e4484f878a2540799bcee1a35e9a2b69 (DEFAULT_TABLE table=default.Table_29da3cc9cf864551818aa1698844d16e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.545889 9675 log.cc:824] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:18.546099 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4484f878a2540799bcee1a35e9a2b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.548319 9265 tablet_service.cc:1467] Processing CreateTablet for tablet cc9c25765bb54a328d903d65ad13802b (DEFAULT_TABLE table=default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.548758 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9c25765bb54a328d903d65ad13802b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.550194 9092 master_service.cc:946] ReplaceTablet: received request to replace tablet e4484f878a2540799bcee1a35e9a2b69 from {username='slave'} at 127.0.0.1:49748
I20260928 14:50:18.550571 9264 tablet_service.cc:1467] Processing CreateTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 (DEFAULT_TABLE table=default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.550989 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69b1a90be4f4a1681bd5d83b0228d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.551896 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 4d800c3135bb44f994baea4732245aea (DEFAULT_TABLE table=default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.552356 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d800c3135bb44f994baea4732245aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.552280 9549 tablet_service.cc:1467] Processing CreateTablet for tablet e4484f878a2540799bcee1a35e9a2b69 (DEFAULT_TABLE table=default.Table_29da3cc9cf864551818aa1698844d16e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.553931 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 4d800c3135bb44f994baea4732245aea (DEFAULT_TABLE table=default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.554105 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 4d800c3135bb44f994baea4732245aea (DEFAULT_TABLE table=default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.554512 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d800c3135bb44f994baea4732245aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.554528 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4484f878a2540799bcee1a35e9a2b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.555084 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d800c3135bb44f994baea4732245aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.556826 9092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Sending DeleteTablet for 3 replicas of tablet e4484f878a2540799bcee1a35e9a2b69
I20260928 14:50:18.557375 9092 catalog_manager.cc:6565] ReplaceTablet: tablet e4484f878a2540799bcee1a35e9a2b69 deleted and replaced by tablet 889a73294bec4aac92f4eaaf45adde41
I20260928 14:50:18.557868 9406 tablet_service.cc:1467] Processing CreateTablet for tablet cc9c25765bb54a328d903d65ad13802b (DEFAULT_TABLE table=default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.557878 9546 tablet_service.cc:1467] Processing CreateTablet for tablet cc9c25765bb54a328d903d65ad13802b (DEFAULT_TABLE table=default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.558235 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9c25765bb54a328d903d65ad13802b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.558328 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9c25765bb54a328d903d65ad13802b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.559068 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:37334
I20260928 14:50:18.559695 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:34138
I20260928 14:50:18.559760 9545 tablet_service.cc:1467] Processing CreateTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 (DEFAULT_TABLE table=default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.560135 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69b1a90be4f4a1681bd5d83b0228d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.560935 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 00b4aec190f94cbab007bd0614588ebd (DEFAULT_TABLE table=default.Table_768839606cef48a983caba4e475a25ab [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.561386 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b4aec190f94cbab007bd0614588ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.562274 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:46814
I20260928 14:50:18.563581 9408 tablet_service.cc:1467] Processing CreateTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 (DEFAULT_TABLE table=default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.563910 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69b1a90be4f4a1681bd5d83b0228d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.567830 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 889a73294bec4aac92f4eaaf45adde41 (DEFAULT_TABLE table=default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.568262 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 889a73294bec4aac92f4eaaf45adde41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.570792 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 889a73294bec4aac92f4eaaf45adde41 (DEFAULT_TABLE table=default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.571025 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 889a73294bec4aac92f4eaaf45adde41 (DEFAULT_TABLE table=default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.571244 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 889a73294bec4aac92f4eaaf45adde41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.571390 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 889a73294bec4aac92f4eaaf45adde41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.583299 9092 master_service.cc:946] ReplaceTablet: received request to replace tablet 00b4aec190f94cbab007bd0614588ebd from {username='slave'} at 127.0.0.1:49748
I20260928 14:50:18.585410 9170 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 14:50:18.585657 9094 master_service.cc:946] ReplaceTablet: received request to replace tablet e4484f878a2540799bcee1a35e9a2b69 from {username='slave'} at 127.0.0.1:49748
I20260928 14:50:18.586191 9093 master_service.cc:946] ReplaceTablet: received request to replace tablet 00b4aec190f94cbab007bd0614588ebd from {username='slave'} at 127.0.0.1:49748
I20260928 14:50:18.586191 9100 master_service.cc:946] ReplaceTablet: received request to replace tablet 00b4aec190f94cbab007bd0614588ebd from {username='slave'} at 127.0.0.1:49748
I20260928 14:50:18.589998 9092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Sending DeleteTablet for 3 replicas of tablet 00b4aec190f94cbab007bd0614588ebd
I20260928 14:50:18.590404 9092 catalog_manager.cc:6565] ReplaceTablet: tablet 00b4aec190f94cbab007bd0614588ebd deleted and replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867
I20260928 14:50:18.590786 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:46814
I20260928 14:50:18.591046 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:37334
I20260928 14:50:18.596243 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:34138
I20260928 14:50:18.597766 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 (DEFAULT_TABLE table=default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.598318 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380d31a0eb2147f8bb4c32d77cf53867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.598745 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 (DEFAULT_TABLE table=default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.599112 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380d31a0eb2147f8bb4c32d77cf53867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:18.604972 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 (DEFAULT_TABLE table=default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.605295 9680 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.605348 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 380d31a0eb2147f8bb4c32d77cf53867. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:18.613087 9084 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e4484f878a2540799bcee1a35e9a2b69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4484f878a2540799bcee1a35e9a2b69 already in progress: creating tablet
W20260928 14:50:18.614434 9084 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e4484f878a2540799bcee1a35e9a2b69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4484f878a2540799bcee1a35e9a2b69 already in progress: creating tablet
W20260928 14:50:18.615718 9085 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e4484f878a2540799bcee1a35e9a2b69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4484f878a2540799bcee1a35e9a2b69 already in progress: creating tablet
I20260928 14:50:18.616134 9680 tablet_bootstrap.cc:654] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:18.616392 9084 catalog_manager.cc:4808] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 00b4aec190f94cbab007bd0614588ebd because the tablet was not found. No further retry: Not found: Tablet not found: 00b4aec190f94cbab007bd0614588ebd
W20260928 14:50:18.617113 9084 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 00b4aec190f94cbab007bd0614588ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b4aec190f94cbab007bd0614588ebd already in progress: creating tablet
W20260928 14:50:18.617703 9085 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 00b4aec190f94cbab007bd0614588ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b4aec190f94cbab007bd0614588ebd already in progress: creating tablet
I20260928 14:50:18.618703 9100 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_5385c5050b68493092e5e06d92ddf17f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.619056 9681 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:18.619280 9100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5385c5050b68493092e5e06d92ddf17f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.621438 9093 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_dbeb98ade54a4a2a87d9bd9264151924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.621973 9093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbeb98ade54a4a2a87d9bd9264151924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.623991 9675 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.624342 9675 ts_tablet_manager.cc:1397] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.009s
I20260928 14:50:18.625973 9092 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_5709d735ad6248279ee59d750c50ec93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.626500 9092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5709d735ad6248279ee59d750c50ec93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.628044 9681 tablet_bootstrap.cc:654] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.629266 9681 log.cc:824] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:18.632797 8916 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu pid 9067
I20260928 14:50:18.635736 9675 raft_consensus.cc:348] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.636296 9675 raft_consensus.cc:374] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.636425 9675 raft_consensus.cc:729] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.637181 9675 consensus_queue.cc:260] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.638068 9131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260928 14:50:18.641203 9680 log.cc:824] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:18.642836 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:18.643929 9675 ts_tablet_manager.cc:1428] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
I20260928 14:50:18.644918 9675 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.646018 9681 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.646355 9681 ts_tablet_manager.cc:1397] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.006s
I20260928 14:50:18.646941 9675 tablet_bootstrap.cc:654] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.656469 9680 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.656735 9680 ts_tablet_manager.cc:1397] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.052s user 0.010s sys 0.000s
I20260928 14:50:18.659255 9681 raft_consensus.cc:348] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.659865 9681 raft_consensus.cc:374] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.660029 9681 raft_consensus.cc:729] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.660861 9681 consensus_queue.cc:260] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.664880 9675 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.665035 9675 ts_tablet_manager.cc:1397] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.012s
I20260928 14:50:18.665730 9681 ts_tablet_manager.cc:1428] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.019s user 0.014s sys 0.004s
I20260928 14:50:18.666085 9675 raft_consensus.cc:348] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.666299 9675 raft_consensus.cc:374] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.666392 9675 raft_consensus.cc:729] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.666714 9675 consensus_queue.cc:260] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.668589 9680 raft_consensus.cc:348] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.668993 9680 raft_consensus.cc:374] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.669088 9680 raft_consensus.cc:729] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.669855 9675 ts_tablet_manager.cc:1428] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 14:50:18.669751 9680 consensus_queue.cc:260] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.670137 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:18.671705 9675 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.673439 9675 tablet_bootstrap.cc:654] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.673799 9681 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.675536 9681 tablet_bootstrap.cc:654] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.677733 9680 ts_tablet_manager.cc:1428] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.021s user 0.014s sys 0.005s
I20260928 14:50:18.677977 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:18.681687 9680 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.683125 9680 tablet_bootstrap.cc:654] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.683919 9681 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.684142 9681 ts_tablet_manager.cc:1397] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.008s
I20260928 14:50:18.685190 9681 raft_consensus.cc:348] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.685506 9681 raft_consensus.cc:374] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.685701 9681 raft_consensus.cc:729] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.686056 9681 consensus_queue.cc:260] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.686713 9675 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.686852 9675 ts_tablet_manager.cc:1397] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260928 14:50:18.687654 9680 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.687541 9675 raft_consensus.cc:348] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.687747 9675 raft_consensus.cc:374] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.687793 9680 ts_tablet_manager.cc:1397] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20260928 14:50:18.687800 9675 raft_consensus.cc:729] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.688072 9675 consensus_queue.cc:260] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.688717 9680 raft_consensus.cc:348] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.688926 9680 raft_consensus.cc:374] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.689019 9680 raft_consensus.cc:729] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.689261 9680 consensus_queue.cc:260] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.689858 9680 ts_tablet_manager.cc:1428] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:18.690171 9680 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.689477 9675 ts_tablet_manager.cc:1428] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:18.690582 9675 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.691864 9680 tablet_bootstrap.cc:654] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.692071 9692 raft_consensus.cc:482] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:18.692369 9692 raft_consensus.cc:504] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.696403 9681 ts_tablet_manager.cc:1428] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260928 14:50:18.698980 9692 leader_election.cc:288] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:18.700947 9681 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.701864 9675 tablet_bootstrap.cc:654] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.703071 9681 tablet_bootstrap.cc:654] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.727047 9675 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.727200 9681 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.727238 9675 ts_tablet_manager.cc:1397] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.011s
I20260928 14:50:18.727365 9681 ts_tablet_manager.cc:1397] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.011s
I20260928 14:50:18.728109 9675 raft_consensus.cc:348] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.728399 9675 raft_consensus.cc:374] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.728544 9675 raft_consensus.cc:729] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.728948 9681 raft_consensus.cc:348] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.729189 9681 raft_consensus.cc:374] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.729274 9681 raft_consensus.cc:729] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.729230 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:18.729573 9681 consensus_queue.cc:260] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.729512 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:18.730116 9681 ts_tablet_manager.cc:1428] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:18.730393 9681 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.730620 9680 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.730778 9680 ts_tablet_manager.cc:1397] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.041s user 0.020s sys 0.016s
I20260928 14:50:18.731470 9680 raft_consensus.cc:348] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.731676 9680 raft_consensus.cc:374] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.731742 9680 raft_consensus.cc:729] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.731832 9681 tablet_bootstrap.cc:654] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.731976 9680 consensus_queue.cc:260] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.732525 9680 ts_tablet_manager.cc:1428] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:18.732806 9680 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:18.733481 9219 leader_election.cc:341] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:18.735692 9680 tablet_bootstrap.cc:654] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.735973 9692 raft_consensus.cc:482] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:18.736141 9692 raft_consensus.cc:504] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.736260 9675 consensus_queue.cc:260] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.736716 9692 leader_election.cc:288] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.736728 9428 raft_consensus.cc:2454] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:18.738032 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:18.738299 9427 raft_consensus.cc:2454] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:18.738770 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:18.738842 9220 leader_election.cc:302] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:18.739226 9692 raft_consensus.cc:2781] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 14:50:18.739300 9219 leader_election.cc:341] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:18.739357 9692 raft_consensus.cc:482] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:18.739472 9692 raft_consensus.cc:3037] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.741685 9675 ts_tablet_manager.cc:1428] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260928 14:50:18.741974 9675 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.742333 9692 raft_consensus.cc:504] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.743202 9681 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.743324 9681 ts_tablet_manager.cc:1397] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.001s
I20260928 14:50:18.743892 9675 tablet_bootstrap.cc:654] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.743999 9681 raft_consensus.cc:348] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.744246 9681 raft_consensus.cc:374] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.744343 9681 raft_consensus.cc:729] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.744184 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:18.744544 9681 consensus_queue.cc:260] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.745007 9681 ts_tablet_manager.cc:1428] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:18.745222 9681 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:18.745787 9219 leader_election.cc:341] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:18.746866 9681 tablet_bootstrap.cc:654] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.747380 9220 leader_election.cc:302] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:18.747838 9692 leader_election.cc:288] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.748032 9692 raft_consensus.cc:2781] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:18.748145 9692 raft_consensus.cc:482] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:18.748282 9692 raft_consensus.cc:3037] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.751145 9692 raft_consensus.cc:504] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.752122 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
W20260928 14:50:18.752625 9219 leader_election.cc:341] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:18.752789 9692 leader_election.cc:288] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:18.748126 9680 tablet_bootstrap.cc:492] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.753023 9680 ts_tablet_manager.cc:1397] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
I20260928 14:50:18.753777 9680 raft_consensus.cc:348] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.754033 9680 raft_consensus.cc:374] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.754124 9680 raft_consensus.cc:729] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.754355 9680 consensus_queue.cc:260] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.754920 9680 ts_tablet_manager.cc:1428] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:18.755483 9680 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.757069 9680 tablet_bootstrap.cc:654] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.761852 9675 tablet_bootstrap.cc:492] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.762086 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:18.762063 9675 ts_tablet_manager.cc:1397] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.004s
I20260928 14:50:18.762277 9428 raft_consensus.cc:3037] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.763065 9681 tablet_bootstrap.cc:492] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.763245 9681 ts_tablet_manager.cc:1397] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.007s
I20260928 14:50:18.763267 9675 raft_consensus.cc:348] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.763576 9675 raft_consensus.cc:374] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.763656 9675 raft_consensus.cc:729] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.763899 9675 consensus_queue.cc:260] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.764477 9675 ts_tablet_manager.cc:1428] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:18.765987 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:18.766181 9427 raft_consensus.cc:3037] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.767630 9675 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.769124 9681 raft_consensus.cc:348] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.769347 9681 raft_consensus.cc:374] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.769424 9681 raft_consensus.cc:729] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.769675 9681 consensus_queue.cc:260] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.771076 9681 ts_tablet_manager.cc:1428] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 14:50:18.771347 9681 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.772431 9427 raft_consensus.cc:2454] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:18.772620 9675 tablet_bootstrap.cc:654] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.772921 9220 leader_election.cc:302] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:18.774075 9681 tablet_bootstrap.cc:654] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.774590 9680 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.774855 9680 ts_tablet_manager.cc:1397] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.000s
I20260928 14:50:18.775625 9680 raft_consensus.cc:348] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.775846 9680 raft_consensus.cc:374] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.775923 9680 raft_consensus.cc:729] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.775951 9428 raft_consensus.cc:2454] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:18.776185 9705 raft_consensus.cc:2781] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:18.776633 9220 leader_election.cc:302] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:18.777025 9692 raft_consensus.cc:2781] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:18.777463 9692 raft_consensus.cc:686] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:18.778189 9692 consensus_queue.cc:237] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.780576 9705 raft_consensus.cc:686] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:18.781122 9705 consensus_queue.cc:237] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.785597 9680 consensus_queue.cc:260] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.786527 9680 ts_tablet_manager.cc:1428] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260928 14:50:18.787369 9680 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.789327 9680 tablet_bootstrap.cc:654] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.791289 9675 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.791661 9675 ts_tablet_manager.cc:1397] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260928 14:50:18.792290 9681 tablet_bootstrap.cc:492] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.792479 9681 ts_tablet_manager.cc:1397] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.008s
I20260928 14:50:18.792811 9675 raft_consensus.cc:348] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.793030 9675 raft_consensus.cc:374] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.793123 9675 raft_consensus.cc:729] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.793375 9681 raft_consensus.cc:348] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.793352 9675 consensus_queue.cc:260] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.793681 9681 raft_consensus.cc:374] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.793812 9681 raft_consensus.cc:729] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.794409 9681 consensus_queue.cc:260] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.794983 9681 ts_tablet_manager.cc:1428] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:18.795269 9681 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.796816 9681 tablet_bootstrap.cc:654] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.800865 9675 ts_tablet_manager.cc:1428] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:18.804451 9675 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:18.806072 9675 tablet_bootstrap.cc:654] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.807190 9680 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.807202 9681 tablet_bootstrap.cc:492] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.807328 9681 ts_tablet_manager.cc:1397] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260928 14:50:18.807425 9680 ts_tablet_manager.cc:1397] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.012s
I20260928 14:50:18.807963 9681 raft_consensus.cc:348] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.808171 9681 raft_consensus.cc:374] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.808251 9681 raft_consensus.cc:729] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.808358 9680 raft_consensus.cc:348] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.808475 9681 consensus_queue.cc:260] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.808614 9680 raft_consensus.cc:374] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.808782 9680 raft_consensus.cc:729] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.809042 9680 consensus_queue.cc:260] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.809751 9680 ts_tablet_manager.cc:1428] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:18.810441 9681 ts_tablet_manager.cc:1428] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:18.814633 9680 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.816053 9680 tablet_bootstrap.cc:654] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.818593 9675 tablet_bootstrap.cc:492] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:18.818734 9675 ts_tablet_manager.cc:1397] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20260928 14:50:18.819151 9680 tablet_bootstrap.cc:492] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.819281 9680 ts_tablet_manager.cc:1397] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260928 14:50:18.819376 9675 raft_consensus.cc:348] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.819582 9675 raft_consensus.cc:374] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.819641 9675 raft_consensus.cc:729] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.819841 9675 consensus_queue.cc:260] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.819928 9680 raft_consensus.cc:348] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.820139 9680 raft_consensus.cc:374] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.820225 9680 raft_consensus.cc:729] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:18.820297 9617 tablet.cc:2369] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:18.820433 9680 consensus_queue.cc:260] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.820988 9680 ts_tablet_manager.cc:1428] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:18.824258 9675 ts_tablet_manager.cc:1428] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 14:50:18.868716 9100 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_6fbaf4d9bce042248e29b61994dc2384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.869415 9100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fbaf4d9bce042248e29b61994dc2384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.871279 9099 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_ec0feb0e0b194af7beeb68c4666c5ea6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.872339 9097 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_ad0a635688444f97b3c009b952ebe465"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.872435 9480 tablet.cc:2369] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 14:50:18.872783 9097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad0a635688444f97b3c009b952ebe465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.873898 9092 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_40ee866dbebc49a98a8bdfb97554b162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.874961 9094 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_5cf2132eafc942ba8344d4eb8869ab1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.875039 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 (DEFAULT_TABLE table=default.Table_dbeb98ade54a4a2a87d9bd9264151924 [id=a59e94a47bd34251847688436f6c882a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.875389 9095 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:18.875561 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:18.876212 9095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.876163 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 (DEFAULT_TABLE table=default.Table_dbeb98ade54a4a2a87d9bd9264151924 [id=a59e94a47bd34251847688436f6c882a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:18.876562 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:18.877086 9094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cf2132eafc942ba8344d4eb8869ab1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:18.879006 9099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:18.880349 9092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ee866dbebc49a98a8bdfb97554b162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.881218 9096 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "default.Table_79b89ecacda14a678766fdc9f414d3ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:18.881701 9096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79b89ecacda14a678766fdc9f414d3ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:18.884057 9691 raft_consensus.cc:482] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:18.884303 9691 raft_consensus.cc:504] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.884835 9681 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:18.885963 8916 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu with pid 9067
I20260928 14:50:18.886209 9691 leader_election.cc:288] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.886444 9681 tablet_bootstrap.cc:654] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:18.894801 9335 tablet.cc:2369] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:18.897085 9691 raft_consensus.cc:482] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:18.897249 9691 raft_consensus.cc:504] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:18.897810 9691 leader_election.cc:288] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.898062 9680 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:18.899677 9680 tablet_bootstrap.cc:654] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:18.907929 9681 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:18.908087 9681 ts_tablet_manager.cc:1397] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.011s
I20260928 14:50:18.908855 9681 raft_consensus.cc:348] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.909080 9681 raft_consensus.cc:374] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.909171 9681 raft_consensus.cc:729] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.909384 9681 consensus_queue.cc:260] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.910074 9681 ts_tablet_manager.cc:1428] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:18.914927 9680 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:18.915109 9680 ts_tablet_manager.cc:1397] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.005s
I20260928 14:50:18.915858 9680 raft_consensus.cc:348] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.916126 9680 raft_consensus.cc:374] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:18.916251 9680 raft_consensus.cc:729] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:18.916545 9680 consensus_queue.cc:260] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.918032 9680 ts_tablet_manager.cc:1428] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:18.918277 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:18.918625 9428 raft_consensus.cc:2379] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 658e483a10314e8d93c2f6e9084f2a91 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:18.919255 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:18.919564 9427 raft_consensus.cc:2379] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 658e483a10314e8d93c2f6e9084f2a91 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:18.921025 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "889a73294bec4aac92f4eaaf45adde41" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:18.921057 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4484f878a2540799bcee1a35e9a2b69" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:18.922231 9497 leader_election.cc:302] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:18.922618 9691 raft_consensus.cc:3037] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.922825 9497 leader_election.cc:302] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:18.923516 9720 raft_consensus.cc:3037] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.925491 9691 raft_consensus.cc:2726] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:18.925652 9720 raft_consensus.cc:2726] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:18.929714 9500 connection.cc:535] server connection from 127.0.0.1:37334 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:18.929728 9221 connection.cc:535] server connection from 127.0.0.1:46814 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:18.930250 9614 heartbeater.cc:644] Failed to heartbeat to 127.8.181.60:39777 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.181.60:39777 (error 108)
W20260928 14:50:18.930243 9623 connection.cc:535] client connection to 127.8.181.60:39777 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:18.931070 9473 heartbeater.cc:644] Failed to heartbeat to 127.8.181.60:39777 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.181.60:39777 (error 108)
W20260928 14:50:18.931216 9623 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.181.60:39777)
W20260928 14:50:18.931597 9623 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.181.60:39777)
W20260928 14:50:18.931982 9623 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.181.60:39777)
W20260928 14:50:18.932174 9014 connection.cc:535] server connection from 127.0.0.1:49168 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:18.932454 9716 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 14:50:18.930771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.181.60:39777 (local address 127.8.181.3:39029)
0928 14:50:18.931021 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0928 14:50:18.931225 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":112}
W20260928 14:50:18.932812 9332 heartbeater.cc:644] Failed to heartbeat to 127.8.181.60:39777 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.181.60:39777 (error 108)
W20260928 14:50:18.933267 9623 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.181.60:39777)
I20260928 14:50:18.956395 9720 raft_consensus.cc:482] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:18.956584 9720 raft_consensus.cc:504] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.957122 9720 leader_election.cc:288] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.957512 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d800c3135bb44f994baea4732245aea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:18.957554 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d800c3135bb44f994baea4732245aea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:18.957763 9427 raft_consensus.cc:2454] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:18.957791 9286 raft_consensus.cc:2454] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:18.958148 9498 leader_election.cc:302] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:18.958388 9720 raft_consensus.cc:2781] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:18.958523 9720 raft_consensus.cc:482] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:18.958626 9720 raft_consensus.cc:3037] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.960739 9720 raft_consensus.cc:504] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:18.961201 9720 leader_election.cc:288] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:18.961545 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d800c3135bb44f994baea4732245aea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:18.961585 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d800c3135bb44f994baea4732245aea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:18.961745 9286 raft_consensus.cc:3037] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.961766 9427 raft_consensus.cc:3037] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:18.963482 9427 raft_consensus.cc:2454] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:18.963563 9286 raft_consensus.cc:2454] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:18.963779 9498 leader_election.cc:302] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:18.964048 9720 raft_consensus.cc:2781] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:18.964201 9720 raft_consensus.cc:686] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:18.964735 9720 consensus_queue.cc:237] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.028178 9705 raft_consensus.cc:482] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:19.028357 9705 raft_consensus.cc:504] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.029016 9705 leader_election.cc:288] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.029484 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9c25765bb54a328d903d65ad13802b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:19.029749 9427 raft_consensus.cc:2454] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:19.030035 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9c25765bb54a328d903d65ad13802b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:19.030155 9220 leader_election.cc:302] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:19.030267 9569 raft_consensus.cc:2454] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:19.030431 9705 raft_consensus.cc:2781] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:19.030531 9705 raft_consensus.cc:482] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:19.030651 9705 raft_consensus.cc:3037] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.035391 9705 raft_consensus.cc:504] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.035923 9705 leader_election.cc:288] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.036301 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9c25765bb54a328d903d65ad13802b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:19.036338 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9c25765bb54a328d903d65ad13802b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:19.036473 9427 raft_consensus.cc:3037] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.036484 9569 raft_consensus.cc:3037] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.038347 9569 raft_consensus.cc:2454] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:19.038352 9427 raft_consensus.cc:2454] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:19.038702 9219 leader_election.cc:302] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:19.038975 9705 raft_consensus.cc:2781] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:19.039115 9705 raft_consensus.cc:686] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:19.039372 9705 consensus_queue.cc:237] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.059896 9687 raft_consensus.cc:482] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:19.060055 9687 raft_consensus.cc:504] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.061425 9687 leader_election.cc:288] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.067615 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69b1a90be4f4a1681bd5d83b0228d92" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:19.067847 9286 raft_consensus.cc:2454] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:19.068029 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69b1a90be4f4a1681bd5d83b0228d92" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:19.068272 9569 raft_consensus.cc:2454] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:19.068246 9360 leader_election.cc:302] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:19.068600 9687 raft_consensus.cc:2781] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:19.068614 9720 raft_consensus.cc:482] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:19.068725 9687 raft_consensus.cc:482] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:19.068820 9687 raft_consensus.cc:3037] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.068749 9720 raft_consensus.cc:504] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.069275 9720 leader_election.cc:288] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:19.069689 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b4aec190f94cbab007bd0614588ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:19.069761 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b4aec190f94cbab007bd0614588ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:19.069892 9286 raft_consensus.cc:2454] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:19.069962 9427 raft_consensus.cc:2454] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:19.070221 9497 leader_election.cc:302] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:19.070490 9720 raft_consensus.cc:2781] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:19.070590 9720 raft_consensus.cc:482] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:19.070659 9720 raft_consensus.cc:3037] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.071225 9687 raft_consensus.cc:504] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.071933 9687 leader_election.cc:288] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.072171 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69b1a90be4f4a1681bd5d83b0228d92" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:19.072345 9286 raft_consensus.cc:3037] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.072368 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69b1a90be4f4a1681bd5d83b0228d92" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:19.074229 9286 raft_consensus.cc:2454] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:19.074645 9360 leader_election.cc:302] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:19.075107 9569 raft_consensus.cc:3037] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.076960 9569 raft_consensus.cc:2454] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:19.077339 9687 raft_consensus.cc:2781] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:19.077767 9687 raft_consensus.cc:686] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:19.078476 9687 consensus_queue.cc:237] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.080271 9691 raft_consensus.cc:482] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:19.080410 9691 raft_consensus.cc:504] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.080958 9691 leader_election.cc:288] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:19.081287 9720 raft_consensus.cc:504] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.081672 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb86e4e2d234f7ab4de8fb8a1c6a4f8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:19.081876 9720 leader_election.cc:288] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:19.081888 9286 raft_consensus.cc:2454] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:19.082394 9497 leader_election.cc:302] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:19.082626 9720 raft_consensus.cc:2781] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:19.082762 9720 raft_consensus.cc:482] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:19.082744 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b4aec190f94cbab007bd0614588ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:19.082928 9286 raft_consensus.cc:3037] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.082864 9720 raft_consensus.cc:3037] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.085438 9286 raft_consensus.cc:2454] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:19.085469 9720 raft_consensus.cc:504] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.085835 9497 leader_election.cc:302] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:19.086097 9691 raft_consensus.cc:2781] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:19.086786 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00b4aec190f94cbab007bd0614588ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:19.086985 9428 raft_consensus.cc:3037] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:19.087567 9498 leader_election.cc:341] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 6bb86e4e2d234f7ab4de8fb8a1c6a4f8
W20260928 14:50:19.087909 9498 leader_election.cc:341] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 6bb86e4e2d234f7ab4de8fb8a1c6a4f8
I20260928 14:50:19.086423 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb86e4e2d234f7ab4de8fb8a1c6a4f8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:19.086095 9720 leader_election.cc:288] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:19.088227 9286 raft_consensus.cc:3037] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.088891 9691 raft_consensus.cc:686] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:19.089367 9428 raft_consensus.cc:2454] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:19.089294 9691 consensus_queue.cc:237] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.090644 9286 raft_consensus.cc:2454] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:19.090993 9497 leader_election.cc:302] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:19.091442 9691 raft_consensus.cc:2781] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:19.091568 9691 raft_consensus.cc:686] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:19.091778 9691 consensus_queue.cc:237] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.169675 9705 raft_consensus.cc:482] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:19.169852 9705 raft_consensus.cc:504] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.170485 9705 leader_election.cc:288] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.170933 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380d31a0eb2147f8bb4c32d77cf53867" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:19.171010 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380d31a0eb2147f8bb4c32d77cf53867" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:19.171144 9428 raft_consensus.cc:2454] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:19.171239 9569 raft_consensus.cc:2454] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:19.171526 9220 leader_election.cc:302] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:19.171797 9705 raft_consensus.cc:2781] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:19.171897 9705 raft_consensus.cc:482] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:19.171981 9705 raft_consensus.cc:3037] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.173883 9705 raft_consensus.cc:504] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.174360 9705 leader_election.cc:288] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:19.174770 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380d31a0eb2147f8bb4c32d77cf53867" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:19.174782 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "380d31a0eb2147f8bb4c32d77cf53867" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:19.174921 9428 raft_consensus.cc:3037] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.174921 9569 raft_consensus.cc:3037] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:19.177186 9569 raft_consensus.cc:2454] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:19.177186 9428 raft_consensus.cc:2454] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:19.177517 9219 leader_election.cc:302] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:19.177819 9705 raft_consensus.cc:2781] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:19.177975 9705 raft_consensus.cc:686] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:19.178247 9705 consensus_queue.cc:237] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:19.368886 9733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
I20260928 14:50:19.369150 9733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:19.369876 9733 leader_election.cc:288] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:19.370240 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" candidate_term: 4 candidate_status { last_received { term: 3 index: 36 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
W20260928 14:50:19.371755 9014 leader_election.cc:334] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:19.371871 9014 leader_election.cc:302] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba; no voters: c253b9f3f43c4b8ba7cd5c7d4edac656, c6b99976d8024a79a0603523b9d32f29
I20260928 14:50:19.372098 9733 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 14:50:19.379271 9736 raft_consensus.cc:482] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
I20260928 14:50:19.379432 9736 raft_consensus.cc:504] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:19.380059 9736 leader_election.cc:288] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:19.380470 9038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" is_pre_election: true
I20260928 14:50:19.380703 9038 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c253b9f3f43c4b8ba7cd5c7d4edac656 in term 3.
I20260928 14:50:19.381170 8940 leader_election.cc:302] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c253b9f3f43c4b8ba7cd5c7d4edac656; no voters:
I20260928 14:50:19.381428 9736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 14:50:19.381584 9736 raft_consensus.cc:482] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6b99976d8024a79a0603523b9d32f29)
I20260928 14:50:19.381704 9736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 3 FOLLOWER]: Advancing to term 4
W20260928 14:50:19.382297 8941 leader_election.cc:334] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:19.383730 9736 raft_consensus.cc:504] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:19.384177 9736 leader_election.cc:288] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 election: Requested vote from peers 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417), c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777)
I20260928 14:50:19.384539 9038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
I20260928 14:50:19.384703 9038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 3 FOLLOWER]: Advancing to term 4
W20260928 14:50:19.385591 8941 leader_election.cc:334] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111)
I20260928 14:50:19.386955 9038 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c253b9f3f43c4b8ba7cd5c7d4edac656 in term 4.
I20260928 14:50:19.387387 8940 leader_election.cc:302] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c253b9f3f43c4b8ba7cd5c7d4edac656; no voters: c6b99976d8024a79a0603523b9d32f29
I20260928 14:50:19.387789 9736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 4 FOLLOWER]: Leader election won for term 4
I20260928 14:50:19.388170 9736 raft_consensus.cc:686] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [term 4 LEADER]: Becoming Leader. State: Replica: c253b9f3f43c4b8ba7cd5c7d4edac656, State: Running, Role: LEADER
I20260928 14:50:19.388491 9736 consensus_queue.cc:237] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 3.37, Last appended by leader: 37, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:19.389456 9739 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:19.389766 9739 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:19.555701 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--webserver_interface=127.8.181.60
--webserver_port=33241
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 14:50:19.642553 9705 consensus_queue.cc:1035] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:19.650815 9705 consensus_queue.cc:1035] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:19.660279 9748 consensus_queue.cc:1035] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:19.665166 9692 consensus_queue.cc:1035] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:19.827127 8941 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Couldn't send request to peer c6b99976d8024a79a0603523b9d32f29. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:19.879716 9038 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [term 4 FOLLOWER]: Refusing update from remote peer c253b9f3f43c4b8ba7cd5c7d4edac656: Log matching property violated. Preceding OpId in replica: term: 3 index: 36. Preceding OpId from leader: term: 4 index: 38. (index mismatch)
I20260928 14:50:19.880345 9739 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 36, Time since last communication: 0.000s
W20260928 14:50:19.880651 9741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:19.880925 9741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:19.881057 9741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 14:50:19.882997 9757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:19.883239 9757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:19.885609 9736 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:19.885891 9736 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:19.886042 9757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:19.886258 9757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba [sys.catalog]: This master's current role is: FOLLOWER
W20260928 14:50:19.891475 9741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:19.891578 9741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:19.891639 9741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:19.891707 9741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 14:50:19.905712 9740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 14:50:19.906062 9741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.181.60
--webserver_port=33241
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:19.907559 9741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 14:50:19.908394 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]
I20260928 14:50:19.908787 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]
I20260928 14:50:19.909103 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00]
I20260928 14:50:19.909570 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_5385c5050b68493092e5e06d92ddf17f [id=3b23d10e59cb42238f2274ea2aca9a93]
I20260928 14:50:19.909588 9741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 14:50:19.911201 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]
I20260928 14:50:19.911753 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]
I20260928 14:50:19.912400 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_dbeb98ade54a4a2a87d9bd9264151924 [id=a59e94a47bd34251847688436f6c882a]
I20260928 14:50:19.912752 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]
I20260928 14:50:19.913021 9740 catalog_manager.cc:669] Loaded metadata for table default.Table_5709d735ad6248279ee59d750c50ec93 [id=ef4d6748ff774d8ea1bccc23bd253b09]
I20260928 14:50:19.915089 9740 tablet_loader.cc:96] loaded metadata for tablet 13c8d33f877649129cdb70e4bb100a72 (table default.Table_5709d735ad6248279ee59d750c50ec93 [id=ef4d6748ff774d8ea1bccc23bd253b09])
I20260928 14:50:19.915570 9740 tablet_loader.cc:96] loaded metadata for tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e])
I20260928 14:50:19.915989 9740 tablet_loader.cc:96] loaded metadata for tablet 4d800c3135bb44f994baea4732245aea (table default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00])
I20260928 14:50:19.916360 9740 tablet_loader.cc:96] loaded metadata for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 (table default.Table_dbeb98ade54a4a2a87d9bd9264151924 [id=a59e94a47bd34251847688436f6c882a])
I20260928 14:50:19.916641 9740 tablet_loader.cc:96] loaded metadata for tablet 75680fd6738044759f8edeb9589f9bf4 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e])
I20260928 14:50:19.916920 9740 tablet_loader.cc:96] loaded metadata for tablet 889a73294bec4aac92f4eaaf45adde41 (table default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750])
I20260928 14:50:19.917320 9740 tablet_loader.cc:96] loaded metadata for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_5385c5050b68493092e5e06d92ddf17f [id=3b23d10e59cb42238f2274ea2aca9a93])
I20260928 14:50:19.917618 9740 tablet_loader.cc:96] loaded metadata for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312])
I20260928 14:50:19.917956 9740 tablet_loader.cc:96] loaded metadata for tablet d69b1a90be4f4a1681bd5d83b0228d92 (table default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e])
I20260928 14:50:19.918552 9740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 14:50:19.919556 9740 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:19.919627 9740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 14:50:19.920861 9740 catalog_manager.cc:1504] Loading token signing keys...
I20260928 14:50:19.921836 9740 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Loaded TSK: 0
I20260928 14:50:19.922225 9740 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 14:50:19.923382 9764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:19.924726 9765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:19.925310 9767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:19.925727 9741 server_base.cc:1034] running on GCE node
I20260928 14:50:19.926460 9741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:19.927836 9741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:19.929042 9741 hybrid_clock.cc:648] HybridClock initialized: now 1790607019928973 us; error 50 us; skew 500 ppm
I20260928 14:50:19.929330 9741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:19.935140 9741 webserver.cc:460] Webserver started at http://127.8.181.60:33241/ using document root <none> and password file <none>
I20260928 14:50:19.935763 9741 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:19.935882 9741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:19.940728 9741 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:19.943423 9773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:19.944613 9741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:19.944757 9741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
uuid: "c6b99976d8024a79a0603523b9d32f29"
format_stamp: "Formatted at 2026-09-28 14:50:16 on dist-test-slave-g607"
I20260928 14:50:19.945676 9741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:19.961897 9741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:19.962812 9741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:19.963127 9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:19.966467 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5709d735ad6248279ee59d750c50ec93" } modify_external_catalogs: true
I20260928 14:50:19.966739 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 889a73294bec4aac92f4eaaf45adde41 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:19.966861 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 889a73294bec4aac92f4eaaf45adde41 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:19.966791 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5709d735ad6248279ee59d750c50ec93" } modify_external_catalogs: true
I20260928 14:50:19.967240 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6b37f2324eea4e239c508ae9316abe0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:19.967708 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_56f6005a38c2496fafff14de10939fff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:19.968991 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b37f2324eea4e239c508ae9316abe0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:19.969547 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56f6005a38c2496fafff14de10939fff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:19.970513 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 00b4aec190f94cbab007bd0614588ebd from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:19.970836 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet e4484f878a2540799bcee1a35e9a2b69 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:19.975580 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6fbaf4d9bce042248e29b61994dc2384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:19.977120 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fbaf4d9bce042248e29b61994dc2384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:19.981815 8955 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 13c8d33f877649129cdb70e4bb100a72
I20260928 14:50:19.971479 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad0a635688444f97b3c009b952ebe465"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:19.982551 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad0a635688444f97b3c009b952ebe465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:19.975371 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:19.986748 9705 consensus_queue.cc:1035] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:19.993803 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 889a73294bec4aac92f4eaaf45adde41
I20260928 14:50:19.995025 9748 consensus_queue.cc:1035] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:19.997308 8953 catalog_manager.cc:6565] ReplaceTablet: tablet 889a73294bec4aac92f4eaaf45adde41 deleted and replaced by tablet d99589ea0ed0477589bd34d5acad6776
W20260928 14:50:20.000619 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.012921 9744 consensus_queue.cc:1035] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.050277 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 889a73294bec4aac92f4eaaf45adde41 with delete_type TABLET_DATA_DELETED (replaced by tablet d99589ea0ed0477589bd34d5acad6776) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.050994 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 889a73294bec4aac92f4eaaf45adde41 with delete_type TABLET_DATA_DELETED (replaced by tablet d99589ea0ed0477589bd34d5acad6776) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.051069 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 889a73294bec4aac92f4eaaf45adde41 with delete_type TABLET_DATA_DELETED (replaced by tablet d99589ea0ed0477589bd34d5acad6776) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.051311 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ec0feb0e0b194af7beeb68c4666c5ea6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.051932 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.052906 9809 consensus_queue.cc:1035] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.054111 8953 catalog_manager.cc:5495] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:20.054982 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5cf2132eafc942ba8344d4eb8869ab1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.056412 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_40ee866dbebc49a98a8bdfb97554b162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.056818 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cf2132eafc942ba8344d4eb8869ab1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:20.057143 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ee866dbebc49a98a8bdfb97554b162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.055510 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_79b89ecacda14a678766fdc9f414d3ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.058470 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79b89ecacda14a678766fdc9f414d3ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.055926 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5385c5050b68493092e5e06d92ddf17f" } new_table_name: "default.Table_0b922585518e4b42a56afd9214dd3de6" modify_external_catalogs: true
I20260928 14:50:20.061781 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]). Expected version 1 got 0
I20260928 14:50:20.067080 9809 consensus_queue.cc:1035] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.083510 9814 tablet_replica.cc:330] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:20.084064 9814 raft_consensus.cc:2229] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:20.084807 9814 raft_consensus.cc:2258] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.086603 9814 ts_tablet_manager.cc:1905] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.088457 9813 tablet_replica.cc:330] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:20.089568 9813 raft_consensus.cc:2229] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.090724 9813 raft_consensus.cc:2258] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.091858 9815 tablet_replica.cc:330] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.092979 9815 raft_consensus.cc:2229] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.093320 9815 raft_consensus.cc:2258] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.094985 9815 ts_tablet_manager.cc:1905] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.099131 9814 ts_tablet_manager.cc:1918] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.099279 9814 log.cc:1196] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/889a73294bec4aac92f4eaaf45adde41
I20260928 14:50:20.099787 9814 ts_tablet_manager.cc:1939] T 889a73294bec4aac92f4eaaf45adde41 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:20.102388 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 889a73294bec4aac92f4eaaf45adde41 (table default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:20.103750 9815 ts_tablet_manager.cc:1918] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.103974 9815 log.cc:1196] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/889a73294bec4aac92f4eaaf45adde41
I20260928 14:50:20.105310 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e" } new_table_name: "default.Table_3b9be1e8fd7f4e3d94603310ae22b552" modify_external_catalogs: true
I20260928 14:50:20.110440 9813 ts_tablet_manager.cc:1905] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:20.104815 9498 consensus_peers.cc:487] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bb86e4e2d234f7ab4de8fb8a1c6a4f8. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:20.111689 9815 ts_tablet_manager.cc:1939] T 889a73294bec4aac92f4eaaf45adde41 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.113665 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 889a73294bec4aac92f4eaaf45adde41 (table default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:20.114560 9749 consensus_queue.cc:1035] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.118772 9813 ts_tablet_manager.cc:1918] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.118963 9813 log.cc:1196] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/889a73294bec4aac92f4eaaf45adde41
I20260928 14:50:20.119583 9813 ts_tablet_manager.cc:1939] T 889a73294bec4aac92f4eaaf45adde41 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:20.121112 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 889a73294bec4aac92f4eaaf45adde41 (table default.Table_ab06c46b4fb64f44b87fcfbbfdf26a0e [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:20.155870 9749 consensus_queue.cc:1035] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260928 14:50:20.171768 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b50279cc5fcf43dc9ce0cafaacf93b3e has no consensus state
I20260928 14:50:20.173095 9748 consensus_queue.cc:1035] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.174711 9333 heartbeater.cc:503] Master 127.8.181.62:43149 was elected leader, sending a full tablet report...
I20260928 14:50:20.181373 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 889a73294bec4aac92f4eaaf45adde41 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.210873 9833 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.213155 9748 consensus_queue.cc:1035] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:20.215857 8939 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b50279cc5fcf43dc9ce0cafaacf93b3e has no consensus state
I20260928 14:50:20.216301 9835 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.222990 9834 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.230681 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dcd0bd483d494cb1b9761b88cfef0abe" } modify_external_catalogs: true
I20260928 14:50:20.231034 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dcd0bd483d494cb1b9761b88cfef0abe" } modify_external_catalogs: true
W20260928 14:50:20.231686 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d99589ea0ed0477589bd34d5acad6776 has no consensus state
I20260928 14:50:20.232103 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_805ce73cf39e46ceb45ce1312ceff765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.232709 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_805ce73cf39e46ceb45ce1312ceff765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.233546 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dbeb98ade54a4a2a87d9bd9264151924" } new_table_name: "default.Table_ad7b877efd3c4bdfb36a80026836f95f" modify_external_catalogs: true
I20260928 14:50:20.233763 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0ce655bb76b049b89738d27cdd17f485" } new_table_name: "default.Table_fe5bce0cd2f049e191363fcbd0de8bac" modify_external_catalogs: true
I20260928 14:50:20.234426 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_27561646684249339361c90b5ac1894e" } modify_external_catalogs: true
I20260928 14:50:20.234624 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_27561646684249339361c90b5ac1894e" } modify_external_catalogs: true
I20260928 14:50:20.235047 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_85a8c601ea1f447bbb522d1548841757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.235168 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_29cf51e464394e13b0accc884533d3fb" } new_table_name: "default.Table_09eb5c8c92d3443998fe2436f7097e34" modify_external_catalogs: true
W20260928 14:50:20.235566 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85a8c601ea1f447bbb522d1548841757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.242928 9404 tablet_service.cc:1467] Processing CreateTablet for tablet d99589ea0ed0477589bd34d5acad6776 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.243386 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99589ea0ed0477589bd34d5acad6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.243464 9263 tablet_service.cc:1467] Processing CreateTablet for tablet d99589ea0ed0477589bd34d5acad6776 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.243934 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99589ea0ed0477589bd34d5acad6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.244524 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]). Expected version 1 got 0
I20260928 14:50:20.244957 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]). Expected version 1 got 0
I20260928 14:50:20.246285 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 75680fd6738044759f8edeb9589f9bf4 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.246654 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75680fd6738044759f8edeb9589f9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.246697 9405 tablet_service.cc:1467] Processing CreateTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (DEFAULT_TABLE table=default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.246970 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50279cc5fcf43dc9ce0cafaacf93b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.248312 9546 tablet_service.cc:1467] Processing CreateTablet for tablet d99589ea0ed0477589bd34d5acad6776 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.248725 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99589ea0ed0477589bd34d5acad6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.251976 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 75680fd6738044759f8edeb9589f9bf4 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.252343 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75680fd6738044759f8edeb9589f9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.257838 9549 tablet_service.cc:1467] Processing CreateTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (DEFAULT_TABLE table=default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.258178 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50279cc5fcf43dc9ce0cafaacf93b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.259171 9848 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:20.260424 9848 tablet_bootstrap.cc:654] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.262079 9848 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:20.262243 9848 ts_tablet_manager.cc:1397] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:20.262200 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 75680fd6738044759f8edeb9589f9bf4 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.262244 9262 tablet_service.cc:1467] Processing CreateTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (DEFAULT_TABLE table=default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.262590 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75680fd6738044759f8edeb9589f9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.262923 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50279cc5fcf43dc9ce0cafaacf93b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.262970 9848 raft_consensus.cc:348] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.263181 9848 raft_consensus.cc:374] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.263269 9848 raft_consensus.cc:729] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.263492 9848 consensus_queue.cc:260] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.266125 9848 ts_tablet_manager.cc:1428] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:20.267269 9848 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:20.268782 9848 tablet_bootstrap.cc:654] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.274593 9851 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:20.278349 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b37f2324eea4e239c508ae9316abe0b" } modify_external_catalogs: true
I20260928 14:50:20.278466 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_56f6005a38c2496fafff14de10939fff" } modify_external_catalogs: true
I20260928 14:50:20.278579 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b37f2324eea4e239c508ae9316abe0b" } modify_external_catalogs: true
I20260928 14:50:20.278713 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_56f6005a38c2496fafff14de10939fff" } modify_external_catalogs: true
I20260928 14:50:20.280583 9851 tablet_bootstrap.cc:654] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.284680 9848 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:20.284829 9848 ts_tablet_manager.cc:1397] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.005s
I20260928 14:50:20.285585 9848 raft_consensus.cc:348] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.285859 9848 raft_consensus.cc:374] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.285988 9848 raft_consensus.cc:729] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.287062 9848 consensus_queue.cc:260] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.287281 9855 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:20.289134 9848 ts_tablet_manager.cc:1428] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:20.290134 9855 tablet_bootstrap.cc:654] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.290794 9848 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:20.292409 9848 tablet_bootstrap.cc:654] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.292733 9851 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:20.292915 9851 ts_tablet_manager.cc:1397] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.007s
I20260928 14:50:20.293754 9851 raft_consensus.cc:348] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.294075 9851 raft_consensus.cc:374] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.294209 9851 raft_consensus.cc:729] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.294795 9851 consensus_queue.cc:260] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.298051 8953 catalog_manager.cc:5495] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:20.298475 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]). Expected version 1 got 0
I20260928 14:50:20.299009 9851 ts_tablet_manager.cc:1428] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:20.298792 8953 catalog_manager.cc:5495] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } }
I20260928 14:50:20.299253 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_29cf51e464394e13b0accc884533d3fb [id=5d8ea8a471ec4cdaabceda4aa8a94312]). Expected version 1 got 0
I20260928 14:50:20.299490 8953 catalog_manager.cc:5495] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } }
I20260928 14:50:20.299793 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 4d800c3135bb44f994baea4732245aea (table default.Table_0ce655bb76b049b89738d27cdd17f485 [id=1c8087c2f05946b7aeb420ab7f693b00]). Expected version 1 got 0
I20260928 14:50:20.300089 9851 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:20.300621 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d69b1a90be4f4a1681bd5d83b0228d92
W20260928 14:50:20.300662 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 consensus state has no leader
I20260928 14:50:20.301074 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ec0feb0e0b194af7beeb68c4666c5ea6" } modify_external_catalogs: true
I20260928 14:50:20.301196 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet d69b1a90be4f4a1681bd5d83b0228d92 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.301245 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ec0feb0e0b194af7beeb68c4666c5ea6" } modify_external_catalogs: true
I20260928 14:50:20.301674 9851 tablet_bootstrap.cc:654] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.302062 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d800c3135bb44f994baea4732245aea from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.302881 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet cc9c25765bb54a328d903d65ad13802b from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.303115 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.303109 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.303325 9813 tablet_replica.cc:330] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:20.303325 9814 tablet_replica.cc:330] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:20.303431 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet cc9c25765bb54a328d903d65ad13802b from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.303509 9814 raft_consensus.cc:2229] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.303500 9813 raft_consensus.cc:2229] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:20.303661 9814 raft_consensus.cc:2258] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.303987 9813 raft_consensus.cc:2258] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.304987 9615 heartbeater.cc:503] Master 127.8.181.62:43149 was elected leader, sending a full tablet report...
I20260928 14:50:20.306169 9474 heartbeater.cc:503] Master 127.8.181.62:43149 was elected leader, sending a full tablet report...
I20260928 14:50:20.308094 9544 tablet_service.cc:1467] Processing CreateTablet for tablet ada3738d517e4558b34826e35c74196a (DEFAULT_TABLE table=default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.308425 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ada3738d517e4558b34826e35c74196a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.301538 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d800c3135bb44f994baea4732245aea consensus state has no leader
I20260928 14:50:20.310853 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_55d6d06d64514513ac8cb6d68aa1a71d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.311331 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55d6d06d64514513ac8cb6d68aa1a71d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.311754 9549 tablet_service.cc:1467] Processing CreateTablet for tablet f81f1875265642c3a428e658dca558d0 (DEFAULT_TABLE table=default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0 [id=5ac524ecad68439eb40c058be3ee262a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.312062 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81f1875265642c3a428e658dca558d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.313720 9405 tablet_service.cc:1467] Processing CreateTablet for tablet f81f1875265642c3a428e658dca558d0 (DEFAULT_TABLE table=default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0 [id=5ac524ecad68439eb40c058be3ee262a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.314057 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81f1875265642c3a428e658dca558d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.317770 9543 tablet_service.cc:1467] Processing CreateTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c (DEFAULT_TABLE table=default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.318390 9814 ts_tablet_manager.cc:1905] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.321856 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e1f1977af4af8aed072bbd77e6f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.323864 9833 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.325758 9821 consensus_queue.cc:1035] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.328303 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 51e28b2e855542b68e3bea8180e7f606
I20260928 14:50:20.328299 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4aea5d7d3ebf4324bf438d2078d9dab1
I20260928 14:50:20.328433 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.329577 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 555b1577a6a1486e93e78125431ab215 (DEFAULT_TABLE table=default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.329905 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 51e28b2e855542b68e3bea8180e7f606 (DEFAULT_TABLE table=default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.330008 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (DEFAULT_TABLE table=default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.330086 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (DEFAULT_TABLE table=default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.330197 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.330369 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.330843 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 3d27738fcfbc42f298e26149dfd28182 (DEFAULT_TABLE table=default.Table_ad0a635688444f97b3c009b952ebe465 [id=8acf918c731f462a9bea00dc1e1a22ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.335013 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (DEFAULT_TABLE table=default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.335368 9404 tablet_service.cc:1467] Processing CreateTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c (DEFAULT_TABLE table=default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.335810 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_76eb6fb13ae44aa6a78a1f9a258d47de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.336400 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e1f1977af4af8aed072bbd77e6f4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.336393 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76eb6fb13ae44aa6a78a1f9a258d47de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.337152 9408 tablet_service.cc:1467] Processing CreateTablet for tablet ada3738d517e4558b34826e35c74196a (DEFAULT_TABLE table=default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.337446 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ada3738d517e4558b34826e35c74196a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.338169 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 555b1577a6a1486e93e78125431ab215 (DEFAULT_TABLE table=default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.338459 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555b1577a6a1486e93e78125431ab215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.340205 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (DEFAULT_TABLE table=default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.340797 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.342010 9813 ts_tablet_manager.cc:1905] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.343134 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aea5d7d3ebf4324bf438d2078d9dab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.343699 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 3d27738fcfbc42f298e26149dfd28182 (DEFAULT_TABLE table=default.Table_ad0a635688444f97b3c009b952ebe465 [id=8acf918c731f462a9bea00dc1e1a22ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.344533 9821 consensus_queue.cc:1035] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:20.344558 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bffc2fe3282149919a051f9d6fa795fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.345120 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bffc2fe3282149919a051f9d6fa795fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.345202 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 51e28b2e855542b68e3bea8180e7f606 (DEFAULT_TABLE table=default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.345938 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d27738fcfbc42f298e26149dfd28182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.339046 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.340469 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.347337 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 4d800c3135bb44f994baea4732245aea (table default.Table_fe5bce0cd2f049e191363fcbd0de8bac [id=1c8087c2f05946b7aeb420ab7f693b00]). Expected version 2 got 0
I20260928 14:50:20.347620 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d99589ea0ed0477589bd34d5acad6776 (table default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 2 got 0
I20260928 14:50:20.347819 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]). Expected version 1 got 0
I20260928 14:50:20.347996 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93]). Expected version 1 got 0
I20260928 14:50:20.349557 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_0b922585518e4b42a56afd9214dd3de6 [id=3b23d10e59cb42238f2274ea2aca9a93]). Expected version 1 got 0
I20260928 14:50:20.349749 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]). Expected version 1 got 0
I20260928 14:50:20.349879 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d99589ea0ed0477589bd34d5acad6776 (table default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 2 got 0
I20260928 14:50:20.350028 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51e28b2e855542b68e3bea8180e7f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.350085 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 4d800c3135bb44f994baea4732245aea (table default.Table_fe5bce0cd2f049e191363fcbd0de8bac [id=1c8087c2f05946b7aeb420ab7f693b00]). Expected version 2 got 0
I20260928 14:50:20.350271 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 (table default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]). Expected version 1 got 0
I20260928 14:50:20.352511 9834 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.353243 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555b1577a6a1486e93e78125431ab215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.353863 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cc9c25765bb54a328d903d65ad13802b
I20260928 14:50:20.354214 8954 catalog_manager.cc:6565] ReplaceTablet: tablet cc9c25765bb54a328d903d65ad13802b deleted and replaced by tablet cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:20.354564 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_168ad97cac4b47538b65747275af38c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.355041 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_168ad97cac4b47538b65747275af38c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.356419 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7099d869d61949ccb9dd2a76af643004"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.356915 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7099d869d61949ccb9dd2a76af643004 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.358325 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aea5d7d3ebf4324bf438d2078d9dab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.360922 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet cc9c25765bb54a328d903d65ad13802b with delete_type TABLET_DATA_DELETED (replaced by tablet cd8131f32f1a4153abf2967ca0a11619) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.369508 9815 tablet_replica.cc:330] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.371047 9835 tablet.cc:1722] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.371604 9815 raft_consensus.cc:2229] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.371799 9815 raft_consensus.cc:2258] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.372815 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d27738fcfbc42f298e26149dfd28182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.375536 9815 ts_tablet_manager.cc:1905] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.375684 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.375909 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51e28b2e855542b68e3bea8180e7f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.398231 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:20.398984 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.399573 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.401089 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fd18ca3d50314a41a1ad1f04a0704585"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.401423 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:20.401649 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd18ca3d50314a41a1ad1f04a0704585 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.413301 9834 tablet.cc:1722] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.432402 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.438400 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad0a635688444f97b3c009b952ebe465" } new_table_name: "default.Table_47ae53d88ba8449aafe8f756ec185bbf" modify_external_catalogs: true
I20260928 14:50:20.444754 9266 tablet_service.cc:1467] Processing CreateTablet for tablet ada3738d517e4558b34826e35c74196a (DEFAULT_TABLE table=default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.445442 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ada3738d517e4558b34826e35c74196a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.446499 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 3d27738fcfbc42f298e26149dfd28182 (DEFAULT_TABLE table=default.Table_ad0a635688444f97b3c009b952ebe465 [id=8acf918c731f462a9bea00dc1e1a22ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.446913 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d27738fcfbc42f298e26149dfd28182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.448244 9262 tablet_service.cc:1467] Processing CreateTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c (DEFAULT_TABLE table=default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.448632 9263 tablet_service.cc:1467] Processing CreateTablet for tablet f81f1875265642c3a428e658dca558d0 (DEFAULT_TABLE table=default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0 [id=5ac524ecad68439eb40c058be3ee262a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.450569 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 555b1577a6a1486e93e78125431ab215 (DEFAULT_TABLE table=default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.454295 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81f1875265642c3a428e658dca558d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.458551 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555b1577a6a1486e93e78125431ab215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.459697 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04e1f1977af4af8aed072bbd77e6f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.464670 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 380d31a0eb2147f8bb4c32d77cf53867
I20260928 14:50:20.465366 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0f116343cade4ff0950abc852cff317f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.465984 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f116343cade4ff0950abc852cff317f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.466720 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_55d6d06d64514513ac8cb6d68aa1a71d" } new_table_name: "default.Table_ea7ac789c79847c786de8d9c1110c838" modify_external_catalogs: true
I20260928 14:50:20.467178 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4d800c3135bb44f994baea4732245aea
I20260928 14:50:20.467540 8955 catalog_manager.cc:6565] ReplaceTablet: tablet 4d800c3135bb44f994baea4732245aea deleted and replaced by tablet 315c446d87c84ae4bc9cb3243dca5538
I20260928 14:50:20.467749 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 00b4aec190f94cbab007bd0614588ebd from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.471544 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (DEFAULT_TABLE table=default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.471935 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aea5d7d3ebf4324bf438d2078d9dab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.477630 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (DEFAULT_TABLE table=default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.477686 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d800c3135bb44f994baea4732245aea with delete_type TABLET_DATA_DELETED (replaced by tablet 315c446d87c84ae4bc9cb3243dca5538) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.477931 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.477993 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.478147 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.479657 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.481963 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7f843d8d53f14d4fb077e8acc03031fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.482743 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f843d8d53f14d4fb077e8acc03031fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.485440 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d83ce30f16b64ea3b15795a1e1794df9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.485942 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d83ce30f16b64ea3b15795a1e1794df9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:20.489128 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d27738fcfbc42f298e26149dfd28182 consensus state has no leader
I20260928 14:50:20.489714 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 51e28b2e855542b68e3bea8180e7f606 (DEFAULT_TABLE table=default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.491449 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51e28b2e855542b68e3bea8180e7f606. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.497478 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 894af8262a004e41a6ccc2641f8f7605 has no consensus state
I20260928 14:50:20.500378 9833 tablet.cc:1722] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.501220 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.502254 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.503872 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_79b89ecacda14a678766fdc9f414d3ef" } modify_external_catalogs: true
I20260928 14:50:20.503916 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fe5bce0cd2f049e191363fcbd0de8bac" } new_table_name: "default.Table_95fe08d401ce4a5e84c4d8b47f0243ea" modify_external_catalogs: true
I20260928 14:50:20.504087 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_79b89ecacda14a678766fdc9f414d3ef" } modify_external_catalogs: true
I20260928 14:50:20.506043 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_47ae53d88ba8449aafe8f756ec185bbf" } new_table_name: "default.Table_0bce3d69ebb44782b712d1041fddb990" modify_external_catalogs: true
I20260928 14:50:20.509579 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:20.510047 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 315c446d87c84ae4bc9cb3243dca5538 has no consensus state
I20260928 14:50:20.511142 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.512754 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:20.514384 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d27738fcfbc42f298e26149dfd28182 consensus state has no leader
I20260928 14:50:20.518689 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 4025017d30034ea3adc6b5fd55d18617 (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.519078 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4025017d30034ea3adc6b5fd55d18617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.520156 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.520359 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.520880 9705 raft_consensus.cc:482] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:20.520372 9405 tablet_service.cc:1467] Processing CreateTablet for tablet d0f099714e924a968fbd792e5f69bba4 (DEFAULT_TABLE table=default.Table_805ce73cf39e46ceb45ce1312ceff765 [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.521028 9705 raft_consensus.cc:504] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.521436 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f099714e924a968fbd792e5f69bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.521678 9705 leader_election.cc:288] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:20.522254 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:20.522951 9219 leader_election.cc:341] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:20.527149 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d800c3135bb44f994baea4732245aea with delete_type TABLET_DATA_DELETED (replaced by tablet 315c446d87c84ae4bc9cb3243dca5538) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.523779 9540 tablet_service.cc:1467] Processing CreateTablet for tablet d0f099714e924a968fbd792e5f69bba4 (DEFAULT_TABLE table=default.Table_805ce73cf39e46ceb45ce1312ceff765 [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.527590 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f099714e924a968fbd792e5f69bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.530265 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet e4484f878a2540799bcee1a35e9a2b69 with delete_type TABLET_DATA_DELETED (replaced by tablet 889a73294bec4aac92f4eaaf45adde41) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.530750 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea7ac789c79847c786de8d9c1110c838" } modify_external_catalogs: true
I20260928 14:50:20.530944 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea7ac789c79847c786de8d9c1110c838" } modify_external_catalogs: true
I20260928 14:50:20.531491 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_40ee866dbebc49a98a8bdfb97554b162" } modify_external_catalogs: true
I20260928 14:50:20.531665 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_40ee866dbebc49a98a8bdfb97554b162" } modify_external_catalogs: true
I20260928 14:50:20.532367 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:20.532662 9427 raft_consensus.cc:2454] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:20.532821 9835 tablet.cc:1722] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:20.533865 9834 tablet.cc:1722] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.535379 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_805ce73cf39e46ceb45ce1312ceff765" } new_table_name: "default.Table_f2bc85b7e0f64234b5f336348cb4e49d" modify_external_catalogs: true
I20260928 14:50:20.538604 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 4025017d30034ea3adc6b5fd55d18617 (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:20.541204 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0f099714e924a968fbd792e5f69bba4 consensus state has no leader
I20260928 14:50:20.545650 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet d99589ea0ed0477589bd34d5acad6776 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.545902 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_de3b233b26d642fb8f190108b2c9f468"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.546445 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de3b233b26d642fb8f190108b2c9f468 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.547768 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d800c3135bb44f994baea4732245aea with delete_type TABLET_DATA_DELETED (replaced by tablet 315c446d87c84ae4bc9cb3243dca5538) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.548089 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet cc9c25765bb54a328d903d65ad13802b with delete_type TABLET_DATA_DELETED (replaced by tablet cd8131f32f1a4153abf2967ca0a11619) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.550259 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 380d31a0eb2147f8bb4c32d77cf53867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.552130 9815 ts_tablet_manager.cc:1918] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.538265 9254 tablet_service.cc:1467] Processing CreateTablet for tablet d0f099714e924a968fbd792e5f69bba4 (DEFAULT_TABLE table=default.Table_805ce73cf39e46ceb45ce1312ceff765 [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.552433 9815 log.cc:1196] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d69b1a90be4f4a1681bd5d83b0228d92
I20260928 14:50:20.552616 9220 leader_election.cc:302] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:20.553156 9815 ts_tablet_manager.cc:1939] T d69b1a90be4f4a1681bd5d83b0228d92 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.555182 9813 ts_tablet_manager.cc:1918] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.555373 9813 log.cc:1196] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d69b1a90be4f4a1681bd5d83b0228d92
I20260928 14:50:20.555754 9813 ts_tablet_manager.cc:1939] T d69b1a90be4f4a1681bd5d83b0228d92 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:20.556322 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0f099714e924a968fbd792e5f69bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.558010 9705 raft_consensus.cc:2781] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:20.558799 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d69b1a90be4f4a1681bd5d83b0228d92 (table default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]) successfully deleted
I20260928 14:50:20.559198 9815 tablet_replica.cc:330] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.559366 9815 raft_consensus.cc:2229] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:20.559480 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 51e28b2e855542b68e3bea8180e7f606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e28b2e855542b68e3bea8180e7f606 already in progress: creating tablet
I20260928 14:50:20.559551 9815 raft_consensus.cc:2258] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:20.559718 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4aea5d7d3ebf4324bf438d2078d9dab1 already in progress: creating tablet
W20260928 14:50:20.559942 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b04e1f1977af4af8aed072bbd77e6f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b04e1f1977af4af8aed072bbd77e6f4c already in progress: creating tablet
I20260928 14:50:20.557425 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4025017d30034ea3adc6b5fd55d18617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.561220 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d69b1a90be4f4a1681bd5d83b0228d92 (table default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]) successfully deleted
I20260928 14:50:20.562012 9705 raft_consensus.cc:482] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:20.562157 9705 raft_consensus.cc:3037] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:20.562317 9815 ts_tablet_manager.cc:1905] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.564837 9705 raft_consensus.cc:504] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.566134 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
W20260928 14:50:20.566880 9219 leader_election.cc:341] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:20.567096 9705 leader_election.cc:288] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:20.569336 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet ada3738d517e4558b34826e35c74196a from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.569628 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet e4484f878a2540799bcee1a35e9a2b69 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:20.572845 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 51e28b2e855542b68e3bea8180e7f606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e28b2e855542b68e3bea8180e7f606 already in progress: creating tablet
I20260928 14:50:20.573904 9864 tablet.cc:1722] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 14:50:20.574235 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4aea5d7d3ebf4324bf438d2078d9dab1 already in progress: creating tablet
I20260928 14:50:20.577354 9855 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:20.577670 9813 tablet_replica.cc:330] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:20.581874 9813 raft_consensus.cc:2229] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.585748 9813 raft_consensus.cc:2258] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.586093 9855 ts_tablet_manager.cc:1397] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.299s user 0.003s sys 0.003s
I20260928 14:50:20.594321 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 (DEFAULT_TABLE table=default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.594720 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d26550613aa4988910ec66eeb8b2f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.597215 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5ef1cee3a6904bc5950dbc6d4a5390ee
I20260928 14:50:20.597771 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.598112 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315c446d87c84ae4bc9cb3243dca5538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.598134 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.598259 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.598837 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 4025017d30034ea3adc6b5fd55d18617 (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.598937 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 (DEFAULT_TABLE table=default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.599223 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4025017d30034ea3adc6b5fd55d18617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.600112 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63792bb2d5b54463a701c9e4e5f095e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.600701 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 8c8624f9349a4608a48943487f01c7c8 (DEFAULT_TABLE table=default.Table_168ad97cac4b47538b65747275af38c6 [id=b8333e21752c4aabb04a7caeeb0515a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.601050 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c8624f9349a4608a48943487f01c7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.601779 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 605ccf9ad9ca4eb985374e065c48601a (DEFAULT_TABLE table=default.Table_76eb6fb13ae44aa6a78a1f9a258d47de [id=763f6cc484294611b96035248c14066d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.602123 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 605ccf9ad9ca4eb985374e065c48601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.604521 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet cc9c25765bb54a328d903d65ad13802b with delete_type TABLET_DATA_DELETED (replaced by tablet cd8131f32f1a4153abf2967ca0a11619) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.605773 9401 tablet_service.cc:1467] Processing CreateTablet for tablet cd8131f32f1a4153abf2967ca0a11619 (DEFAULT_TABLE table=default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.606089 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd8131f32f1a4153abf2967ca0a11619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.608269 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 8c8624f9349a4608a48943487f01c7c8 (DEFAULT_TABLE table=default.Table_168ad97cac4b47538b65747275af38c6 [id=b8333e21752c4aabb04a7caeeb0515a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.608609 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c8624f9349a4608a48943487f01c7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.609113 9814 ts_tablet_manager.cc:1918] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.609279 9833 tablet.cc:1722] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.609575 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 894af8262a004e41a6ccc2641f8f7605 (DEFAULT_TABLE table=default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.609831 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 605ccf9ad9ca4eb985374e065c48601a (DEFAULT_TABLE table=default.Table_76eb6fb13ae44aa6a78a1f9a258d47de [id=763f6cc484294611b96035248c14066d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.609983 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 894af8262a004e41a6ccc2641f8f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.610165 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 605ccf9ad9ca4eb985374e065c48601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.613631 9814 log.cc:1196] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d69b1a90be4f4a1681bd5d83b0228d92
I20260928 14:50:20.613808 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 0795ca09ecfe433195e016d5d1f0dbc0 (DEFAULT_TABLE table=default.Table_bffc2fe3282149919a051f9d6fa795fa [id=1c768cf900204133b2fc4011d3aae7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.614022 9814 ts_tablet_manager.cc:1939] T d69b1a90be4f4a1681bd5d83b0228d92 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:20.614090 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0795ca09ecfe433195e016d5d1f0dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.614975 9814 tablet_replica.cc:330] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:20.616726 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 894af8262a004e41a6ccc2641f8f7605 (DEFAULT_TABLE table=default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.617074 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 894af8262a004e41a6ccc2641f8f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.617833 9541 tablet_service.cc:1467] Processing CreateTablet for tablet cd8131f32f1a4153abf2967ca0a11619 (DEFAULT_TABLE table=default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.618132 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd8131f32f1a4153abf2967ca0a11619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.621671 9813 ts_tablet_manager.cc:1905] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.621982 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.622290 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315c446d87c84ae4bc9cb3243dca5538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.587404 9855 raft_consensus.cc:348] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.622388 9855 raft_consensus.cc:374] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.622480 9855 raft_consensus.cc:729] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.623894 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 (DEFAULT_TABLE table=default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.624199 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d26550613aa4988910ec66eeb8b2f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.624974 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 (DEFAULT_TABLE table=default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.625278 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63792bb2d5b54463a701c9e4e5f095e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.626528 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 0795ca09ecfe433195e016d5d1f0dbc0 (DEFAULT_TABLE table=default.Table_bffc2fe3282149919a051f9d6fa795fa [id=1c768cf900204133b2fc4011d3aae7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.627091 9855 consensus_queue.cc:260] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.629673 9833 tablet.cc:1722] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.630355 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ada3738d517e4558b34826e35c74196a
I20260928 14:50:20.632097 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7099d869d61949ccb9dd2a76af643004" } modify_external_catalogs: true
I20260928 14:50:20.632278 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7099d869d61949ccb9dd2a76af643004" } modify_external_catalogs: true
I20260928 14:50:20.638386 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0795ca09ecfe433195e016d5d1f0dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.639844 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d99589ea0ed0477589bd34d5acad6776
I20260928 14:50:20.640259 8949 catalog_manager.cc:6565] ReplaceTablet: tablet d99589ea0ed0477589bd34d5acad6776 deleted and replaced by tablet 0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:20.641809 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 894af8262a004e41a6ccc2641f8f7605
I20260928 14:50:20.643610 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2ca8a99cae8b46cbb6c43da43427656e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.644109 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ca8a99cae8b46cbb6c43da43427656e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:20.645066 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 76490.3us
I20260928 14:50:20.645823 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9c79f3003b9a414bbe7b61df842d89b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.646286 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c79f3003b9a414bbe7b61df842d89b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.646740 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d69b1a90be4f4a1681bd5d83b0228d92 (table default.Table_27561646684249339361c90b5ac1894e [id=16a7a24a56e24509bebf8b8ae1b6f73e]) successfully deleted
W20260928 14:50:20.646979 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4aea5d7d3ebf4324bf438d2078d9dab1 already in progress: creating tablet
W20260928 14:50:20.647161 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 51e28b2e855542b68e3bea8180e7f606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e28b2e855542b68e3bea8180e7f606 already in progress: creating tablet
W20260928 14:50:20.647338 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b04e1f1977af4af8aed072bbd77e6f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b04e1f1977af4af8aed072bbd77e6f4c already in progress: creating tablet
I20260928 14:50:20.648531 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 (DEFAULT_TABLE table=default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.648888 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63792bb2d5b54463a701c9e4e5f095e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.650388 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 (DEFAULT_TABLE table=default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.650744 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d26550613aa4988910ec66eeb8b2f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.652482 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8d26550613aa4988910ec66eeb8b2f07
I20260928 14:50:20.578855 9815 ts_tablet_manager.cc:1918] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.656060 9815 log.cc:1196] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e4484f878a2540799bcee1a35e9a2b69
I20260928 14:50:20.657390 9815 ts_tablet_manager.cc:1939] T e4484f878a2540799bcee1a35e9a2b69 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.657581 8950 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a] alter complete (version 1)
I20260928 14:50:20.659984 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 605ccf9ad9ca4eb985374e065c48601a (DEFAULT_TABLE table=default.Table_76eb6fb13ae44aa6a78a1f9a258d47de [id=763f6cc484294611b96035248c14066d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.660341 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 605ccf9ad9ca4eb985374e065c48601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.666007 9262 tablet_service.cc:1467] Processing CreateTablet for tablet cd8131f32f1a4153abf2967ca0a11619 (DEFAULT_TABLE table=default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.666359 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd8131f32f1a4153abf2967ca0a11619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.674945 9855 ts_tablet_manager.cc:1428] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.088s user 0.001s sys 0.001s
I20260928 14:50:20.675096 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:20.675340 9855 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:20.675675 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.675906 9815 tablet_replica.cc:330] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.676120 9545 tablet_service.cc:1467] Processing CreateTablet for tablet ce25abb4559241f58054f27435fd6078 (DEFAULT_TABLE table=default.Table_fd18ca3d50314a41a1ad1f04a0704585 [id=a95034bdd2ac4f5e9a36e1e16b407355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.676254 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet ada3738d517e4558b34826e35c74196a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.676519 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce25abb4559241f58054f27435fd6078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.676491 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet d99589ea0ed0477589bd34d5acad6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e661ac0a85949a280d837ee0357eea7) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.677461 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet ada3738d517e4558b34826e35c74196a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.677762 9855 tablet_bootstrap.cc:654] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.678087 9427 raft_consensus.cc:3037] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:20.679430 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.680120 9814 raft_consensus.cc:2229] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.682299 9814 pending_rounds.cc:62] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:20.682420 9814 pending_rounds.cc:68] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326350192521216 op_type: NO_OP noop_request { }
I20260928 14:50:20.682626 9814 raft_consensus.cc:2866] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:20.682883 9814 raft_consensus.cc:2258] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:20.682925 9497 consensus_peers.cc:487] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:20.683043 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.683408 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315c446d87c84ae4bc9cb3243dca5538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.683691 9814 ts_tablet_manager.cc:1905] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.687193 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_de3b233b26d642fb8f190108b2c9f468" } modify_external_catalogs: true
I20260928 14:50:20.687463 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_de3b233b26d642fb8f190108b2c9f468" } modify_external_catalogs: true
I20260928 14:50:20.687702 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e4484f878a2540799bcee1a35e9a2b69 (table default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:20.688792 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4d2f23d569c24e48907579804c0dfcbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.689344 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d2f23d569c24e48907579804c0dfcbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.689666 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_74edbb4940534e4888740f76081209f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.676127 9815 raft_consensus.cc:2229] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
W20260928 14:50:20.690132 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74edbb4940534e4888740f76081209f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.688812 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1acf17e2b553464a8efad0faca9ac9f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.690439 9815 raft_consensus.cc:2258] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:20.690673 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1acf17e2b553464a8efad0faca9ac9f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.691412 9815 ts_tablet_manager.cc:1905] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.691617 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b3cf2a7374154dc4998057cb92b6c52a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.692058 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3cf2a7374154dc4998057cb92b6c52a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.696089 9814 ts_tablet_manager.cc:1918] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.696223 9814 log.cc:1196] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/00b4aec190f94cbab007bd0614588ebd
I20260928 14:50:20.696589 9814 ts_tablet_manager.cc:1939] T 00b4aec190f94cbab007bd0614588ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:20.697343 9814 tablet_replica.cc:330] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:20.700273 9395 tablet_service.cc:1467] Processing CreateTablet for tablet ce25abb4559241f58054f27435fd6078 (DEFAULT_TABLE table=default.Table_fd18ca3d50314a41a1ad1f04a0704585 [id=a95034bdd2ac4f5e9a36e1e16b407355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.700941 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce25abb4559241f58054f27435fd6078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.701644 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 0795ca09ecfe433195e016d5d1f0dbc0 (DEFAULT_TABLE table=default.Table_bffc2fe3282149919a051f9d6fa795fa [id=1c768cf900204133b2fc4011d3aae7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.701860 8952 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0d6d2071ef5d4802a7eab04c8289dcad
I20260928 14:50:20.702000 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0795ca09ecfe433195e016d5d1f0dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.676533 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.706393 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 894af8262a004e41a6ccc2641f8f7605 (DEFAULT_TABLE table=default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.706772 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 894af8262a004e41a6ccc2641f8f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.708473 9427 raft_consensus.cc:2454] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:20.678707 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.678823 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet d99589ea0ed0477589bd34d5acad6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e661ac0a85949a280d837ee0357eea7) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.710124 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.713708 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 8c8624f9349a4608a48943487f01c7c8 (DEFAULT_TABLE table=default.Table_168ad97cac4b47538b65747275af38c6 [id=b8333e21752c4aabb04a7caeeb0515a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.714190 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c8624f9349a4608a48943487f01c7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.716799 9815 ts_tablet_manager.cc:1918] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:20.716997 9815 log.cc:1196] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/00b4aec190f94cbab007bd0614588ebd
I20260928 14:50:20.717442 9815 ts_tablet_manager.cc:1939] T 00b4aec190f94cbab007bd0614588ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.718535 9815 tablet_replica.cc:330] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.718750 9815 raft_consensus.cc:2229] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:20.719092 9815 raft_consensus.cc:2258] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.719901 9815 ts_tablet_manager.cc:1905] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.726681 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 00b4aec190f94cbab007bd0614588ebd (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
I20260928 14:50:20.726740 9851 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:20.728801 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.729758 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3b9be1e8fd7f4e3d94603310ae22b552" } new_table_name: "default.Table_b9d8335cd947458faef12d2ca76b6861" modify_external_catalogs: true
I20260928 14:50:20.730146 9815 ts_tablet_manager.cc:1918] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:20.730248 9815 log.cc:1196] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4d800c3135bb44f994baea4732245aea
I20260928 14:50:20.730698 9815 ts_tablet_manager.cc:1939] T 4d800c3135bb44f994baea4732245aea P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.731155 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e3bb5d92feef4555b3d91bc699b0fedd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.731674 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3bb5d92feef4555b3d91bc699b0fedd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.733021 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2ca8a99cae8b46cbb6c43da43427656e" } new_table_name: "default.Table_525bc234b3a7496dbafe595639cde13b" modify_external_catalogs: true
I20260928 14:50:20.733980 9815 tablet_replica.cc:330] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.734207 9815 raft_consensus.cc:2229] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.734560 9815 raft_consensus.cc:2258] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.735970 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0b922585518e4b42a56afd9214dd3de6" } new_table_name: "default.Table_af0f3ad2239b4d608f5059a112dd6f91" modify_external_catalogs: true
I20260928 14:50:20.736528 9815 ts_tablet_manager.cc:1905] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.737190 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7f843d8d53f14d4fb077e8acc03031fd" } new_table_name: "default.Table_6baee3f426384a22b739a3129d41abde" modify_external_catalogs: true
I20260928 14:50:20.737546 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4d800c3135bb44f994baea4732245aea (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:20.738786 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8b9e5857660a46159398f3e1588dadad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.739236 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b9e5857660a46159398f3e1588dadad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.740382 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.740569 9813 ts_tablet_manager.cc:1918] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:20.740705 9813 log.cc:1196] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cc9c25765bb54a328d903d65ad13802b
W20260928 14:50:20.741094 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.741314 9813 ts_tablet_manager.cc:1939] T cc9c25765bb54a328d903d65ad13802b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:20.742295 9815 ts_tablet_manager.cc:1918] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:20.742432 9815 log.cc:1196] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cc9c25765bb54a328d903d65ad13802b
I20260928 14:50:20.742805 9815 ts_tablet_manager.cc:1939] T cc9c25765bb54a328d903d65ad13802b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:20.746086 9813 tablet_replica.cc:330] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:20.746390 9813 raft_consensus.cc:2229] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.746389 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]) successfully deleted
W20260928 14:50:20.746668 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b04e1f1977af4af8aed072bbd77e6f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b04e1f1977af4af8aed072bbd77e6f4c already in progress: creating tablet
I20260928 14:50:20.746903 9813 raft_consensus.cc:2258] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.748000 9813 ts_tablet_manager.cc:1905] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.749082 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74edbb4940534e4888740f76081209f8" } new_table_name: "default.Table_b15bf17dcd5042b3ab80185b4f036517" modify_external_catalogs: true
I20260928 14:50:20.749833 9254 tablet_service.cc:1467] Processing CreateTablet for tablet ce25abb4559241f58054f27435fd6078 (DEFAULT_TABLE table=default.Table_fd18ca3d50314a41a1ad1f04a0704585 [id=a95034bdd2ac4f5e9a36e1e16b407355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.751784 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.751971 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce25abb4559241f58054f27435fd6078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.752213 9851 ts_tablet_manager.cc:1397] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.427s user 0.050s sys 0.075s
I20260928 14:50:20.752952 9814 raft_consensus.cc:2229] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:20.754585 9815 tablet_replica.cc:330] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:20.754503 9835 tablet.cc:1722] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:20.754777 9815 raft_consensus.cc:2229] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.755065 9815 raft_consensus.cc:2258] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.755277 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cc9c25765bb54a328d903d65ad13802b (table default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]) successfully deleted
I20260928 14:50:20.755820 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 00b4aec190f94cbab007bd0614588ebd (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
I20260928 14:50:20.756780 9815 ts_tablet_manager.cc:1905] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.757411 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 0e661ac0a85949a280d837ee0357eea7 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.757901 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e661ac0a85949a280d837ee0357eea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.758813 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 9b998502f90a4df08b4078f833ad8c05 (DEFAULT_TABLE table=default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.759070 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1aca6789c31d429ba2f289b7b0ae4cba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.759231 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b998502f90a4df08b4078f833ad8c05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.759538 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aca6789c31d429ba2f289b7b0ae4cba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.762145 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 8700d651fd7144bd9ecc15cfedcfb434 (DEFAULT_TABLE table=default.Table_2ca8a99cae8b46cbb6c43da43427656e [id=0219eb70be1e4602b9b5542bafc4ddf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.762919 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700d651fd7144bd9ecc15cfedcfb434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.765628 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 964985f048114f53ba1e685c7f1dbd6d (DEFAULT_TABLE table=default.Table_7f843d8d53f14d4fb077e8acc03031fd [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.766131 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964985f048114f53ba1e685c7f1dbd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.766861 9546 tablet_service.cc:1467] Processing CreateTablet for tablet d7d4ef8a945c4e6c899e2bbd6069969c (DEFAULT_TABLE table=default.Table_0f116343cade4ff0950abc852cff317f [id=758c0941b029421d8f865d8600a17049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.766793 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeda483866146f89198e6f14456f0f2 (DEFAULT_TABLE table=default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.768314 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d4ef8a945c4e6c899e2bbd6069969c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.769341 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeda483866146f89198e6f14456f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.770268 9827 raft_consensus.cc:482] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:20.770430 9827 raft_consensus.cc:504] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.771293 9855 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:20.771850 9855 ts_tablet_manager.cc:1397] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.002s
I20260928 14:50:20.772302 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99589ea0ed0477589bd34d5acad6776" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:20.772572 9569 raft_consensus.cc:2454] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:20.772835 9855 raft_consensus.cc:348] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.773138 9855 raft_consensus.cc:374] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.772986 9827 leader_election.cc:288] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:20.773264 9855 raft_consensus.cc:729] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.773494 9360 leader_election.cc:302] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:20.773506 9855 consensus_queue.cc:260] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.773898 9827 raft_consensus.cc:2781] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:20.774078 9855 ts_tablet_manager.cc:1428] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:20.774370 9855 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:20.774470 9827 raft_consensus.cc:482] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:20.774585 9827 raft_consensus.cc:3037] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:20.776151 9855 tablet_bootstrap.cc:654] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.785773 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 0e661ac0a85949a280d837ee0357eea7 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.793586 9827 raft_consensus.cc:504] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.794476 9827 leader_election.cc:288] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:20.794885 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e661ac0a85949a280d837ee0357eea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.797861 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99589ea0ed0477589bd34d5acad6776" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:20.798138 9855 tablet_bootstrap.cc:492] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:20.798269 9569 raft_consensus.cc:3037] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:20.798328 9855 ts_tablet_manager.cc:1397] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260928 14:50:20.799172 9855 raft_consensus.cc:348] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.799476 9855 raft_consensus.cc:374] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.799606 9855 raft_consensus.cc:729] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.799899 9855 consensus_queue.cc:260] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:20.801120 9763 kernel_stack_watchdog.cc:198] Thread 9741 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 410ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f1792888980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f178f5a2bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f17960bd8c7 kudu::rpc::ServicePool::Init() at ??:0
@ 0x7f17984fea68 kudu::RpcServer::RegisterService() at ??:0
@ 0x7f179851f0b8 kudu::server::ServerBase::RegisterService() at ??:0
@ 0x7f1798520d74 kudu::server::ServerBase::Start() at ??:0
@ 0x7f1799ad8fec kudu::kserver::KuduServer::Start() at ??:0
@ 0x7f17a253ad5f kudu::master::Master::StartAsync() at ??:0
@ 0x7f17a253a0f7 kudu::master::Master::Start() at ??:0
@ 0x7f17a25995da kudu::master::RunMasterServer() at ??:0
@ 0xa05eee kudu::tools::(anonymous namespace)::MasterRun() at ??:?
@ 0x921351 std::_Function_handler<>::_M_invoke() at ??:?
@ 0x7f17a2e86129 std::function<>::operator()() at ??:0
I20260928 14:50:20.801177 9569 raft_consensus.cc:2454] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:20.802209 9398 tablet_service.cc:1467] Processing CreateTablet for tablet d7d4ef8a945c4e6c899e2bbd6069969c (DEFAULT_TABLE table=default.Table_0f116343cade4ff0950abc852cff317f [id=758c0941b029421d8f865d8600a17049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.802635 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d4ef8a945c4e6c899e2bbd6069969c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.802606 9360 leader_election.cc:302] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:20.807964 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 8700d651fd7144bd9ecc15cfedcfb434 (DEFAULT_TABLE table=default.Table_2ca8a99cae8b46cbb6c43da43427656e [id=0219eb70be1e4602b9b5542bafc4ddf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.808305 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700d651fd7144bd9ecc15cfedcfb434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.808430 9855 ts_tablet_manager.cc:1428] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 14:50:20.809753 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 964985f048114f53ba1e685c7f1dbd6d (DEFAULT_TABLE table=default.Table_7f843d8d53f14d4fb077e8acc03031fd [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.810178 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964985f048114f53ba1e685c7f1dbd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.810590 9855 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:20.810976 9741 thread.cc:636] rpc worker (service pool kudu.server.GenericService) Time spent creating pthread: real 0.501s user 0.096s sys 0.141s
W20260928 14:50:20.811841 9741 thread.cc:602] rpc worker (service pool kudu.server.GenericService) Time spent starting thread: real 0.502s user 0.096s sys 0.141s
I20260928 14:50:20.812129 9855 tablet_bootstrap.cc:654] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.806818 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeda483866146f89198e6f14456f0f2 (DEFAULT_TABLE table=default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.813860 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeda483866146f89198e6f14456f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.819211 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 9b998502f90a4df08b4078f833ad8c05 (DEFAULT_TABLE table=default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.819597 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b998502f90a4df08b4078f833ad8c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.822285 9813 ts_tablet_manager.cc:1918] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:20.822434 9813 log.cc:1196] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4d800c3135bb44f994baea4732245aea
I20260928 14:50:20.822888 9813 ts_tablet_manager.cc:1939] T 4d800c3135bb44f994baea4732245aea P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:20.823763 9813 tablet_replica.cc:330] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:20.823939 9813 raft_consensus.cc:2229] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:20.824118 9813 raft_consensus.cc:2258] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:20.824115 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e661ac0a85949a280d837ee0357eea7 consensus state has no leader
I20260928 14:50:20.825472 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet d0f099714e924a968fbd792e5f69bba4 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:20.826359 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 315c446d87c84ae4bc9cb3243dca5538 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:20.826538 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c101b1f03bb411f963f2348397c03e2 has no consensus state
I20260928 14:50:20.826776 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 75680fd6738044759f8edeb9589f9bf4 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:20.827319 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8700d651fd7144bd9ecc15cfedcfb434 consensus state has no leader
I20260928 14:50:20.827622 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5cf2132eafc942ba8344d4eb8869ab1d" } modify_external_catalogs: true
I20260928 14:50:20.827807 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5cf2132eafc942ba8344d4eb8869ab1d" } modify_external_catalogs: true
W20260928 14:50:20.828042 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b50279cc5fcf43dc9ce0cafaacf93b3e consensus state has no leader
W20260928 14:50:20.828358 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964985f048114f53ba1e685c7f1dbd6d consensus state has no leader
I20260928 14:50:20.831290 9827 raft_consensus.cc:2781] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:20.832685 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet ada3738d517e4558b34826e35c74196a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:20.832896 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 64496.4us
I20260928 14:50:20.833156 9220 leader_election.cc:302] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:20.833982 9813 ts_tablet_manager.cc:1905] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.835155 9705 raft_consensus.cc:2781] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:20.835296 9705 raft_consensus.cc:686] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:20.835548 9705 consensus_queue.cc:237] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.836917 9259 tablet_service.cc:1467] Processing CreateTablet for tablet d7d4ef8a945c4e6c899e2bbd6069969c (DEFAULT_TABLE table=default.Table_0f116343cade4ff0950abc852cff317f [id=758c0941b029421d8f865d8600a17049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.837358 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d4ef8a945c4e6c899e2bbd6069969c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.838299 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_af0f3ad2239b4d608f5059a112dd6f91" } modify_external_catalogs: true
I20260928 14:50:20.838476 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_af0f3ad2239b4d608f5059a112dd6f91" } modify_external_catalogs: true
I20260928 14:50:20.841826 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 (DEFAULT_TABLE table=default.Table_b3cf2a7374154dc4998057cb92b6c52a [id=4431be8698914255814800147776a1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.841909 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 9b998502f90a4df08b4078f833ad8c05 (DEFAULT_TABLE table=default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.842238 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e865f14ddc4b0c8ce0877cd99f5972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.842253 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b998502f90a4df08b4078f833ad8c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.844864 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 4c101b1f03bb411f963f2348397c03e2 (DEFAULT_TABLE table=default.Table_b15bf17dcd5042b3ab80185b4f036517 [id=30cfc95166db4e5fab7aac9d7721ec26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.845445 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c101b1f03bb411f963f2348397c03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.845818 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeda483866146f89198e6f14456f0f2 (DEFAULT_TABLE table=default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.846120 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeda483866146f89198e6f14456f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.846544 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4d800c3135bb44f994baea4732245aea (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:20.847342 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a" } modify_external_catalogs: true
I20260928 14:50:20.847502 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a" } modify_external_catalogs: true
I20260928 14:50:20.848315 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 5a64ffa786f045b480efe51eb69d7074 (DEFAULT_TABLE table=default.Table_4d2f23d569c24e48907579804c0dfcbc [id=d1cbf4f020a44f349d4de94aa0a2f725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.848349 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 5a64ffa786f045b480efe51eb69d7074 (DEFAULT_TABLE table=default.Table_4d2f23d569c24e48907579804c0dfcbc [id=d1cbf4f020a44f349d4de94aa0a2f725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.848693 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a64ffa786f045b480efe51eb69d7074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.849076 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a64ffa786f045b480efe51eb69d7074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.849797 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 8700d651fd7144bd9ecc15cfedcfb434 (DEFAULT_TABLE table=default.Table_2ca8a99cae8b46cbb6c43da43427656e [id=0219eb70be1e4602b9b5542bafc4ddf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.850142 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8700d651fd7144bd9ecc15cfedcfb434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.850302 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 75680fd6738044759f8edeb9589f9bf4
I20260928 14:50:20.850745 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 75680fd6738044759f8edeb9589f9bf4 deleted and replaced by tablet c9cee872de1f4ce8b803cb8e8fb018d2
I20260928 14:50:20.851233 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 75680fd6738044759f8edeb9589f9bf4 with delete_type TABLET_DATA_DELETED (replaced by tablet c9cee872de1f4ce8b803cb8e8fb018d2) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.851940 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b4aec190f94cbab007bd0614588ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 380d31a0eb2147f8bb4c32d77cf53867) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.853189 9545 tablet_service.cc:1467] Processing CreateTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 (DEFAULT_TABLE table=default.Table_1acf17e2b553464a8efad0faca9ac9f1 [id=011947823839453e80127487ef4562b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.853648 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3e689e2ffa4edb8ef1004287e40c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.853804 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 964985f048114f53ba1e685c7f1dbd6d (DEFAULT_TABLE table=default.Table_7f843d8d53f14d4fb077e8acc03031fd [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.854017 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 75680fd6738044759f8edeb9589f9bf4 with delete_type TABLET_DATA_DELETED (replaced by tablet c9cee872de1f4ce8b803cb8e8fb018d2) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.854167 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964985f048114f53ba1e685c7f1dbd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.855195 9855 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:20.855333 9855 ts_tablet_manager.cc:1397] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.001s
I20260928 14:50:20.856052 9855 raft_consensus.cc:348] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.856271 9855 raft_consensus.cc:374] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.856331 9855 raft_consensus.cc:729] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.857810 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 4c101b1f03bb411f963f2348397c03e2 (DEFAULT_TABLE table=default.Table_b15bf17dcd5042b3ab80185b4f036517 [id=30cfc95166db4e5fab7aac9d7721ec26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.858150 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c101b1f03bb411f963f2348397c03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.858642 9855 consensus_queue.cc:260] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.859597 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:20.860083 8956 catalog_manager.cc:6565] ReplaceTablet: tablet d0f099714e924a968fbd792e5f69bba4 deleted and replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:20.861961 9257 tablet_service.cc:1467] Processing CreateTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 (DEFAULT_TABLE table=default.Table_1acf17e2b553464a8efad0faca9ac9f1 [id=011947823839453e80127487ef4562b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.862851 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3e689e2ffa4edb8ef1004287e40c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.863807 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.864217 9855 ts_tablet_manager.cc:1428] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:20.864944 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.865863 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 (DEFAULT_TABLE table=default.Table_b3cf2a7374154dc4998057cb92b6c52a [id=4431be8698914255814800147776a1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.866312 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e865f14ddc4b0c8ce0877cd99f5972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.866377 9349 kernel_stack_watchdog.cc:198] Thread 9848 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 290ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fde0b769980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7fde08483bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7fde084a3fd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7fde0849fbeb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7fde084a4cef kudu::ThreadPool::Submit() at ??:0
@ 0x7fde1334506d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7fde133440bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7fde13343ca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7fde1334ba02 kudu::log::Log::Init() at ??:0
@ 0x7fde1334adbf kudu::log::Log::Open() at ??:0
@ 0x7fde14bdc2ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7fde14bd87dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7fde14bd6fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260928 14:50:20.867339 9855 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:20.868150 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 5a64ffa786f045b480efe51eb69d7074 (DEFAULT_TABLE table=default.Table_4d2f23d569c24e48907579804c0dfcbc [id=d1cbf4f020a44f349d4de94aa0a2f725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.868631 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a64ffa786f045b480efe51eb69d7074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.868553 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_09eb5c8c92d3443998fe2436f7097e34" } modify_external_catalogs: true
I20260928 14:50:20.868747 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_09eb5c8c92d3443998fe2436f7097e34" } modify_external_catalogs: true
I20260928 14:50:20.872952 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet d69b1a90be4f4a1681bd5d83b0228d92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.873119 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99589ea0ed0477589bd34d5acad6776" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:20.873833 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet d99589ea0ed0477589bd34d5acad6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e661ac0a85949a280d837ee0357eea7) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.874619 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99589ea0ed0477589bd34d5acad6776" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:20.875360 9814 raft_consensus.cc:2258] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:20.876080 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b50279cc5fcf43dc9ce0cafaacf93b3e
I20260928 14:50:20.877775 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 4c101b1f03bb411f963f2348397c03e2 (DEFAULT_TABLE table=default.Table_b15bf17dcd5042b3ab80185b4f036517 [id=30cfc95166db4e5fab7aac9d7721ec26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:20.878193 9848 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.031s sys 0.103s
I20260928 14:50:20.877535 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 0e661ac0a85949a280d837ee0357eea7 (DEFAULT_TABLE table=default.Table_3b9be1e8fd7f4e3d94603310ae22b552 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.881387 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e661ac0a85949a280d837ee0357eea7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:20.882369 8941 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260928 14:50:20.884852 9814 ts_tablet_manager.cc:1905] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:20.886134 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 555b1577a6a1486e93e78125431ab215
I20260928 14:50:20.886653 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 315c446d87c84ae4bc9cb3243dca5538
I20260928 14:50:20.887008 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 315c446d87c84ae4bc9cb3243dca5538 deleted and replaced by tablet 9d6dc266ab8248d381e4850179455795
I20260928 14:50:20.887369 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:20.887660 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:20.888350 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c85a540301ae48139f38dcc341dabc99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.888859 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c85a540301ae48139f38dcc341dabc99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.890884 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c39546a03d024407aacb996e3b7dc3a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.891393 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c39546a03d024407aacb996e3b7dc3a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.886351 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 75680fd6738044759f8edeb9589f9bf4 with delete_type TABLET_DATA_DELETED (replaced by tablet c9cee872de1f4ce8b803cb8e8fb018d2) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.898382 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.900811 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:20.878278 9848 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.585s user 0.031s sys 0.103s
W20260928 14:50:20.904663 9360 leader_election.cc:341] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:20.905586 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c101b1f03bb411f963f2348397c03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.908413 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.908576 9549 tablet_service.cc:1467] Processing CreateTablet for tablet def872f66b2541b9af6084e93d991ec2 (DEFAULT_TABLE table=default.Table_1aca6789c31d429ba2f289b7b0ae4cba [id=944b7f0777354b8d96d264eb858cfc93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.909098 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def872f66b2541b9af6084e93d991ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.912529 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 555b1577a6a1486e93e78125431ab215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.912673 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.912812 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.912922 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 (DEFAULT_TABLE table=default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.913259 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a30439ac5a8485a9b6ebbe1371087b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.913651 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c (DEFAULT_TABLE table=default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8 [id=649895f4721d4daf823b5e04843ae3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.913941 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8193754d28d34c18bfc38ae0abd05f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.916584 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.920395 9266 tablet_service.cc:1467] Processing CreateTablet for tablet def872f66b2541b9af6084e93d991ec2 (DEFAULT_TABLE table=default.Table_1aca6789c31d429ba2f289b7b0ae4cba [id=944b7f0777354b8d96d264eb858cfc93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.925458 9855 tablet_bootstrap.cc:654] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:20.927490 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c (DEFAULT_TABLE table=default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8 [id=649895f4721d4daf823b5e04843ae3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.929203 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def872f66b2541b9af6084e93d991ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.929394 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 (DEFAULT_TABLE table=default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.929749 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a30439ac5a8485a9b6ebbe1371087b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.929927 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8193754d28d34c18bfc38ae0abd05f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.930344 9538 tablet_service.cc:1467] Processing CreateTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.930686 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9cee872de1f4ce8b803cb8e8fb018d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.932854 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e (DEFAULT_TABLE table=default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.933164 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051b7f0b1d0f4f638f3e7a69a027196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.934451 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9c79f3003b9a414bbe7b61df842d89b5" } modify_external_catalogs: true
I20260928 14:50:20.934623 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9c79f3003b9a414bbe7b61df842d89b5" } modify_external_catalogs: true
I20260928 14:50:20.935817 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 555b1577a6a1486e93e78125431ab215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.937362 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e255f8403baa437f9a75d582b7d9a26a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.937928 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e255f8403baa437f9a75d582b7d9a26a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.938308 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 (DEFAULT_TABLE table=default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.938616 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e7e11092d1475cba53e51a0f61d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.939059 9851 raft_consensus.cc:348] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.942021 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:20.942662 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.944579 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_66332b3d2ff9456496408d9a898ed929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.944990 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6dc266ab8248d381e4850179455795 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:20.945079 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66332b3d2ff9456496408d9a898ed929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.945370 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6dc266ab8248d381e4850179455795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.947481 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9aeda483866146f89198e6f14456f0f2
I20260928 14:50:20.948823 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:20.949779 9543 tablet_service.cc:1467] Processing CreateTablet for tablet e0ee1e19142b402f96056c387140b5ca (DEFAULT_TABLE table=default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.950103 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ee1e19142b402f96056c387140b5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.950830 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bd54e79c005f430e9bd80ab3f1cdc376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:20.951431 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:20.951494 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd54e79c005f430e9bd80ab3f1cdc376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:20.951737 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 (DEFAULT_TABLE table=default.Table_c85a540301ae48139f38dcc341dabc99 [id=16da29ef576a4730aff2c1e24942cafc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.952155 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.951787 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.953722 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ff819255f74f49a1ce0b5588aa03a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.952979 9851 raft_consensus.cc:374] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.957564 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 (DEFAULT_TABLE table=default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.957924 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e7e11092d1475cba53e51a0f61d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.957459 9851 raft_consensus.cc:729] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.960227 9851 consensus_queue.cc:260] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.961319 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e (DEFAULT_TABLE table=default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.961690 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051b7f0b1d0f4f638f3e7a69a027196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.962777 9855 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:20.962945 9855 ts_tablet_manager.cc:1397] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.001s
I20260928 14:50:20.963546 9254 tablet_service.cc:1467] Processing CreateTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.965207 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9cee872de1f4ce8b803cb8e8fb018d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.965674 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 (DEFAULT_TABLE table=default.Table_b3cf2a7374154dc4998057cb92b6c52a [id=4431be8698914255814800147776a1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.965584 9855 raft_consensus.cc:348] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.965961 9855 raft_consensus.cc:374] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:20.966179 9360 leader_election.cc:341] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:20.965447 9405 tablet_service.cc:1467] Processing CreateTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 (DEFAULT_TABLE table=default.Table_1acf17e2b553464a8efad0faca9ac9f1 [id=011947823839453e80127487ef4562b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.967360 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet b50279cc5fcf43dc9ce0cafaacf93b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:20.968472 9855 raft_consensus.cc:729] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.971628 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 (DEFAULT_TABLE table=default.Table_c85a540301ae48139f38dcc341dabc99 [id=16da29ef576a4730aff2c1e24942cafc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.971964 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ff819255f74f49a1ce0b5588aa03a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.974998 9851 ts_tablet_manager.cc:1428] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.219s user 0.002s sys 0.001s
I20260928 14:50:20.977108 9851 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:20.984963 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 62970.2us
I20260928 14:50:20.988000 9259 tablet_service.cc:1467] Processing CreateTablet for tablet e0ee1e19142b402f96056c387140b5ca (DEFAULT_TABLE table=default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.988338 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ee1e19142b402f96056c387140b5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.990043 9821 raft_consensus.cc:482] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:20.990594 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c (DEFAULT_TABLE table=default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8 [id=649895f4721d4daf823b5e04843ae3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.990947 9848 tablet_bootstrap.cc:492] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:20.991082 9848 ts_tablet_manager.cc:1397] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.700s user 0.032s sys 0.105s
I20260928 14:50:20.991842 9848 raft_consensus.cc:348] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.992101 9848 raft_consensus.cc:374] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:20.992187 9848 raft_consensus.cc:729] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:20.992430 9814 ts_tablet_manager.cc:1918] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:20.992416 9848 consensus_queue.cc:260] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.992606 9814 log.cc:1196] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/380d31a0eb2147f8bb4c32d77cf53867
I20260928 14:50:20.993710 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:20.994009 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (DEFAULT_TABLE table=default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.990358 9821 raft_consensus.cc:504] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:20.996160 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 17d7539290064c2c9fda29a5f16d375b (DEFAULT_TABLE table=default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.994549 9814 ts_tablet_manager.cc:1939] T 380d31a0eb2147f8bb4c32d77cf53867 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:20.996845 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:20.996810 9821 leader_election.cc:288] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:20.997997 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 595dccb9d03b4dd48698262aad630ac2 (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.998484 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595dccb9d03b4dd48698262aad630ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:20.999446 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (DEFAULT_TABLE table=default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.000147 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffd9bc260ae4373a946ce82ba5f0d48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.002240 9498 leader_election.cc:341] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:21.004052 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffd9bc260ae4373a946ce82ba5f0d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.004674 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 595dccb9d03b4dd48698262aad630ac2 (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.006498 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 17d7539290064c2c9fda29a5f16d375b (DEFAULT_TABLE table=default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.006971 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d7539290064c2c9fda29a5f16d375b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.010634 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6dc266ab8248d381e4850179455795 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:20.969020 9855 consensus_queue.cc:260] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.017875 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:21.018522 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595dccb9d03b4dd48698262aad630ac2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.019152 9497 leader_election.cc:341] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:21.019280 9497 leader_election.cc:302] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:21.019627 9821 raft_consensus.cc:2726] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:21.019963 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d7539290064c2c9fda29a5f16d375b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.024116 9855 ts_tablet_manager.cc:1428] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.061s user 0.004s sys 0.001s
I20260928 14:50:21.027103 9851 tablet_bootstrap.cc:654] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.030416 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fd18ca3d50314a41a1ad1f04a0704585" } new_table_name: "default.Table_d83736fcd1be4678a302426b78fd1d6e" modify_external_catalogs: true
I20260928 14:50:21.030648 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1aca6789c31d429ba2f289b7b0ae4cba" } new_table_name: "default.Table_636fad71edff41c6a084cd4b40b2a02e" modify_external_catalogs: true
I20260928 14:50:21.034891 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1acf17e2b553464a8efad0faca9ac9f1" } new_table_name: "default.Table_74388823ef59495e8cc13452d0033e0c" modify_external_catalogs: true
I20260928 14:50:21.034984 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_525bc234b3a7496dbafe595639cde13b" } new_table_name: "default.Table_5f9bb7f55d034226b7fcbb9bb19651aa" modify_external_catalogs: true
I20260928 14:50:21.036103 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c85a540301ae48139f38dcc341dabc99" } new_table_name: "default.Table_973889bd0a494a95a0a088ba6e85c124" modify_external_catalogs: true
I20260928 14:50:21.037570 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b2e60bd42e1247258afb605862e3cbed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.038076 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2e60bd42e1247258afb605862e3cbed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:21.039152 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet def872f66b2541b9af6084e93d991ec2 consensus state has no leader
I20260928 14:50:21.041929 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_69d4bcddf3d0495abf820675c110ce8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.042843 9855 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.118480 9741 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.60:39777
W20260928 14:50:21.042428 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69d4bcddf3d0495abf820675c110ce8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.066043 9855 tablet_bootstrap.cc:654] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.132545 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 9741
I20260928 14:50:21.044550 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_413d0798da2e4456aa361e47f8f118d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.118518 9896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.60:39777 every 8 connection(s)
I20260928 14:50:21.053357 9814 tablet_replica.cc:330] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.046896 9397 tablet_service.cc:1467] Processing CreateTablet for tablet def872f66b2541b9af6084e93d991ec2 (DEFAULT_TABLE table=default.Table_1aca6789c31d429ba2f289b7b0ae4cba [id=944b7f0777354b8d96d264eb858cfc93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.126086 9741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
W20260928 14:50:21.205888 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_413d0798da2e4456aa361e47f8f118d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.049330 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e865f14ddc4b0c8ce0877cd99f5972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.092629 9815 ts_tablet_manager.cc:1918] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:21.206979 9815 log.cc:1196] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/380d31a0eb2147f8bb4c32d77cf53867
I20260928 14:50:21.207403 9815 ts_tablet_manager.cc:1939] T 380d31a0eb2147f8bb4c32d77cf53867 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.049381 9827 raft_consensus.cc:686] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:21.049842 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 555b1577a6a1486e93e78125431ab215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.050576 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 (DEFAULT_TABLE table=default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.053368 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.053447 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.053500 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.072412 9813 ts_tablet_manager.cc:1918] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:21.208675 9815 tablet_replica.cc:330] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.053896 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6dc266ab8248d381e4850179455795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.104015 9821 raft_consensus.cc:482] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:21.246114 9909 sys_catalog.cc:263] Verifying existing consensus state
I20260928 14:50:21.262434 9909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap starting.
I20260928 14:50:21.045872 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a315096835a54e1a9682f8c89c4e165b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.055721 9851 tablet_bootstrap.cc:492] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.292902 9851 ts_tablet_manager.cc:1397] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.318s user 0.001s sys 0.003s
W20260928 14:50:21.293087 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a315096835a54e1a9682f8c89c4e165b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.209156 9827 consensus_queue.cc:237] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.076129 9395 tablet_service.cc:1467] Processing CreateTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:21.165081 9220 consensus_peers.cc:487] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc9c25765bb54a328d903d65ad13802b. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:21.293635 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 128724us
I20260928 14:50:21.081616 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 (DEFAULT_TABLE table=default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.214883 9814 raft_consensus.cc:2229] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.086428 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e (DEFAULT_TABLE table=default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.090839 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.294072 9814 raft_consensus.cc:2258] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.094620 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6dc266ab8248d381e4850179455795 (DEFAULT_TABLE table=default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.091459 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 (DEFAULT_TABLE table=default.Table_c85a540301ae48139f38dcc341dabc99 [id=16da29ef576a4730aff2c1e24942cafc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.213683 9821 raft_consensus.cc:504] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.095337 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 17d7539290064c2c9fda29a5f16d375b (DEFAULT_TABLE table=default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.225800 9855 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.294696 9855 ts_tablet_manager.cc:1397] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.254s user 0.006s sys 0.003s
I20260928 14:50:21.295107 9821 leader_election.cc:288] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:21.074316 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce25abb4559241f58054f27435fd6078 consensus state has no leader
I20260928 14:50:21.295413 9855 raft_consensus.cc:348] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.295698 9855 raft_consensus.cc:374] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:21.074903 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3e689e2ffa4edb8ef1004287e40c99 consensus state has no leader
I20260928 14:50:21.295779 9855 raft_consensus.cc:729] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.296065 9814 ts_tablet_manager.cc:1905] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.296003 9855 consensus_queue.cc:260] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.296335 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ada3738d517e4558b34826e35c74196a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:21.296491 9855 ts_tablet_manager.cc:1428] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:21.296792 9855 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.096050 9399 tablet_service.cc:1467] Processing CreateTablet for tablet e0ee1e19142b402f96056c387140b5ca (DEFAULT_TABLE table=default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.096195 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 595dccb9d03b4dd48698262aad630ac2 (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.097796 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (DEFAULT_TABLE table=default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.109114 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 (DEFAULT_TABLE table=default.Table_bd54e79c005f430e9bd80ab3f1cdc376 [id=abe01d8e1ae6470893f4d86a00f7d529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.297704 9815 raft_consensus.cc:2229] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.298266 9815 raft_consensus.cc:2258] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:21.078778 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8700d651fd7144bd9ecc15cfedcfb434 consensus state has no leader
I20260928 14:50:21.298590 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ada3738d517e4558b34826e35c74196a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:21.139503 9901 ts_tablet_manager.cc:927] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Initiating tablet copy from peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:21.299171 9497 leader_election.cc:341] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:21.209795 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 8218bc963a9941a49e8329d0a04d8252 (DEFAULT_TABLE table=default.Table_b2e60bd42e1247258afb605862e3cbed [id=77614b71faa3420291481f6e7c502533]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:21.299713 9498 leader_election.cc:341] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:21.210297 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet def872f66b2541b9af6084e93d991ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.299826 9498 leader_election.cc:302] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:21.079046 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47ff819255f74f49a1ce0b5588aa03a1 consensus state has no leader
W20260928 14:50:21.300002 9498 raft_consensus.cc:2670] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:21.208753 9813 log.cc:1196] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/00b4aec190f94cbab007bd0614588ebd
I20260928 14:50:21.300104 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051b7f0b1d0f4f638f3e7a69a027196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.300519 9813 ts_tablet_manager.cc:1939] T 00b4aec190f94cbab007bd0614588ebd P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:21.073843 9848 ts_tablet_manager.cc:1428] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.064s user 0.004s sys 0.002s
I20260928 14:50:21.301087 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ee1e19142b402f96056c387140b5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.302284 9815 ts_tablet_manager.cc:1905] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.054571 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
W20260928 14:50:21.305505 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 250906us
I20260928 14:50:21.305832 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595dccb9d03b4dd48698262aad630ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.305785 9851 raft_consensus.cc:348] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.306059 9851 raft_consensus.cc:374] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.306161 9851 raft_consensus.cc:729] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.306401 9851 consensus_queue.cc:260] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.307030 9851 ts_tablet_manager.cc:1428] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260928 14:50:21.307370 9851 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.309147 9851 tablet_bootstrap.cc:654] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.309212 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c39546a03d024407aacb996e3b7dc3a0" } modify_external_catalogs: true
W20260928 14:50:21.218509 8940 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 4c101b1f03bb411f963f2348397c03e2 (table default.Table_b15bf17dcd5042b3ab80185b4f036517 [id=30cfc95166db4e5fab7aac9d7721ec26], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4c101b1f03bb411f963f2348397c03e2 consensus state has no leader
I20260928 14:50:21.309481 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c39546a03d024407aacb996e3b7dc3a0" } modify_external_catalogs: true
I20260928 14:50:21.310153 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffd9bc260ae4373a946ce82ba5f0d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.310127 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6" } modify_external_catalogs: true
I20260928 14:50:21.310297 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6" } modify_external_catalogs: true
I20260928 14:50:21.310684 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_95fe08d401ce4a5e84c4d8b47f0243ea" } modify_external_catalogs: true
I20260928 14:50:21.310864 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_95fe08d401ce4a5e84c4d8b47f0243ea" } modify_external_catalogs: true
I20260928 14:50:21.311534 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7fef1dc0110344edb4f6e3ffb68382c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.312052 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fef1dc0110344edb4f6e3ffb68382c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.312906 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d26f83df82f94f588368c60b5b19b239"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.313246 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_90c26f1761434c4da4b1b562e70a7093"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.313737 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f2bc85b7e0f64234b5f336348cb4e49d" } modify_external_catalogs: true
I20260928 14:50:21.313895 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f2bc85b7e0f64234b5f336348cb4e49d" } modify_external_catalogs: true
I20260928 14:50:21.314419 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_59d6edf8a9424fd99021d923d4bf98fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.314881 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59d6edf8a9424fd99021d923d4bf98fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.316906 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89959226fd6247d4b89c54cc6ef4ede6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.317505 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8218bc963a9941a49e8329d0a04d8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.318152 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3e689e2ffa4edb8ef1004287e40c99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.318674 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d26f83df82f94f588368c60b5b19b239 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.318877 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d83ce30f16b64ea3b15795a1e1794df9" } modify_external_catalogs: true
I20260928 14:50:21.319041 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d83ce30f16b64ea3b15795a1e1794df9" } modify_external_catalogs: true
I20260928 14:50:21.321815 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 8218bc963a9941a49e8329d0a04d8252 (DEFAULT_TABLE table=default.Table_b2e60bd42e1247258afb605862e3cbed [id=77614b71faa3420291481f6e7c502533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.322158 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8218bc963a9941a49e8329d0a04d8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.323433 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 00b4aec190f94cbab007bd0614588ebd (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
I20260928 14:50:21.327301 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bbd24c48f3c34bc38d34edc998b1a22f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.327807 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbd24c48f3c34bc38d34edc998b1a22f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.321400 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 (DEFAULT_TABLE table=default.Table_bd54e79c005f430e9bd80ab3f1cdc376 [id=abe01d8e1ae6470893f4d86a00f7d529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.329061 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89959226fd6247d4b89c54cc6ef4ede6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.332471 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90c26f1761434c4da4b1b562e70a7093 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.334064 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 (DEFAULT_TABLE table=default.Table_bd54e79c005f430e9bd80ab3f1cdc376 [id=abe01d8e1ae6470893f4d86a00f7d529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.334096 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 8218bc963a9941a49e8329d0a04d8252 (DEFAULT_TABLE table=default.Table_b2e60bd42e1247258afb605862e3cbed [id=77614b71faa3420291481f6e7c502533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.334070 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7bef5ad1b07443a19dc0e47790936ecc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.334470 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89959226fd6247d4b89c54cc6ef4ede6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.334525 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bef5ad1b07443a19dc0e47790936ecc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.334712 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8218bc963a9941a49e8329d0a04d8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.335763 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6baee3f426384a22b739a3129d41abde" } new_table_name: "default.Table_12d8f6b419c946f48ae9f7c461999575" modify_external_catalogs: true
I20260928 14:50:21.340445 9855 tablet_bootstrap.cc:654] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.341915 9821 raft_consensus.cc:482] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:21.342057 9821 raft_consensus.cc:504] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.342646 9821 leader_election.cc:288] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:21.345896 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:21.347100 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9cee872de1f4ce8b803cb8e8fb018d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.347452 9848 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:21.347644 9408 tablet_service.cc:1467] Processing CreateTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f (DEFAULT_TABLE table=default.Table_69d4bcddf3d0495abf820675c110ce8c [id=0c7c9f38c5984b3597ba7b03c38113a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.350070 9814 ts_tablet_manager.cc:1918] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:21.350217 9814 log.cc:1196] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4d800c3135bb44f994baea4732245aea
I20260928 14:50:21.350610 9814 ts_tablet_manager.cc:1939] T 4d800c3135bb44f994baea4732245aea P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.351569 9814 tablet_replica.cc:330] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.351773 9814 raft_consensus.cc:2229] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:21.351972 9813 tablet_replica.cc:330] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:21.352138 9814 raft_consensus.cc:2258] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.352676 9814 ts_tablet_manager.cc:1905] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.353618 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.353688 9815 ts_tablet_manager.cc:1918] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.353811 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.356112 9815 log.cc:1196] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ada3738d517e4558b34826e35c74196a
I20260928 14:50:21.356526 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 17d7539290064c2c9fda29a5f16d375b
I20260928 14:50:21.356662 9815 ts_tablet_manager.cc:1939] T ada3738d517e4558b34826e35c74196a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.357287 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:21.357719 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75680fd6738044759f8edeb9589f9bf4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:21.358022 9815 tablet_replica.cc:330] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.358064 9427 raft_consensus.cc:2379] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 658e483a10314e8d93c2f6e9084f2a91 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:21.358172 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d7539290064c2c9fda29a5f16d375b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.358359 9815 raft_consensus.cc:2229] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.359633 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
W20260928 14:50:21.359879 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ef1cee3a6904bc5950dbc6d4a5390ee already in progress: creating tablet
W20260928 14:50:21.360090 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 894af8262a004e41a6ccc2641f8f7605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 894af8262a004e41a6ccc2641f8f7605 already in progress: creating tablet
I20260928 14:50:21.360396 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ada3738d517e4558b34826e35c74196a (table default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]) successfully deleted
I20260928 14:50:21.363848 9262 tablet_service.cc:1467] Processing CreateTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f (DEFAULT_TABLE table=default.Table_69d4bcddf3d0495abf820675c110ce8c [id=0c7c9f38c5984b3597ba7b03c38113a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.364035 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.364311 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd70cf6ee2d343878c90ae4818f1eb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.365638 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.367095 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4d800c3135bb44f994baea4732245aea (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
W20260928 14:50:21.371235 9219 consensus_peers.cc:487] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc9c25765bb54a328d903d65ad13802b. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:21.371523 9813 raft_consensus.cc:2229] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.371759 9813 raft_consensus.cc:2258] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.373870 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9d6dc266ab8248d381e4850179455795
I20260928 14:50:21.373893 9851 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.374064 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 8948e45987b94ca69004c42e224ce93f (DEFAULT_TABLE table=default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.374536 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:21.358502 9498 leader_election.cc:302] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:21.374905 9821 raft_consensus.cc:3037] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:21.375327 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8948e45987b94ca69004c42e224ce93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.377229 9821 raft_consensus.cc:2726] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:21.361769 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.362286 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 8948e45987b94ca69004c42e224ce93f (DEFAULT_TABLE table=default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.363037 9543 tablet_service.cc:1467] Processing CreateTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f (DEFAULT_TABLE table=default.Table_69d4bcddf3d0495abf820675c110ce8c [id=0c7c9f38c5984b3597ba7b03c38113a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.377770 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd70cf6ee2d343878c90ae4818f1eb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.377799 9851 ts_tablet_manager.cc:1397] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.005s
I20260928 14:50:21.380046 9815 raft_consensus.cc:2258] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:21.380788 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964985f048114f53ba1e685c7f1dbd6d consensus state has no leader
I20260928 14:50:21.380237 9851 raft_consensus.cc:348] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.380995 9851 raft_consensus.cc:374] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.381374 9851 raft_consensus.cc:729] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.369660 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.369851 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.381855 9813 ts_tablet_manager.cc:1905] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.382038 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8948e45987b94ca69004c42e224ce93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.357800 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 8948e45987b94ca69004c42e224ce93f (DEFAULT_TABLE table=default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.382416 9851 consensus_queue.cc:260] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.380808 9815 ts_tablet_manager.cc:1905] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.384250 9851 ts_tablet_manager.cc:1428] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260928 14:50:21.389680 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:21.269477 8928 kernel_stack_watchdog.cc:198] Thread 8939 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 140ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f86e96e9980 (unknown) at ??:0
@ 0x7f86e96e39c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7f86e37da69c google::LogMessage::Flush() at ??:0
@ 0x7f86e37da6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f86f9305994 kudu::master::AsyncDeleteReplica::HandleResponse() at ??:0
@ 0x7f86f925f9a7 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f86f9309540 _ZZN4kudu6master18AsyncDeleteReplica11SendRequestEiENKUlvE_clEv at ??:0
@ 0x7f86f930935e _ZNSt17_Function_handlerIFvvEZN4kudu6master18AsyncDeleteReplica11SendRequestEiEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f86ece89f86 kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7f86ece89b6e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f86ece75dea kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f86ece76321 kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f86ece13aa9 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f86ece125a5 kudu::rpc::Connection::ReadHandler() at ??:0
I20260928 14:50:21.393169 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.393683 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 964985f048114f53ba1e685c7f1dbd6d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.393970 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 8d26550613aa4988910ec66eeb8b2f07 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.394529 9815 ts_tablet_manager.cc:1918] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.394635 9815 log.cc:1196] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d99589ea0ed0477589bd34d5acad6776
I20260928 14:50:21.394976 9815 ts_tablet_manager.cc:1939] T d99589ea0ed0477589bd34d5acad6776 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.397090 9815 tablet_replica.cc:330] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.397378 9815 raft_consensus.cc:2229] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.397662 9815 raft_consensus.cc:2258] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.398504 9815 ts_tablet_manager.cc:1905] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.398664 9851 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.401921 9855 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.402279 9855 ts_tablet_manager.cc:1397] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
I20260928 14:50:21.402842 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e7e11092d1475cba53e51a0f61d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.404649 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:21.405810 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.412421 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ff819255f74f49a1ce0b5588aa03a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.413345 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6dc266ab8248d381e4850179455795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.414227 9848 tablet_bootstrap.cc:654] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.415266 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd70cf6ee2d343878c90ae4818f1eb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.416606 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.416801 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.417907 9814 ts_tablet_manager.cc:1918] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:21.418037 9814 log.cc:1196] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e4484f878a2540799bcee1a35e9a2b69
I20260928 14:50:21.418540 9814 ts_tablet_manager.cc:1939] T e4484f878a2540799bcee1a35e9a2b69 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.419026 9814 tablet_replica.cc:330] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.419242 9814 raft_consensus.cc:2229] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:21.419581 9814 raft_consensus.cc:2258] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.421427 9901 tablet_copy_client.cc:316] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: tablet copy: Beginning tablet copy session from remote peer at address 127.8.181.3:44119
I20260928 14:50:21.422596 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.423880 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.424726 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.424989 9589 tablet_copy_service.cc:140] P 658e483a10314e8d93c2f6e9084f2a91: Received BeginTabletCopySession request for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 from peer ae832871bd1142f7af10c084115ffc12 ({username='slave'} at 127.8.181.2:55055)
I20260928 14:50:21.425225 9589 tablet_copy_service.cc:161] P 658e483a10314e8d93c2f6e9084f2a91: Beginning new tablet copy session on tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 from peer ae832871bd1142f7af10c084115ffc12 at {username='slave'} at 127.8.181.2:55055: session id = ae832871bd1142f7af10c084115ffc12-6bb86e4e2d234f7ab4de8fb8a1c6a4f8
I20260928 14:50:21.426453 9814 ts_tablet_manager.cc:1905] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.427603 9851 tablet_bootstrap.cc:654] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.428562 9855 raft_consensus.cc:348] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.428814 9855 raft_consensus.cc:374] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.428948 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.429834 9855 raft_consensus.cc:729] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.430094 9855 consensus_queue.cc:260] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.432102 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.432526 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.435858 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.437487 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.438067 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8948e45987b94ca69004c42e224ce93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.438467 9589 tablet_copy_source_session.cc:205] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 14:50:21.439476 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a (DEFAULT_TABLE table=default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.439810 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8193754d28d34c18bfc38ae0abd05f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.440294 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5166a828e84d46af3112cdc7bb0a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.440902 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.441713 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a30439ac5a8485a9b6ebbe1371087b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.445978 9855 ts_tablet_manager.cc:1428] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260928 14:50:21.446293 9855 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.446419 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 964985f048114f53ba1e685c7f1dbd6d
I20260928 14:50:21.446832 8948 catalog_manager.cc:6565] ReplaceTablet: tablet 964985f048114f53ba1e685c7f1dbd6d deleted and replaced by tablet 03245f72e0aa496d895968d8e5715b56
I20260928 14:50:21.449421 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.451063 9855 tablet_bootstrap.cc:654] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.453768 9815 ts_tablet_manager.cc:1918] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.453948 9815 log.cc:1196] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/75680fd6738044759f8edeb9589f9bf4
I20260928 14:50:21.454279 9815 ts_tablet_manager.cc:1939] T 75680fd6738044759f8edeb9589f9bf4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.454936 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.457080 9855 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.458406 9855 ts_tablet_manager.cc:1397] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260928 14:50:21.459074 9855 raft_consensus.cc:348] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.459267 9855 raft_consensus.cc:374] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.459321 9855 raft_consensus.cc:729] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.459501 9855 consensus_queue.cc:260] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.461561 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d99589ea0ed0477589bd34d5acad6776 (table default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:21.464421 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
W20260928 14:50:21.465159 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 45075us
I20260928 14:50:21.465507 9855 ts_tablet_manager.cc:1428] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
W20260928 14:50:21.465517 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8d26550613aa4988910ec66eeb8b2f07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d26550613aa4988910ec66eeb8b2f07 already in progress: creating tablet
I20260928 14:50:21.465660 9815 tablet_replica.cc:330] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.465821 9815 raft_consensus.cc:2229] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.465809 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 75680fd6738044759f8edeb9589f9bf4 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
I20260928 14:50:21.466005 9815 raft_consensus.cc:2258] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:21.466034 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 00b4aec190f94cbab007bd0614588ebd because the tablet was not found. No further retry: Not found: Tablet not found: 00b4aec190f94cbab007bd0614588ebd
I20260928 14:50:21.466522 9815 ts_tablet_manager.cc:1905] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.467960 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e4484f878a2540799bcee1a35e9a2b69 (table default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:21.472851 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.473654 9855 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.475625 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.476136 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a (DEFAULT_TABLE table=default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.476487 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5166a828e84d46af3112cdc7bb0a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.481581 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.481793 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.482235 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.482404 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a (DEFAULT_TABLE table=default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.483002 9855 tablet_bootstrap.cc:654] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.483090 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet d99589ea0ed0477589bd34d5acad6776 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.483779 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.484021 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5166a828e84d46af3112cdc7bb0a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.484454 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet e4484f878a2540799bcee1a35e9a2b69 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.494004 9815 ts_tablet_manager.cc:1918] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.494194 9815 log.cc:1196] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b50279cc5fcf43dc9ce0cafaacf93b3e
I20260928 14:50:21.494868 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.495860 9813 ts_tablet_manager.cc:1918] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:21.496030 9813 log.cc:1196] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/e4484f878a2540799bcee1a35e9a2b69
I20260928 14:50:21.496411 9813 ts_tablet_manager.cc:1939] T e4484f878a2540799bcee1a35e9a2b69 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:21.496747 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 20) took 1019 ms. Trace:
I20260928 14:50:21.498026 9473 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.498231 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.497823 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.504230 9814 ts_tablet_manager.cc:1918] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:21.504388 9814 log.cc:1196] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cc9c25765bb54a328d903d65ad13802b
I20260928 14:50:21.504755 9814 ts_tablet_manager.cc:1939] T cc9c25765bb54a328d903d65ad13802b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.512717 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f5bcc70b7720421fad8a94e37bbd663d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.513273 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5bcc70b7720421fad8a94e37bbd663d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.514416 9815 ts_tablet_manager.cc:1939] T b50279cc5fcf43dc9ce0cafaacf93b3e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.515343 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_af0f3ad2239b4d608f5059a112dd6f91 [id=3b23d10e59cb42238f2274ea2aca9a93]) successfully deleted
I20260928 14:50:21.515424 9815 tablet_replica.cc:330] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.515889 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_76eb6fb13ae44aa6a78a1f9a258d47de" } new_table_name: "default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf" modify_external_catalogs: true
I20260928 14:50:21.517168 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b2e60bd42e1247258afb605862e3cbed" } new_table_name: "default.Table_52d13edfb61a4b7aa82f6a3997a78f2c" modify_external_catalogs: true
I20260928 14:50:21.517792 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b15bf17dcd5042b3ab80185b4f036517" } new_table_name: "default.Table_12b926cfeead4b05a434279fb8a0df41" modify_external_catalogs: true
I20260928 14:50:21.515601 9815 raft_consensus.cc:2229] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.518973 9815 raft_consensus.cc:2258] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.519714 9815 ts_tablet_manager.cc:1905] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.519796 9394 tablet_service.cc:1467] Processing CreateTablet for tablet ed0d79a39b2543049506422432990617 (DEFAULT_TABLE table=default.Table_7bef5ad1b07443a19dc0e47790936ecc [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.520146 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0d79a39b2543049506422432990617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.520609 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_81d22cb6ebbd4493b48d69af0c3b0227"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.521080 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81d22cb6ebbd4493b48d69af0c3b0227 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.522192 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4970c43c954a4fc4abe5155f630f6f6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.522653 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4970c43c954a4fc4abe5155f630f6f6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.523254 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 (DEFAULT_TABLE table=default.Table_d26f83df82f94f588368c60b5b19b239 [id=24b463abfd834c8b9c6f579d967741b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.523613 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f02364b809f4e1c8d558f121d4d88b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.523653 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b3cf2a7374154dc4998057cb92b6c52a" } new_table_name: "default.Table_d47d9dc144824b13a05a1a8ed9fc5382" modify_external_catalogs: true
W20260928 14:50:21.523929 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c101b1f03bb411f963f2348397c03e2 consensus state has no leader
W20260928 14:50:21.527060 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8218bc963a9941a49e8329d0a04d8252 consensus state has no leader
W20260928 14:50:21.527482 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 605ccf9ad9ca4eb985374e065c48601a consensus state has no leader
I20260928 14:50:21.530241 9543 tablet_service.cc:1467] Processing CreateTablet for tablet ed0d79a39b2543049506422432990617 (DEFAULT_TABLE table=default.Table_7bef5ad1b07443a19dc0e47790936ecc [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.530314 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ed0d79a39b2543049506422432990617 (DEFAULT_TABLE table=default.Table_7bef5ad1b07443a19dc0e47790936ecc [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.530581 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0d79a39b2543049506422432990617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.530699 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0d79a39b2543049506422432990617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.535080 9851 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.535209 9851 ts_tablet_manager.cc:1397] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.137s user 0.007s sys 0.002s
I20260928 14:50:21.536589 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 (DEFAULT_TABLE table=default.Table_d26f83df82f94f588368c60b5b19b239 [id=24b463abfd834c8b9c6f579d967741b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.536664 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (DEFAULT_TABLE table=default.Table_bbd24c48f3c34bc38d34edc998b1a22f [id=11115f212dde4f8e8ef6e06db5310c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.536933 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f02364b809f4e1c8d558f121d4d88b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.536981 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0b8288fc9b47ce8c70dec324dfecf0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.539865 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29e865f14ddc4b0c8ce0877cd99f5972 consensus state has no leader
I20260928 14:50:21.540263 9909 log.cc:824] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:21.540908 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 17) took 1041 ms. Trace:
I20260928 14:50:21.543288 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet cd8131f32f1a4153abf2967ca0a11619 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.547430 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (DEFAULT_TABLE table=default.Table_bbd24c48f3c34bc38d34edc998b1a22f [id=11115f212dde4f8e8ef6e06db5310c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.547822 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0b8288fc9b47ce8c70dec324dfecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.496877 9813 rpcz_store.cc:276] 0928 14:50:20.477551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.478065 (+ 514us) service_pool.cc:227] Handling call
0928 14:50:21.323150 (+845085us) ts_tablet_manager.cc:1145] Deleting tablet e4484f878a2540799bcee1a35e9a2b69
0928 14:50:21.323158 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.492205 (+169047us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.495758 (+ 3553us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.496692 (+ 934us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":844904}
I20260928 14:50:21.550010 9813 tablet_replica.cc:330] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:21.550352 9813 raft_consensus.cc:2229] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.550771 9813 raft_consensus.cc:2258] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.551276 9815 ts_tablet_manager.cc:1918] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.551400 9815 log.cc:1196] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/555b1577a6a1486e93e78125431ab215
I20260928 14:50:21.551695 9815 ts_tablet_manager.cc:1939] T 555b1577a6a1486e93e78125431ab215 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.552223 9813 ts_tablet_manager.cc:1905] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.554102 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet e4484f878a2540799bcee1a35e9a2b69 (table default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:21.556975 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 555b1577a6a1486e93e78125431ab215 (table default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]) successfully deleted
I20260928 14:50:21.556913 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 7b47d891c9264a03ac11f50f2b56edad (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:21.557178 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 63792bb2d5b54463a701c9e4e5f095e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63792bb2d5b54463a701c9e4e5f095e0 already in progress: creating tablet
I20260928 14:50:21.557256 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b47d891c9264a03ac11f50f2b56edad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.560062 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cd8131f32f1a4153abf2967ca0a11619 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd8131f32f1a4153abf2967ca0a11619 already in progress: creating tablet
W20260928 14:50:21.560292 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9aeda483866146f89198e6f14456f0f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeda483866146f89198e6f14456f0f2 already in progress: creating tablet
W20260928 14:50:21.560503 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 17d7539290064c2c9fda29a5f16d375b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d7539290064c2c9fda29a5f16d375b already in progress: creating tablet
W20260928 14:50:21.560721 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e0ee1e19142b402f96056c387140b5ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0ee1e19142b402f96056c387140b5ca already in progress: creating tablet
I20260928 14:50:21.560700 9901 tablet_copy_client.cc:791] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: tablet copy: Starting download of 0 data blocks...
I20260928 14:50:21.561666 9901 tablet_copy_client.cc:655] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: tablet copy: Starting download of 1 WAL segments...
I20260928 14:50:21.565603 9815 tablet_replica.cc:330] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.565774 9815 raft_consensus.cc:2229] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.565955 9815 raft_consensus.cc:2258] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.566545 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad79ea2361c24f15adbaee0e9f6a72e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.567157 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.570212 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9172d2fb2b6b4543b6352b66dfeed0f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.570722 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9172d2fb2b6b4543b6352b66dfeed0f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.571857 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7521642115684918bcca103f46abe69d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.572319 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7521642115684918bcca103f46abe69d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.572889 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 7b47d891c9264a03ac11f50f2b56edad (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.572968 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 6a50b4fe8d86464f933baec07478db25 (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.573216 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b47d891c9264a03ac11f50f2b56edad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.573314 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a50b4fe8d86464f933baec07478db25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.579026 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 6a50b4fe8d86464f933baec07478db25 (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.579334 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a50b4fe8d86464f933baec07478db25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.582885 9901 tablet_copy_client.cc:531] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 14:50:21.584988 9815 ts_tablet_manager.cc:1905] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.585351 9543 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (DEFAULT_TABLE table=default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.586966 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d47d9dc144824b13a05a1a8ed9fc5382" } modify_external_catalogs: true
I20260928 14:50:21.587073 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_973889bd0a494a95a0a088ba6e85c124" } modify_external_catalogs: true
I20260928 14:50:21.586571 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 03245f72e0aa496d895968d8e5715b56 (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.585692 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf10326ec24b99ae2ab1ba8779d1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.587639 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03245f72e0aa496d895968d8e5715b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.593822 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d47d9dc144824b13a05a1a8ed9fc5382" } modify_external_catalogs: true
I20260928 14:50:21.595278 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_973889bd0a494a95a0a088ba6e85c124" } modify_external_catalogs: true
I20260928 14:50:21.596903 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cce07af2389446a1b409612d248028cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.597452 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce07af2389446a1b409612d248028cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.597770 9901 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:21.542244 9814 rpcz_store.cc:276] 0928 14:50:20.499583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.573683 (+ 74100us) service_pool.cc:227] Handling call
0928 14:50:21.418958 (+845275us) ts_tablet_manager.cc:1145] Deleting tablet cc9c25765bb54a328d903d65ad13802b
0928 14:50:21.418972 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.431254 (+ 12282us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.504110 (+ 72856us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.540534 (+ 36424us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":814313}
I20260928 14:50:21.604187 9392 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (DEFAULT_TABLE table=default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.604529 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf10326ec24b99ae2ab1ba8779d1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.604954 9855 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.605185 9855 ts_tablet_manager.cc:1397] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.132s user 0.003s sys 0.003s
I20260928 14:50:21.608495 9813 ts_tablet_manager.cc:1918] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:21.608616 9813 log.cc:1196] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/380d31a0eb2147f8bb4c32d77cf53867
I20260928 14:50:21.609025 9813 ts_tablet_manager.cc:1939] T 380d31a0eb2147f8bb4c32d77cf53867 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:21.609217 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 (DEFAULT_TABLE table=default.Table_d26f83df82f94f588368c60b5b19b239 [id=24b463abfd834c8b9c6f579d967741b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.609660 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f02364b809f4e1c8d558f121d4d88b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.609782 9266 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (DEFAULT_TABLE table=default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.610432 8924 master_runner.cc:186] Error getting master registration for 127.8.181.60:39777: OK, instance_id { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" instance_seqno: 1790607020240865 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 14:50:21.610690 8924 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 14:50:21.610903 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf10326ec24b99ae2ab1ba8779d1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.611058 9855 raft_consensus.cc:348] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.611387 9855 raft_consensus.cc:374] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.612560 9855 raft_consensus.cc:729] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.612958 9855 consensus_queue.cc:260] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.613621 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
W20260928 14:50:21.614676 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ef1cee3a6904bc5950dbc6d4a5390ee already in progress: creating tablet
W20260928 14:50:21.615022 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8d26550613aa4988910ec66eeb8b2f07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d26550613aa4988910ec66eeb8b2f07 already in progress: creating tablet
I20260928 14:50:21.615782 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a315096835a54e1a9682f8c89c4e165b" } modify_external_catalogs: true
I20260928 14:50:21.615968 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 7b47d891c9264a03ac11f50f2b56edad (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.616045 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a315096835a54e1a9682f8c89c4e165b" } modify_external_catalogs: true
I20260928 14:50:21.616385 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b47d891c9264a03ac11f50f2b56edad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.616596 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_52d13edfb61a4b7aa82f6a3997a78f2c" } modify_external_catalogs: true
I20260928 14:50:21.617269 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 03245f72e0aa496d895968d8e5715b56 (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.617617 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03245f72e0aa496d895968d8e5715b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.618408 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 17) took 1141 ms. Trace:
I20260928 14:50:21.618471 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6a50b4fe8d86464f933baec07478db25 (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.618521 9813 rpcz_store.cc:276] 0928 14:50:20.477196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.479572 (+ 2376us) service_pool.cc:227] Handling call
0928 14:50:21.549628 (+1070056us) ts_tablet_manager.cc:1145] Deleting tablet 380d31a0eb2147f8bb4c32d77cf53867
0928 14:50:21.549639 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.592557 (+ 42918us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.608384 (+ 15827us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.618374 (+ 9990us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069763}
I20260928 14:50:21.618781 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a50b4fe8d86464f933baec07478db25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.619270 9851 raft_consensus.cc:348] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.619493 9851 raft_consensus.cc:374] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.619603 9851 raft_consensus.cc:729] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.618965 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (DEFAULT_TABLE table=default.Table_bbd24c48f3c34bc38d34edc998b1a22f [id=11115f212dde4f8e8ef6e06db5310c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.620489 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0b8288fc9b47ce8c70dec324dfecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.621022 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 03245f72e0aa496d895968d8e5715b56 (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.621174 9814 tablet_replica.cc:330] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.621423 9814 raft_consensus.cc:2229] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.621490 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03245f72e0aa496d895968d8e5715b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.621771 9814 raft_consensus.cc:2258] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.622466 9814 ts_tablet_manager.cc:1905] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.624987 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 29) took 1026 ms. Trace:
I20260928 14:50:21.625212 9813 rpcz_store.cc:276] 0928 14:50:20.597998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.598045 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:21.624749 (+1026704us) ts_tablet_manager.cc:1145] Deleting tablet 5ef1cee3a6904bc5950dbc6d4a5390ee
0928 14:50:21.624758 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.624880 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026515}
I20260928 14:50:21.626180 9855 ts_tablet_manager.cc:1428] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260928 14:50:21.626230 9848 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:21.629285 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_52d13edfb61a4b7aa82f6a3997a78f2c" } modify_external_catalogs: true
I20260928 14:50:21.629706 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 380d31a0eb2147f8bb4c32d77cf53867 (table default.Table_dcd0bd483d494cb1b9761b88cfef0abe [id=3d29a9aa9d9a437f8f3ba864f46b571e]) successfully deleted
I20260928 14:50:21.630231 9848 ts_tablet_manager.cc:1397] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.307s user 0.011s sys 0.013s
I20260928 14:50:21.619827 9851 consensus_queue.cc:260] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.631253 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.631592 9848 raft_consensus.cc:348] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.631806 9848 raft_consensus.cc:374] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.631906 9848 raft_consensus.cc:729] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.632454 9813 tablet_replica.cc:330] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:21.632625 9813 raft_consensus.cc:2229] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
W20260928 14:50:21.654279 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ef1cee3a6904bc5950dbc6d4a5390ee already in progress: creating tablet
I20260928 14:50:21.637780 9851 ts_tablet_manager.cc:1428] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.101s user 0.002s sys 0.000s
I20260928 14:50:21.666766 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.661635 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d2f23d569c24e48907579804c0dfcbc" } new_table_name: "default.Table_381accf700114544b20a817ee30e9fff" modify_external_catalogs: true
I20260928 14:50:21.673121 9814 ts_tablet_manager.cc:1918] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.741297 9814 log.cc:1196] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ada3738d517e4558b34826e35c74196a
I20260928 14:50:21.661780 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_baeb1f09aaeb41198d89478f8ff2b440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.741755 9814 ts_tablet_manager.cc:1939] T ada3738d517e4558b34826e35c74196a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:21.741956 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baeb1f09aaeb41198d89478f8ff2b440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.742558 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 35) took 1017 ms. Trace:
I20260928 14:50:21.742681 9814 rpcz_store.cc:276] 0928 14:50:20.725370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.743388 (+ 18018us) service_pool.cc:227] Handling call
0928 14:50:21.618226 (+874838us) ts_tablet_manager.cc:1145] Deleting tablet ada3738d517e4558b34826e35c74196a
0928 14:50:21.618236 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.626634 (+ 8398us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.673018 (+ 46384us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.742520 (+ 69502us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":785397}
I20260928 14:50:21.662084 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.662618 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 894af8262a004e41a6ccc2641f8f7605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 894af8262a004e41a6ccc2641f8f7605 already in progress: creating tablet
I20260928 14:50:21.743228 9814 tablet_replica.cc:330] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:21.743338 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 80737.6us
I20260928 14:50:21.632779 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.743429 9814 raft_consensus.cc:2229] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.743594 9814 raft_consensus.cc:2258] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.744148 9814 ts_tablet_manager.cc:1905] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.744684 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:21.694587 9219 consensus_peers.cc:487] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75680fd6738044759f8edeb9589f9bf4. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:21.740327 8940 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 86218.6us
W20260928 14:50:21.745380 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 50820us
I20260928 14:50:21.636193 9855 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.745411 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6153a2da670a4ced9fcc45cb16cdb91e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.745918 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6153a2da670a4ced9fcc45cb16cdb91e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:21.746058 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ada3738d517e4558b34826e35c74196a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ada3738d517e4558b34826e35c74196a already in progress: creating tablet
W20260928 14:50:21.746294 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8d26550613aa4988910ec66eeb8b2f07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d26550613aa4988910ec66eeb8b2f07 already in progress: creating tablet
W20260928 14:50:21.746506 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 894af8262a004e41a6ccc2641f8f7605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 894af8262a004e41a6ccc2641f8f7605 already in progress: creating tablet
I20260928 14:50:21.740542 9851 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.651597 9909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap replayed 1/1 log segments. Stats: ops{read=43 overwritten=0 applied=36 ignored=0} inserts{seen=31 ignored=0} mutations{seen=25 ignored=0} orphaned_commits=0. Pending: 7 replicates
I20260928 14:50:21.633386 9848 consensus_queue.cc:260] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.749897 9848 ts_tablet_manager.cc:1428] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.120s user 0.002s sys 0.000s
I20260928 14:50:21.750231 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.750252 9909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap complete.
I20260928 14:50:21.747152 9855 tablet_bootstrap.cc:654] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.645187 9815 ts_tablet_manager.cc:1918] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.751891 9815 log.cc:1196] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:21.752249 9815 ts_tablet_manager.cc:1939] T b04e1f1977af4af8aed072bbd77e6f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.633196 9813 pending_rounds.cc:62] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:21.753480 9815 tablet_replica.cc:330] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.753638 9813 pending_rounds.cc:68] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326359220346880 op_type: NO_OP noop_request { }
I20260928 14:50:21.753746 9815 raft_consensus.cc:2229] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.753827 9813 raft_consensus.cc:2866] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:21.747551 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9172d2fb2b6b4543b6352b66dfeed0f5" } modify_external_catalogs: true
W20260928 14:50:21.743371 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.753918 9815 raft_consensus.cc:2258] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.753959 9813 raft_consensus.cc:2258] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.754014 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9172d2fb2b6b4543b6352b66dfeed0f5" } modify_external_catalogs: true
I20260928 14:50:21.754623 9815 ts_tablet_manager.cc:1905] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.652155 9901 tablet.cc:1722] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:21.748063 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ada3738d517e4558b34826e35c74196a (table default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]) successfully deleted
I20260928 14:50:21.754854 9901 tablet_metadata.cc:623] Not flushing: waiting for 1 pins to be released.
W20260928 14:50:21.755033 8939 catalog_manager.cc:4808] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d69b1a90be4f4a1681bd5d83b0228d92 because the tablet was not found. No further retry: Not found: Tablet not found: d69b1a90be4f4a1681bd5d83b0228d92
I20260928 14:50:21.755244 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b04e1f1977af4af8aed072bbd77e6f4c (table default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]) successfully deleted
I20260928 14:50:21.755357 9901 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260928 14:50:21.755439 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9d6dc266ab8248d381e4850179455795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6dc266ab8248d381e4850179455795 already in progress: creating tablet
W20260928 14:50:21.755630 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9b998502f90a4df08b4078f833ad8c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b998502f90a4df08b4078f833ad8c05 already in progress: creating tablet
W20260928 14:50:21.755807 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 051b7f0b1d0f4f638f3e7a69a027196e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 051b7f0b1d0f4f638f3e7a69a027196e already in progress: creating tablet
I20260928 14:50:21.755844 9901 tablet_bootstrap.cc:492] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Bootstrap complete.
W20260928 14:50:21.756008 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 964985f048114f53ba1e685c7f1dbd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 964985f048114f53ba1e685c7f1dbd6d already in progress: creating tablet
I20260928 14:50:21.758180 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 (DEFAULT_TABLE table=default.Table_81d22cb6ebbd4493b48d69af0c3b0227 [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.758186 9543 tablet_service.cc:1467] Processing CreateTablet for tablet cf2dd699271542bd9b9604e746686c53 (DEFAULT_TABLE table=default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.759712 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bef7b73d24a42979fcb7a2e47e92919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.760206 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2dd699271542bd9b9604e746686c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.750254 9848 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:21.748322 9851 tablet_bootstrap.cc:654] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.752476 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.757932 9265 tablet_service.cc:1467] Processing CreateTablet for tablet cf2dd699271542bd9b9604e746686c53 (DEFAULT_TABLE table=default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.761749 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.761904 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2dd699271542bd9b9604e746686c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.767074 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 (DEFAULT_TABLE table=default.Table_81d22cb6ebbd4493b48d69af0c3b0227 [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.767432 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bef7b73d24a42979fcb7a2e47e92919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.769739 9262 tablet_service.cc:1467] Processing CreateTablet for tablet ee16f4482a424538812f6356655acf77 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.770104 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee16f4482a424538812f6356655acf77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.771020 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a64ffa786f045b480efe51eb69d7074 consensus state has no leader
I20260928 14:50:21.771276 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 315c446d87c84ae4bc9cb3243dca5538 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.771672 9813 ts_tablet_manager.cc:1905] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.771799 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.771874 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 894af8262a004e41a6ccc2641f8f7605 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.772256 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e661ac0a85949a280d837ee0357eea7 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.773850 9393 tablet_service.cc:1467] Processing CreateTablet for tablet cf2dd699271542bd9b9604e746686c53 (DEFAULT_TABLE table=default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.774204 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 (DEFAULT_TABLE table=default.Table_81d22cb6ebbd4493b48d69af0c3b0227 [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.775991 9394 tablet_service.cc:1467] Processing CreateTablet for tablet ee16f4482a424538812f6356655acf77 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.776185 9848 tablet_bootstrap.cc:654] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.777210 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2dd699271542bd9b9604e746686c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.777900 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.778064 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bef7b73d24a42979fcb7a2e47e92919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.778769 9814 ts_tablet_manager.cc:1918] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.778893 9814 log.cc:1196] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d99589ea0ed0477589bd34d5acad6776
I20260928 14:50:21.778975 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d26f83df82f94f588368c60b5b19b239" } new_table_name: "default.Table_550f202c199b47f098184b3921013074" modify_external_catalogs: true
I20260928 14:50:21.779184 9814 ts_tablet_manager.cc:1939] T d99589ea0ed0477589bd34d5acad6776 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.780471 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee16f4482a424538812f6356655acf77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.782052 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d83736fcd1be4678a302426b78fd1d6e" } new_table_name: "default.Table_ab8b665217b04cf7a742ad3a5bda5573" modify_external_catalogs: true
I20260928 14:50:21.790222 9538 tablet_service.cc:1467] Processing CreateTablet for tablet ee16f4482a424538812f6356655acf77 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.792445 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7bef5ad1b07443a19dc0e47790936ecc" } new_table_name: "default.Table_cfe5ca1f74cb4f2babaf347be5b9a8f5" modify_external_catalogs: true
I20260928 14:50:21.792732 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8218bc963a9941a49e8329d0a04d8252
I20260928 14:50:21.793227 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:21.793516 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d3606a72c566496db99da926a94abb30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.793928 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cd097e6f93214ec0b7966e4b467d51e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.794351 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:21.794430 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd097e6f93214ec0b7966e4b467d51e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.794606 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 29e865f14ddc4b0c8ce0877cd99f5972
I20260928 14:50:21.794591 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.795182 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.795204 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_102c885d8b48453a84696844fe43f393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.795702 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_102c885d8b48453a84696844fe43f393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.795822 8950 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 49db256b8d3a49c5bc2f92bcfdffbc1c
I20260928 14:50:21.796216 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bc8042c6f95c497ea4c6c571d5c1cdd8" } new_table_name: "default.Table_2d202dfea9be4834a2afc521a5a1e956" modify_external_catalogs: true
I20260928 14:50:21.796594 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9d5166a828e84d46af3112cdc7bb0a2a
I20260928 14:50:21.797202 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee16f4482a424538812f6356655acf77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:21.794065 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3606a72c566496db99da926a94abb30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.797636 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.798547 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_afef2b8c01784afca888d12fea0bb492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.798981 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afef2b8c01784afca888d12fea0bb492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.800385 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.805246 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.805330 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 36) took 1079 ms. Trace:
I20260928 14:50:21.805449 9814 rpcz_store.cc:276] 0928 14:50:20.725478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.741593 (+ 16115us) service_pool.cc:227] Handling call
0928 14:50:21.743172 (+1001579us) ts_tablet_manager.cc:1145] Deleting tablet d99589ea0ed0477589bd34d5acad6776
0928 14:50:21.743180 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.772931 (+ 29751us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.778675 (+ 5744us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.805261 (+ 26586us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":869211}
I20260928 14:50:21.806032 9814 tablet_replica.cc:330] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.806216 9814 raft_consensus.cc:2229] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:21.806510 9814 pending_rounds.cc:62] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:21.806569 9814 pending_rounds.cc:68] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326357344657408 op_type: NO_OP noop_request { }
W20260928 14:50:21.806713 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f02364b809f4e1c8d558f121d4d88b9 consensus state has no leader
I20260928 14:50:21.806712 9814 raft_consensus.cc:2866] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:21.806761 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d99589ea0ed0477589bd34d5acad6776 (table default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:21.806762 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8
I20260928 14:50:21.806816 9814 raft_consensus.cc:2258] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.807210 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 deleted and replaced by tablet f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:21.807081 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5acbe80699db42c9a3d1d00365be633d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.807399 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b47d891c9264a03ac11f50f2b56edad from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:21.807446 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 with delete_type TABLET_DATA_DELETED (replaced by tablet f05131db52e94d7c9f4856b0455246d2) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:21.807581 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5acbe80699db42c9a3d1d00365be633d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.808511 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:21.808879 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce25abb4559241f58054f27435fd6078 consensus state has no leader
I20260928 14:50:21.808727 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.809599 9851 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.809664 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 with delete_type TABLET_DATA_DELETED (replaced by tablet f05131db52e94d7c9f4856b0455246d2) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.809754 9851 ts_tablet_manager.cc:1397] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.001s
I20260928 14:50:21.809849 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.810149 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:21.810547 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 0e661ac0a85949a280d837ee0357eea7 deleted and replaced by tablet d8c20a70834344c7937f96ab5fae2049
I20260928 14:50:21.810477 9851 raft_consensus.cc:348] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.810756 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.810887 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.811298 9814 ts_tablet_manager.cc:1905] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.811563 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.810765 9851 raft_consensus.cc:374] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.814234 9851 raft_consensus.cc:729] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.814502 9851 consensus_queue.cc:260] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.815770 9851 ts_tablet_manager.cc:1428] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:21.816058 9851 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:21.816169 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed0d79a39b2543049506422432990617 consensus state has no leader
I20260928 14:50:21.816439 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.791025 9909 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 FOLLOWER]: Replica starting. Triggering 7 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:21.818735 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.820504 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_30bb2a03ceff45e0b56a5fd71a36a327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.820815 9851 tablet_bootstrap.cc:654] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:21.821100 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30bb2a03ceff45e0b56a5fd71a36a327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:21.822330 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8193754d28d34c18bfc38ae0abd05f4c consensus state has no leader
I20260928 14:50:21.825192 9814 ts_tablet_manager.cc:1918] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:21.825313 9814 log.cc:1196] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/75680fd6738044759f8edeb9589f9bf4
I20260928 14:50:21.825726 9814 ts_tablet_manager.cc:1939] T 75680fd6738044759f8edeb9589f9bf4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.828533 9901 ts_tablet_manager.cc:1397] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.231s user 0.005s sys 0.015s
I20260928 14:50:21.830032 9851 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.830163 9851 ts_tablet_manager.cc:1397] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260928 14:50:21.830560 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 75680fd6738044759f8edeb9589f9bf4 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
I20260928 14:50:21.831228 9851 raft_consensus.cc:348] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.831436 9851 raft_consensus.cc:374] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.831532 9851 raft_consensus.cc:729] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.831828 9814 tablet_replica.cc:330] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.831732 9851 consensus_queue.cc:260] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.832199 9851 ts_tablet_manager.cc:1428] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:21.832504 9851 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.833590 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.834578 9851 tablet_bootstrap.cc:654] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.838724 9909 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.839471 9909 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 3.43, Last appended by leader: 43, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:21.840155 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.840485 9851 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.840667 9851 ts_tablet_manager.cc:1397] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260928 14:50:21.841384 9851 raft_consensus.cc:348] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.841650 9851 raft_consensus.cc:374] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.841722 9851 raft_consensus.cc:729] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.841923 9851 consensus_queue.cc:260] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.842355 9851 ts_tablet_manager.cc:1428] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:21.842671 9851 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.829438 9901 raft_consensus.cc:348] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.843784 9901 raft_consensus.cc:729] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.844094 9901 consensus_queue.cc:260] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.845999 9473 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:21.846167 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.846287 9909 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 14:50:21.846776 9901 ts_tablet_manager.cc:1428] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260928 14:50:21.844239 9851 tablet_bootstrap.cc:654] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.850339 9848 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:21.850473 9848 ts_tablet_manager.cc:1397] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.000s
I20260928 14:50:21.850608 9820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 3 FOLLOWER]: Advancing to term 4
I20260928 14:50:21.851159 9848 raft_consensus.cc:348] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.851349 9848 raft_consensus.cc:374] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.851459 9848 raft_consensus.cc:729] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.851811 9848 consensus_queue.cc:260] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.852514 9848 ts_tablet_manager.cc:1428] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:21.852753 9848 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:21.852805 9851 tablet_bootstrap.cc:492] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.852855 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.852929 9851 ts_tablet_manager.cc:1397] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260928 14:50:21.854640 9851 raft_consensus.cc:348] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.855048 9813 ts_tablet_manager.cc:1918] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:21.855196 9813 log.cc:1196] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d99589ea0ed0477589bd34d5acad6776
I20260928 14:50:21.855561 9813 ts_tablet_manager.cc:1939] T d99589ea0ed0477589bd34d5acad6776 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:21.855861 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 33) took 1182 ms. Trace:
I20260928 14:50:21.854849 9851 raft_consensus.cc:374] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.855964 9813 rpcz_store.cc:276] 0928 14:50:20.673826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.674148 (+ 322us) service_pool.cc:227] Handling call
0928 14:50:21.632402 (+958254us) ts_tablet_manager.cc:1145] Deleting tablet d99589ea0ed0477589bd34d5acad6776
0928 14:50:21.632410 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.835539 (+203129us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.854920 (+ 19381us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.855827 (+ 907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":923215}
I20260928 14:50:21.856143 9851 raft_consensus.cc:729] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.856366 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d99589ea0ed0477589bd34d5acad6776 (table default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:21.856341 9851 consensus_queue.cc:260] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.854470 9848 tablet_bootstrap.cc:654] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.856791 9851 ts_tablet_manager.cc:1428] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:21.857056 9851 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.857676 9813 tablet_replica.cc:330] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:21.857873 9813 raft_consensus.cc:2229] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.858009 9813 raft_consensus.cc:2258] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.858489 9813 ts_tablet_manager.cc:1905] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.861245 9851 tablet_bootstrap.cc:654] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.864064 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7b47d891c9264a03ac11f50f2b56edad
I20260928 14:50:21.865083 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.865309 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.865916 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.866106 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 with delete_type TABLET_DATA_DELETED (replaced by tablet f05131db52e94d7c9f4856b0455246d2) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.866237 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.866514 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 7b47d891c9264a03ac11f50f2b56edad deleted and replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d
I20260928 14:50:21.866724 9589 tablet_copy_service.cc:342] P 658e483a10314e8d93c2f6e9084f2a91: Request end of tablet copy session ae832871bd1142f7af10c084115ffc12-6bb86e4e2d234f7ab4de8fb8a1c6a4f8 received from {username='slave'} at 127.8.181.2:55055
I20260928 14:50:21.866991 9589 tablet_copy_service.cc:433] P 658e483a10314e8d93c2f6e9084f2a91: ending tablet copy session ae832871bd1142f7af10c084115ffc12-6bb86e4e2d234f7ab4de8fb8a1c6a4f8 on tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 with peer ae832871bd1142f7af10c084115ffc12
I20260928 14:50:21.867766 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.868690 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.870478 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.870538 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 51e28b2e855542b68e3bea8180e7f606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:21.842131 9960 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:21.870769 9960 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:21.879189 9815 ts_tablet_manager.cc:1918] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.879308 9815 log.cc:1196] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5ef1cee3a6904bc5950dbc6d4a5390ee
I20260928 14:50:21.879608 9815 ts_tablet_manager.cc:1939] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.879967 9820 pending_rounds.cc:76] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting all ops after (but not including) 37
I20260928 14:50:21.880188 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.38
I20260928 14:50:21.881034 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.39
I20260928 14:50:21.881319 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.40
I20260928 14:50:21.881508 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.41
I20260928 14:50:21.881729 9814 raft_consensus.cc:2229] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.882315 9814 raft_consensus.cc:2258] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.882886 9814 ts_tablet_manager.cc:1905] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.886314 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (table default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]) successfully deleted
I20260928 14:50:21.887099 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.42
I20260928 14:50:21.890211 9402 tablet_service.cc:1467] Processing CreateTablet for tablet f095e4cbf95147d9afb83434ae1fd29f (DEFAULT_TABLE table=default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.890646 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095e4cbf95147d9afb83434ae1fd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.891099 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc4c49a4962473699103528b64a1005 (DEFAULT_TABLE table=default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.891469 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc4c49a4962473699103528b64a1005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.894095 9265 tablet_service.cc:1467] Processing CreateTablet for tablet d004e52539cc49bc8a26f77e0bb182cc (DEFAULT_TABLE table=default.Table_7521642115684918bcca103f46abe69d [id=d3062c0f64294b23abad7e06715e1fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.894579 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d004e52539cc49bc8a26f77e0bb182cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.896420 9814 ts_tablet_manager.cc:1918] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.896552 9814 log.cc:1196] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/b50279cc5fcf43dc9ce0cafaacf93b3e
I20260928 14:50:21.896898 9814 ts_tablet_manager.cc:1939] T b50279cc5fcf43dc9ce0cafaacf93b3e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.897802 9827 raft_consensus.cc:482] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:21.897959 9827 raft_consensus.cc:504] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.898561 9827 leader_election.cc:288] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:21.899477 9360 leader_election.cc:341] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b50279cc5fcf43dc9ce0cafaacf93b3e
W20260928 14:50:21.899706 9360 leader_election.cc:341] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: b50279cc5fcf43dc9ce0cafaacf93b3e
I20260928 14:50:21.899799 9360 leader_election.cc:302] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:21.899994 9262 tablet_service.cc:1467] Processing CreateTablet for tablet f095e4cbf95147d9afb83434ae1fd29f (DEFAULT_TABLE table=default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.900146 9827 raft_consensus.cc:2726] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:21.900211 9392 tablet_service.cc:1467] Processing CreateTablet for tablet d004e52539cc49bc8a26f77e0bb182cc (DEFAULT_TABLE table=default.Table_7521642115684918bcca103f46abe69d [id=d3062c0f64294b23abad7e06715e1fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.900375 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095e4cbf95147d9afb83434ae1fd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.900565 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d004e52539cc49bc8a26f77e0bb182cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.905822 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f095e4cbf95147d9afb83434ae1fd29f (DEFAULT_TABLE table=default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.906205 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095e4cbf95147d9afb83434ae1fd29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.909482 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 53) took 1015 ms. Trace:
I20260928 14:50:21.909689 9814 rpcz_store.cc:276] 0928 14:50:20.893897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.893944 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:21.831743 (+937799us) ts_tablet_manager.cc:1145] Deleting tablet b50279cc5fcf43dc9ce0cafaacf93b3e
0928 14:50:21.831753 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.893168 (+ 61415us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.896297 (+ 3129us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:21.909414 (+ 13117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":930709}
I20260928 14:50:21.910132 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_af0f3ad2239b4d608f5059a112dd6f91 [id=3b23d10e59cb42238f2274ea2aca9a93]) successfully deleted
I20260928 14:50:21.910463 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.910710 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:21.910959 9815 tablet_replica.cc:330] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:21.911142 9815 raft_consensus.cc:2229] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.911299 9815 raft_consensus.cc:2258] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.911731 9814 tablet_replica.cc:330] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:21.911919 9814 raft_consensus.cc:2229] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:21.912014 9815 ts_tablet_manager.cc:1905] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.912071 9814 raft_consensus.cc:2258] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:21.914947 9814 ts_tablet_manager.cc:1905] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:21.917121 9543 tablet_service.cc:1467] Processing CreateTablet for tablet d004e52539cc49bc8a26f77e0bb182cc (DEFAULT_TABLE table=default.Table_7521642115684918bcca103f46abe69d [id=d3062c0f64294b23abad7e06715e1fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.917485 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d004e52539cc49bc8a26f77e0bb182cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.922983 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc4c49a4962473699103528b64a1005 (DEFAULT_TABLE table=default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.923395 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc4c49a4962473699103528b64a1005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.924640 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc4c49a4962473699103528b64a1005 (DEFAULT_TABLE table=default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:21.924995 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc4c49a4962473699103528b64a1005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:21.927325 9814 ts_tablet_manager.cc:1918] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:21.927470 9814 log.cc:1196] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/555b1577a6a1486e93e78125431ab215
I20260928 14:50:21.927879 9814 ts_tablet_manager.cc:1939] T 555b1577a6a1486e93e78125431ab215 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:21.928834 9705 raft_consensus.cc:482] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:21.928978 9705 raft_consensus.cc:504] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.929570 9705 leader_election.cc:288] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:21.930008 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51e28b2e855542b68e3bea8180e7f606" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:21.930095 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 555b1577a6a1486e93e78125431ab215 (table default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]) successfully deleted
I20260928 14:50:21.930137 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51e28b2e855542b68e3bea8180e7f606" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:21.930226 9427 raft_consensus.cc:2454] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
W20260928 14:50:21.930661 9219 leader_election.cc:341] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: Tablet not RUNNING: STOPPED
I20260928 14:50:21.930812 9219 leader_election.cc:302] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:21.930966 9820 pending_rounds.cc:97] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Aborting uncommitted WRITE_OP operation due to leader change: 3.43
I20260928 14:50:21.931171 9705 raft_consensus.cc:2781] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:21.931264 9705 raft_consensus.cc:482] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:21.931358 9705 raft_consensus.cc:3037] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:21.933797 9705 raft_consensus.cc:504] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.934403 9705 leader_election.cc:288] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:21.934566 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cd8131f32f1a4153abf2967ca0a11619 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd8131f32f1a4153abf2967ca0a11619 already in progress: creating tablet
I20260928 14:50:21.934933 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51e28b2e855542b68e3bea8180e7f606" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:21.935052 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51e28b2e855542b68e3bea8180e7f606" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:21.935227 9427 raft_consensus.cc:3037] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:21.935406 9219 leader_election.cc:341] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: Tablet not RUNNING: STOPPED
I20260928 14:50:21.937800 9427 raft_consensus.cc:2454] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:21.938210 9220 leader_election.cc:302] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:21.938462 9705 raft_consensus.cc:2781] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:21.939097 9855 tablet_bootstrap.cc:492] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.939267 9855 ts_tablet_manager.cc:1397] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.309s user 0.014s sys 0.017s
I20260928 14:50:21.940032 9855 raft_consensus.cc:348] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.940290 9855 raft_consensus.cc:374] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.940354 9855 raft_consensus.cc:729] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.940613 9855 consensus_queue.cc:260] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.941097 9855 ts_tablet_manager.cc:1428] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:21.942468 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.947520 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.949313 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 4aea5d7d3ebf4324bf438d2078d9dab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.952785 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.953702 9855 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.955175 9855 tablet_bootstrap.cc:654] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.952764 9705 raft_consensus.cc:686] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:21.956248 9705 consensus_queue.cc:237] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.958140 9855 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.958266 9855 ts_tablet_manager.cc:1397] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:21.958384 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 59) took 1008 ms. Trace:
I20260928 14:50:21.958576 9814 rpcz_store.cc:276] 0928 14:50:20.949903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.949981 (+ 78us) service_pool.cc:227] Handling call
0928 14:50:21.957401 (+1007420us) ts_tablet_manager.cc:1145] Deleting tablet 63792bb2d5b54463a701c9e4e5f095e0
0928 14:50:21.957413 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.958298 (+ 885us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1005132}
I20260928 14:50:21.958933 9855 raft_consensus.cc:348] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.959142 9855 raft_consensus.cc:374] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:21.959169 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 63792bb2d5b54463a701c9e4e5f095e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63792bb2d5b54463a701c9e4e5f095e0 already in progress: creating tablet
I20260928 14:50:21.959224 9855 raft_consensus.cc:729] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.959412 9855 consensus_queue.cc:260] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.959959 9855 ts_tablet_manager.cc:1428] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:21.960286 9855 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:21.962016 9855 tablet_bootstrap.cc:654] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.963727 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.964102 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:21.972028 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9628f53ffd00439a887e6b4f86112c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.972745 9815 ts_tablet_manager.cc:1918] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:21.972765 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9628f53ffd00439a887e6b4f86112c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.973664 9815 log.cc:1196] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/51e28b2e855542b68e3bea8180e7f606
I20260928 14:50:21.973793 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bbd24c48f3c34bc38d34edc998b1a22f" } new_table_name: "default.Table_e656ed07cfbc4f459bcd8a2986c008b7" modify_external_catalogs: true
I20260928 14:50:21.974429 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 58) took 1039 ms. Trace:
I20260928 14:50:21.974529 9851 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:21.974547 9814 rpcz_store.cc:276] 0928 14:50:20.948669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.948722 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:21.959496 (+1010774us) ts_tablet_manager.cc:1145] Deleting tablet 315c446d87c84ae4bc9cb3243dca5538
0928 14:50:21.959507 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.974353 (+ 14846us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006589}
I20260928 14:50:21.974673 9851 ts_tablet_manager.cc:1397] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.118s user 0.014s sys 0.032s
I20260928 14:50:21.975620 9851 raft_consensus.cc:348] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.975880 9851 raft_consensus.cc:374] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.975942 9851 raft_consensus.cc:729] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.976158 9851 consensus_queue.cc:260] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.977469 9851 ts_tablet_manager.cc:1428] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:21.978063 9815 ts_tablet_manager.cc:1939] T 51e28b2e855542b68e3bea8180e7f606 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:21.978463 9851 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:21.979318 9848 tablet_bootstrap.cc:492] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:21.979534 9848 ts_tablet_manager.cc:1397] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.127s user 0.003s sys 0.002s
I20260928 14:50:21.980417 9848 raft_consensus.cc:348] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.980713 9848 raft_consensus.cc:374] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.980822 9848 raft_consensus.cc:729] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.981092 9848 consensus_queue.cc:260] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.981633 9848 ts_tablet_manager.cc:1428] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:21.981974 9848 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:21.982874 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e0b8288fc9b47ce8c70dec324dfecf0 consensus state has no leader
I20260928 14:50:21.984632 9848 tablet_bootstrap.cc:654] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.985771 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.986181 9855 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:21.986330 9855 ts_tablet_manager.cc:1397] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.003s
I20260928 14:50:21.986720 9851 tablet_bootstrap.cc:654] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:21.987013 9855 raft_consensus.cc:348] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.987237 9855 raft_consensus.cc:374] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:21.987317 9855 raft_consensus.cc:729] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:21.987551 9855 consensus_queue.cc:260] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:21.989032 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:21.993495 9855 ts_tablet_manager.cc:1428] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:21.995512 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 51e28b2e855542b68e3bea8180e7f606 (table default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]) successfully deleted
W20260928 14:50:21.995791 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8218bc963a9941a49e8329d0a04d8252 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8218bc963a9941a49e8329d0a04d8252 already in progress: creating tablet
W20260928 14:50:21.996003 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9d5166a828e84d46af3112cdc7bb0a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5166a828e84d46af3112cdc7bb0a2a already in progress: creating tablet
W20260928 14:50:21.996214 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0e661ac0a85949a280d837ee0357eea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e661ac0a85949a280d837ee0357eea7 already in progress: creating tablet
I20260928 14:50:21.996826 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.996909 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_878c137d7b9a413691d0488b19f1441c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:21.997078 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet ada3738d517e4558b34826e35c74196a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:21.997427 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_878c137d7b9a413691d0488b19f1441c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:21.998472 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4d39dbabc10e4f8d812e0178e1e16815"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:21.999038 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d39dbabc10e4f8d812e0178e1e16815 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.000013 9855 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.000563 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_381accf700114544b20a817ee30e9fff" } modify_external_catalogs: true
I20260928 14:50:22.000751 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_381accf700114544b20a817ee30e9fff" } modify_external_catalogs: true
I20260928 14:50:22.000835 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad7b877efd3c4bdfb36a80026836f95f" } modify_external_catalogs: true
I20260928 14:50:22.000909 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4970c43c954a4fc4abe5155f630f6f6f" } modify_external_catalogs: true
I20260928 14:50:22.001094 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4970c43c954a4fc4abe5155f630f6f6f" } modify_external_catalogs: true
I20260928 14:50:22.001039 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad7b877efd3c4bdfb36a80026836f95f" } modify_external_catalogs: true
I20260928 14:50:22.001439 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_636fad71edff41c6a084cd4b40b2a02e" } modify_external_catalogs: true
I20260928 14:50:22.001645 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_636fad71edff41c6a084cd4b40b2a02e" } modify_external_catalogs: true
I20260928 14:50:22.002175 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad79ea2361c24f15adbaee0e9f6a72e8" } modify_external_catalogs: true
I20260928 14:50:22.002373 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad79ea2361c24f15adbaee0e9f6a72e8" } modify_external_catalogs: true
I20260928 14:50:22.002545 9855 tablet_bootstrap.cc:654] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:22.004195 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 29e865f14ddc4b0c8ce0877cd99f5972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e865f14ddc4b0c8ce0877cd99f5972 already in progress: creating tablet
I20260928 14:50:22.004540 9815 tablet_replica.cc:330] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:22.004773 9815 raft_consensus.cc:2229] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
W20260928 14:50:21.997445 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.005193 9815 raft_consensus.cc:2258] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.006201 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.007194 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet d0f099714e924a968fbd792e5f69bba4 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.008181 9815 ts_tablet_manager.cc:1905] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.008690 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e656ed07cfbc4f459bcd8a2986c008b7" } new_table_name: "default.Table_1ec91a2f8ab14f82888c9ed84ff6433a" modify_external_catalogs: true
I20260928 14:50:22.012674 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d3606a72c566496db99da926a94abb30" } new_table_name: "default.Table_d8b71be52644495e87e90d56bfd7de1e" modify_external_catalogs: true
W20260928 14:50:22.022197 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e0b8288fc9b47ce8c70dec324dfecf0 consensus state has no leader
I20260928 14:50:22.025470 9855 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:22.025624 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bad2124268994f04ae7153ea5aaeeab0 has no consensus state
I20260928 14:50:22.025686 9855 ts_tablet_manager.cc:1397] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260928 14:50:22.026679 9855 raft_consensus.cc:348] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.026942 9855 raft_consensus.cc:374] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.027093 9855 raft_consensus.cc:729] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.027201 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 51e28b2e855542b68e3bea8180e7f606 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.027393 9855 consensus_queue.cc:260] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.028167 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_934f9198bb9640cd8a19ffbd721f3d24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.028751 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_934f9198bb9640cd8a19ffbd721f3d24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.029811 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.030120 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.030620 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.030750 9855 ts_tablet_manager.cc:1428] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 14:50:22.027207 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0bce3d69ebb44782b712d1041fddb990" } new_table_name: "default.Table_02ba088a0895494998f0bacb8786b831" modify_external_catalogs: true
I20260928 14:50:22.033298 9813 ts_tablet_manager.cc:1918] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.033512 9813 log.cc:1196] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/75680fd6738044759f8edeb9589f9bf4
I20260928 14:50:22.034015 9813 ts_tablet_manager.cc:1939] T 75680fd6738044759f8edeb9589f9bf4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.033468 9855 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.034879 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 47) took 1181 ms. Trace:
I20260928 14:50:22.027802 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7e00ed21ddb54c429a68c09c19656d68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.036303 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e00ed21ddb54c429a68c09c19656d68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:22.043395 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d27738fcfbc42f298e26149dfd28182 consensus state has no leader
I20260928 14:50:22.047585 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.053212 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 03245f72e0aa496d895968d8e5715b56 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.053818 9813 rpcz_store.cc:276] 0928 14:50:20.853871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.853928 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:21.857616 (+1003688us) ts_tablet_manager.cc:1145] Deleting tablet 75680fd6738044759f8edeb9589f9bf4
0928 14:50:21.857626 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:21.954081 (+ 96455us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:22.033130 (+ 79049us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:22.034819 (+ 1689us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003487}
I20260928 14:50:22.053952 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d4695bfc77c1438196fb5f1daa0a6164"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.054371 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 75680fd6738044759f8edeb9589f9bf4 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
W20260928 14:50:22.054944 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4695bfc77c1438196fb5f1daa0a6164 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.054937 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 48) took 1190 ms. Trace:
I20260928 14:50:22.055033 9813 rpcz_store.cc:276] 0928 14:50:20.864772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.864830 (+ 58us) service_pool.cc:227] Handling call
0928 14:50:22.054581 (+1189751us) ts_tablet_manager.cc:1145] Deleting tablet d0f099714e924a968fbd792e5f69bba4
0928 14:50:22.054595 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.054879 (+ 284us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189504}
I20260928 14:50:22.055874 9813 tablet_replica.cc:330] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.056125 9813 raft_consensus.cc:2229] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.056128 9815 ts_tablet_manager.cc:1918] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:22.056270 9815 log.cc:1196] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6bb86e4e2d234f7ab4de8fb8a1c6a4f8
I20260928 14:50:22.056346 9813 raft_consensus.cc:2258] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.056972 9813 ts_tablet_manager.cc:1905] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.058842 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_02ba088a0895494998f0bacb8786b831 [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 3 got 0
I20260928 14:50:22.058982 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 67) took 1065 ms. Trace:
I20260928 14:50:22.059141 9814 rpcz_store.cc:276] 0928 14:50:20.980486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.989608 (+ 9122us) service_pool.cc:227] Handling call
0928 14:50:22.041791 (+1052183us) ts_tablet_manager.cc:1145] Deleting tablet 9aeda483866146f89198e6f14456f0f2
0928 14:50:22.041805 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.045739 (+ 3934us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1047961}
I20260928 14:50:22.059665 9815 ts_tablet_manager.cc:1939] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:22.058554 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
W20260928 14:50:22.060688 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9aeda483866146f89198e6f14456f0f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeda483866146f89198e6f14456f0f2 already in progress: creating tablet
I20260928 14:50:22.056886 9855 tablet_bootstrap.cc:654] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:22.061095 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 17d7539290064c2c9fda29a5f16d375b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d7539290064c2c9fda29a5f16d375b already in progress: creating tablet
W20260928 14:50:22.061416 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e0ee1e19142b402f96056c387140b5ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0ee1e19142b402f96056c387140b5ca already in progress: creating tablet
W20260928 14:50:22.061800 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9d6dc266ab8248d381e4850179455795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6dc266ab8248d381e4850179455795 already in progress: creating tablet
I20260928 14:50:22.054468 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5f9bb7f55d034226b7fcbb9bb19651aa" } new_table_name: "default.Table_5933bd9ddd9d49e79e0c351ae30d030e" modify_external_catalogs: true
I20260928 14:50:22.062377 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.063277 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 63792bb2d5b54463a701c9e4e5f095e0 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.064148 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c98a8c2519314eb2a4007165e1132926"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.065596 9855 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:22.065842 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c98a8c2519314eb2a4007165e1132926 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.066597 9392 tablet_service.cc:1467] Processing CreateTablet for tablet c9a7573c751d412aa8394d6277c28b7f (DEFAULT_TABLE table=default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.067045 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9a7573c751d412aa8394d6277c28b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.068819 9855 ts_tablet_manager.cc:1397] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.004s
I20260928 14:50:22.069844 9815 tablet_replica.cc:330] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:22.071301 9815 raft_consensus.cc:2229] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.071496 9815 raft_consensus.cc:2258] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.071786 9538 tablet_service.cc:1467] Processing CreateTablet for tablet c9a7573c751d412aa8394d6277c28b7f (DEFAULT_TABLE table=default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.072189 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9a7573c751d412aa8394d6277c28b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.072136 9265 tablet_service.cc:1467] Processing CreateTablet for tablet c9a7573c751d412aa8394d6277c28b7f (DEFAULT_TABLE table=default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.072388 9855 raft_consensus.cc:348] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.072557 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9a7573c751d412aa8394d6277c28b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.073263 9855 raft_consensus.cc:374] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.073509 9855 raft_consensus.cc:729] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.079059 9851 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.079205 9851 ts_tablet_manager.cc:1397] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.101s user 0.049s sys 0.022s
I20260928 14:50:22.079281 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cf2dd699271542bd9b9604e746686c53
I20260928 14:50:22.079555 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5a64ffa786f045b480efe51eb69d7074
I20260928 14:50:22.080124 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 03245f72e0aa496d895968d8e5715b56
I20260928 14:50:22.080241 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.080488 8950 catalog_manager.cc:6565] ReplaceTablet: tablet 03245f72e0aa496d895968d8e5715b56 deleted and replaced by tablet 254ab608221e4fe2bc459f9d6fee925a
I20260928 14:50:22.080739 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.080798 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.081635 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 (table default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]) successfully deleted
I20260928 14:50:22.081446 9851 raft_consensus.cc:348] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.081928 9851 raft_consensus.cc:374] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:22.082017 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 47ff819255f74f49a1ce0b5588aa03a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ff819255f74f49a1ce0b5588aa03a1 already in progress: creating tablet
I20260928 14:50:22.082042 9851 raft_consensus.cc:729] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:22.082296 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7b47d891c9264a03ac11f50f2b56edad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b47d891c9264a03ac11f50f2b56edad already in progress: creating tablet
W20260928 14:50:22.082368 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8700d651fd7144bd9ecc15cfedcfb434 consensus state has no leader
I20260928 14:50:22.082391 9851 consensus_queue.cc:260] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.082515 9855 consensus_queue.cc:260] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.081902 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8404ce5ed5f045669de5e3f460d848bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.083041 9851 ts_tablet_manager.cc:1428] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
W20260928 14:50:22.083215 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8404ce5ed5f045669de5e3f460d848bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.083333 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.083535 9815 ts_tablet_manager.cc:1905] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.083554 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.084602 9851 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.086134 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_02ba088a0895494998f0bacb8786b831 [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 3 got 0
I20260928 14:50:22.086341 9851 tablet_bootstrap.cc:654] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.089023 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_02ba088a0895494998f0bacb8786b831 [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 3 got 0
I20260928 14:50:22.091292 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet def872f66b2541b9af6084e93d991ec2
I20260928 14:50:22.092310 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.094439 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.094986 9821 raft_consensus.cc:482] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.095146 9821 raft_consensus.cc:504] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.095355 9814 tablet_replica.cc:330] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:22.095952 9821 leader_election.cc:288] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:22.096033 9814 raft_consensus.cc:2229] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.096621 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.096927 9815 ts_tablet_manager.cc:1918] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.097195 9815 log.cc:1196] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4aea5d7d3ebf4324bf438d2078d9dab1
I20260928 14:50:22.097249 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:22.098089 9498 leader_election.cc:341] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:22.098845 9497 leader_election.cc:341] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.098999 9815 ts_tablet_manager.cc:1939] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:22.099045 9497 leader_election.cc:302] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.099515 9821 raft_consensus.cc:2726] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:22.100533 9815 tablet_replica.cc:330] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:22.101344 9815 raft_consensus.cc:2229] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.101786 9815 raft_consensus.cc:2258] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.102630 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.103170 9815 ts_tablet_manager.cc:1905] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.103772 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:22.104801 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9b998502f90a4df08b4078f833ad8c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b998502f90a4df08b4078f833ad8c05 already in progress: creating tablet
W20260928 14:50:22.105039 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 964985f048114f53ba1e685c7f1dbd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 964985f048114f53ba1e685c7f1dbd6d already in progress: creating tablet
W20260928 14:50:22.105293 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 051b7f0b1d0f4f638f3e7a69a027196e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 051b7f0b1d0f4f638f3e7a69a027196e already in progress: creating tablet
I20260928 14:50:22.105396 9855 ts_tablet_manager.cc:1428] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260928 14:50:22.106948 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 6891077c78ef4f3d84e33283096ddf7a (DEFAULT_TABLE table=default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.107388 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6891077c78ef4f3d84e33283096ddf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.107445 9855 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.108239 9402 tablet_service.cc:1467] Processing CreateTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.108713 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3dee7ff6d5544908cdd9dbd45ce521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.110570 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:22.110791 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
W20260928 14:50:22.111868 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 62283.3us
I20260928 14:50:22.112237 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 4bd612753b914a079ccf89249b073018 (DEFAULT_TABLE table=default.Table_6153a2da670a4ced9fcc45cb16cdb91e [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.112874 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bd612753b914a079ccf89249b073018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.114780 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:22.115478 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.117499 9855 tablet_bootstrap.cc:654] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.120728 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.120967 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.121119 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.121248 9814 raft_consensus.cc:2258] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.121852 9814 ts_tablet_manager.cc:1905] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.122082 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:22.122679 9855 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.122802 9855 ts_tablet_manager.cc:1397] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260928 14:50:22.123382 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.124440 9855 raft_consensus.cc:348] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.125079 9848 tablet_bootstrap.cc:492] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.125229 9848 ts_tablet_manager.cc:1397] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.143s user 0.003s sys 0.000s
I20260928 14:50:22.125582 9855 raft_consensus.cc:374] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.125835 9855 raft_consensus.cc:729] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.126399 9851 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.126796 9851 ts_tablet_manager.cc:1397] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.001s
I20260928 14:50:22.126996 9855 consensus_queue.cc:260] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.127616 9851 raft_consensus.cc:348] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.127882 9851 raft_consensus.cc:374] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.127987 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.128003 9851 raft_consensus.cc:729] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.128289 9851 consensus_queue.cc:260] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.128839 9851 ts_tablet_manager.cc:1428] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:22.129139 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.129194 9851 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.130394 9402 tablet_service.cc:1467] Processing CreateTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (DEFAULT_TABLE table=default.Table_afef2b8c01784afca888d12fea0bb492 [id=653bfb0f2b28414e968985203ce7a611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.130807 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.131254 9848 raft_consensus.cc:348] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.131525 9848 raft_consensus.cc:374] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.131649 9848 raft_consensus.cc:729] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.131690 9393 tablet_service.cc:1467] Processing CreateTablet for tablet bad2124268994f04ae7153ea5aaeeab0 (DEFAULT_TABLE table=default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.132059 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad2124268994f04ae7153ea5aaeeab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.131906 9848 consensus_queue.cc:260] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.132380 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.134300 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.135391 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.136160 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.136185 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (table default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]) successfully deleted
I20260928 14:50:22.136664 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311e4286b2a943ee924ac1c25dc9ca46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.137357 9851 tablet_bootstrap.cc:654] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.137766 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 6891077c78ef4f3d84e33283096ddf7a (DEFAULT_TABLE table=default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.138170 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6891077c78ef4f3d84e33283096ddf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.140393 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:22.140579 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.142431 9815 ts_tablet_manager.cc:1918] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.142696 9815 log.cc:1196] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:22.143328 9815 ts_tablet_manager.cc:1939] T d0f099714e924a968fbd792e5f69bba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:22.145821 9391 tablet_service.cc:1467] Processing CreateTablet for tablet d8c20a70834344c7937f96ab5fae2049 (DEFAULT_TABLE table=default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.146306 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c20a70834344c7937f96ab5fae2049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.147538 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 6891077c78ef4f3d84e33283096ddf7a (DEFAULT_TABLE table=default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.147975 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6891077c78ef4f3d84e33283096ddf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.148522 9855 ts_tablet_manager.cc:1428] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260928 14:50:22.149349 9851 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.149616 9851 ts_tablet_manager.cc:1397] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260928 14:50:22.150552 9851 raft_consensus.cc:348] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.150797 9851 raft_consensus.cc:374] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.150965 9851 raft_consensus.cc:729] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.151088 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.151189 9851 consensus_queue.cc:260] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.154780 9855 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.156895 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.158849 9851 ts_tablet_manager.cc:1428] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:22.159042 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.159435 9851 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.160171 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.169168 9855 tablet_bootstrap.cc:654] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.169689 9848 ts_tablet_manager.cc:1428] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:22.170238 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.171077 9264 tablet_service.cc:1467] Processing CreateTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.171589 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3dee7ff6d5544908cdd9dbd45ce521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.172026 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 4bd612753b914a079ccf89249b073018 (DEFAULT_TABLE table=default.Table_6153a2da670a4ced9fcc45cb16cdb91e [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.172369 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bd612753b914a079ccf89249b073018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.171101 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.182869 9848 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.186108 9848 tablet_bootstrap.cc:654] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.189144 9855 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.189316 9855 ts_tablet_manager.cc:1397] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
W20260928 14:50:22.189641 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 70728.6us
I20260928 14:50:22.190071 9855 raft_consensus.cc:348] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.190338 9855 raft_consensus.cc:374] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.190430 9855 raft_consensus.cc:729] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.190696 9855 consensus_queue.cc:260] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.191399 9855 ts_tablet_manager.cc:1428] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:22.191917 9855 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.191627 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.195555 9814 ts_tablet_manager.cc:1918] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.195698 9814 log.cc:1196] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5ef1cee3a6904bc5950dbc6d4a5390ee
I20260928 14:50:22.197324 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.197628 9267 tablet_service.cc:1467] Processing CreateTablet for tablet bad2124268994f04ae7153ea5aaeeab0 (DEFAULT_TABLE table=default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.197826 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 4bd612753b914a079ccf89249b073018 (DEFAULT_TABLE table=default.Table_6153a2da670a4ced9fcc45cb16cdb91e [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.198069 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad2124268994f04ae7153ea5aaeeab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.198410 9255 tablet_service.cc:1467] Processing CreateTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (DEFAULT_TABLE table=default.Table_afef2b8c01784afca888d12fea0bb492 [id=653bfb0f2b28414e968985203ce7a611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.198719 9851 tablet_bootstrap.cc:654] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.198772 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.199975 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.200335 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3dee7ff6d5544908cdd9dbd45ce521a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.198870 9855 tablet_bootstrap.cc:654] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.201813 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.202175 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311e4286b2a943ee924ac1c25dc9ca46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.203214 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d6dc266ab8248d381e4850179455795 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.203570 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet b04e1f1977af4af8aed072bbd77e6f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.203994 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d0f099714e924a968fbd792e5f69bba4 (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
W20260928 14:50:22.204331 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cf2dd699271542bd9b9604e746686c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2dd699271542bd9b9604e746686c53 already in progress: creating tablet
W20260928 14:50:22.204721 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5a64ffa786f045b480efe51eb69d7074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a64ffa786f045b480efe51eb69d7074 already in progress: creating tablet
W20260928 14:50:22.204988 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 03245f72e0aa496d895968d8e5715b56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03245f72e0aa496d895968d8e5715b56 already in progress: creating tablet
W20260928 14:50:22.205459 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet def872f66b2541b9af6084e93d991ec2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet def872f66b2541b9af6084e93d991ec2 already in progress: creating tablet
I20260928 14:50:22.205825 9256 tablet_service.cc:1467] Processing CreateTablet for tablet d8c20a70834344c7937f96ab5fae2049 (DEFAULT_TABLE table=default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.206189 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c20a70834344c7937f96ab5fae2049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.208719 9404 tablet_service.cc:1467] Processing CreateTablet for tablet f05131db52e94d7c9f4856b0455246d2 (DEFAULT_TABLE table=default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.209259 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05131db52e94d7c9f4856b0455246d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.209954 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 727cb249723946578bc5bb086d6e6c40 (DEFAULT_TABLE table=default.Table_baeb1f09aaeb41198d89478f8ff2b440 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.209887 9960 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:22.210180 9960 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:22.210405 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727cb249723946578bc5bb086d6e6c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.212845 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bd612753b914a079ccf89249b073018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.214953 9976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:22.215205 9851 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.215266 9976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:22.215356 9851 ts_tablet_manager.cc:1397] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.002s
I20260928 14:50:22.215770 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_09b3fe6038b848ba945df814e1a6c8bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.216342 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09b3fe6038b848ba945df814e1a6c8bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.216121 9851 raft_consensus.cc:348] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.216926 9851 raft_consensus.cc:374] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.217034 9851 raft_consensus.cc:729] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.217288 9851 consensus_queue.cc:260] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.217602 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3162055572e84dbe8f62a9ed44e21062"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.218080 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3162055572e84dbe8f62a9ed44e21062 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.218194 9851 ts_tablet_manager.cc:1428] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:22.218477 9851 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.221222 9851 tablet_bootstrap.cc:654] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.222832 9814 ts_tablet_manager.cc:1939] T 5ef1cee3a6904bc5950dbc6d4a5390ee P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:22.223115 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.223682 9259 tablet_service.cc:1467] Processing CreateTablet for tablet f05131db52e94d7c9f4856b0455246d2 (DEFAULT_TABLE table=default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.223923 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (table default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]) successfully deleted
I20260928 14:50:22.224054 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05131db52e94d7c9f4856b0455246d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.224599 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.224915 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_17561d3b320f424e9824ecfff9d5d407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.225747 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17561d3b320f424e9824ecfff9d5d407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.225782 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 727cb249723946578bc5bb086d6e6c40 (DEFAULT_TABLE table=default.Table_baeb1f09aaeb41198d89478f8ff2b440 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.226110 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727cb249723946578bc5bb086d6e6c40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.227248 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 47ff819255f74f49a1ce0b5588aa03a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ff819255f74f49a1ce0b5588aa03a1 already in progress: creating tablet
W20260928 14:50:22.227856 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8218bc963a9941a49e8329d0a04d8252 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8218bc963a9941a49e8329d0a04d8252 already in progress: creating tablet
W20260928 14:50:22.228438 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 29e865f14ddc4b0c8ce0877cd99f5972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e865f14ddc4b0c8ce0877cd99f5972 already in progress: creating tablet
W20260928 14:50:22.228992 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9d5166a828e84d46af3112cdc7bb0a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5166a828e84d46af3112cdc7bb0a2a already in progress: creating tablet
I20260928 14:50:22.229271 9814 tablet_replica.cc:330] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:22.229475 9814 raft_consensus.cc:2229] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.229691 9814 raft_consensus.cc:2258] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.229878 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 999aa56f1683464d9612a2ddbfbebbda (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.230296 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999aa56f1683464d9612a2ddbfbebbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.230397 9814 ts_tablet_manager.cc:1905] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:22.230834 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ce25abb4559241f58054f27435fd6078 (table default.Table_ab8b665217b04cf7a742ad3a5bda5573 [id=a95034bdd2ac4f5e9a36e1e16b407355], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce25abb4559241f58054f27435fd6078 consensus state has no leader
I20260928 14:50:22.235869 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.236317 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.237286 9548 tablet_service.cc:1467] Processing CreateTablet for tablet f05131db52e94d7c9f4856b0455246d2 (DEFAULT_TABLE table=default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.237504 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_69d4bcddf3d0495abf820675c110ce8c" } new_table_name: "default.Table_0628bbb0b50640ff9da42eef50691d9d" modify_external_catalogs: true
I20260928 14:50:22.237689 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05131db52e94d7c9f4856b0455246d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.238519 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2d202dfea9be4834a2afc521a5a1e956" } new_table_name: "default.Table_67666bc5e90b44aab3b47c6d130d117f" modify_external_catalogs: true
I20260928 14:50:22.238776 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f00db4ef6925410f9db9f1a923d2bfeb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.239284 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f00db4ef6925410f9db9f1a923d2bfeb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.240358 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b9d8335cd947458faef12d2ca76b6861" } new_table_name: "default.Table_25782fe77ad24ccfa43739f42a1a305c" modify_external_catalogs: true
I20260928 14:50:22.241565 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.241552 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.241437 9544 tablet_service.cc:1467] Processing CreateTablet for tablet d8c20a70834344c7937f96ab5fae2049 (DEFAULT_TABLE table=default.Table_b9d8335cd947458faef12d2ca76b6861 [id=c90173a37f6f4615a34f85216ec6d750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.242055 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c20a70834344c7937f96ab5fae2049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.242015 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.244287 9540 tablet_service.cc:1467] Processing CreateTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (DEFAULT_TABLE table=default.Table_afef2b8c01784afca888d12fea0bb492 [id=653bfb0f2b28414e968985203ce7a611]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.244459 9539 tablet_service.cc:1467] Processing CreateTablet for tablet bad2124268994f04ae7153ea5aaeeab0 (DEFAULT_TABLE table=default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.251559 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 727cb249723946578bc5bb086d6e6c40 (DEFAULT_TABLE table=default.Table_baeb1f09aaeb41198d89478f8ff2b440 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.251784 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd70cf6ee2d343878c90ae4818f1eb8f consensus state has no leader
I20260928 14:50:22.252055 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 999aa56f1683464d9612a2ddbfbebbda (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.252221 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8193754d28d34c18bfc38ae0abd05f4c consensus state has no leader
I20260928 14:50:22.252362 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311e4286b2a943ee924ac1c25dc9ca46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.253618 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999aa56f1683464d9612a2ddbfbebbda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.254365 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8c20a70834344c7937f96ab5fae2049 consensus state has no leader
I20260928 14:50:22.254724 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.255858 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bd54e79c005f430e9bd80ab3f1cdc376" } new_table_name: "default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b" modify_external_catalogs: true
I20260928 14:50:22.256052 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_73d808de82b24ab8a73d4186ddb7ea40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.257156 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_095d6dc7887348e1ab7bcb8be6278f3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.258834 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f095e4cbf95147d9afb83434ae1fd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f095e4cbf95147d9afb83434ae1fd29f already in progress: creating tablet
W20260928 14:50:22.259464 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_095d6dc7887348e1ab7bcb8be6278f3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:22.260605 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d808de82b24ab8a73d4186ddb7ea40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.261472 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad2124268994f04ae7153ea5aaeeab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.262262 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727cb249723946578bc5bb086d6e6c40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.262352 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89959226fd6247d4b89c54cc6ef4ede6 consensus state has no leader
I20260928 14:50:22.264557 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 999aa56f1683464d9612a2ddbfbebbda (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.265136 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999aa56f1683464d9612a2ddbfbebbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.267298 9995 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 14:50:22.273006 9851 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.273316 9851 ts_tablet_manager.cc:1397] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.005s
I20260928 14:50:22.274179 9851 raft_consensus.cc:348] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.274674 9851 raft_consensus.cc:374] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.274857 9851 raft_consensus.cc:729] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.275151 9851 consensus_queue.cc:260] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.275768 9851 ts_tablet_manager.cc:1428] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:22.276384 9851 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.278180 9851 tablet_bootstrap.cc:654] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.280486 9988 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:22.280931 9988 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:22.281351 9814 ts_tablet_manager.cc:1918] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:22.281746 9814 log.cc:1196] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6bb86e4e2d234f7ab4de8fb8a1c6a4f8
I20260928 14:50:22.281802 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.282236 9814 ts_tablet_manager.cc:1939] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:22.282464 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f05131db52e94d7c9f4856b0455246d2 because the tablet was not found. No further retry: Not found: Tablet not found: f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:22.283129 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9141134a84af4e0e83ec4d03d5b91f65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.283700 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9141134a84af4e0e83ec4d03d5b91f65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.284010 9848 tablet_bootstrap.cc:492] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.284222 9848 ts_tablet_manager.cc:1397] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.101s user 0.000s sys 0.004s
I20260928 14:50:22.285063 9848 raft_consensus.cc:348] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.285344 9848 raft_consensus.cc:374] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.285444 9848 raft_consensus.cc:729] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.282806 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (DEFAULT_TABLE table=default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.287642 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.287909 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:22.288663 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0e661ac0a85949a280d837ee0357eea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e661ac0a85949a280d837ee0357eea7 already in progress: creating tablet
I20260928 14:50:22.289073 9814 tablet_replica.cc:330] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:22.289299 9814 raft_consensus.cc:2229] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.289464 9814 raft_consensus.cc:2258] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.290095 9814 ts_tablet_manager.cc:1905] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.283073 9332 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.297465 9821 raft_consensus.cc:482] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.297724 9821 raft_consensus.cc:504] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.299111 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.299998 9821 leader_election.cc:288] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:22.300175 9498 leader_election.cc:341] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.309738 9848 consensus_queue.cc:260] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.310348 9848 ts_tablet_manager.cc:1428] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20260928 14:50:22.310429 9473 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.310670 9848 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.310998 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7521642115684918bcca103f46abe69d" } new_table_name: "default.Table_c3faaac521464670a4b981a20d62e237" modify_external_catalogs: true
I20260928 14:50:22.311632 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5ac0707793ba4f36a82ff882fe74ebf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.312208 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ac0707793ba4f36a82ff882fe74ebf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.312342 9848 tablet_bootstrap.cc:654] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.315264 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:22.318487 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 066df778654449bda96f68b5035c4d73 (DEFAULT_TABLE table=default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.318873 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 066df778654449bda96f68b5035c4d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.321000 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 57e56077833e41dbacf54c1757ba6a38 (DEFAULT_TABLE table=default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.321805 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e56077833e41dbacf54c1757ba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.322772 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.322872 9388 tablet_service.cc:1467] Processing CreateTablet for tablet d61eb0b79a424ec5a4cbbe83cfb540df (DEFAULT_TABLE table=default.Table_9628f53ffd00439a887e6b4f86112c13 [id=fbd5774946e94346a6a1bd16b7250240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.323210 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61eb0b79a424ec5a4cbbe83cfb540df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.323374 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 6a828130854b4e4e8c44b2b45260e50e (DEFAULT_TABLE table=default.Table_d4695bfc77c1438196fb5f1daa0a6164 [id=135455fa96ab4b05ae173bd269ba5269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.323906 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a828130854b4e4e8c44b2b45260e50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.324270 9401 tablet_service.cc:1467] Processing CreateTablet for tablet d27a357d905e463ba9507f74e575acb1 (DEFAULT_TABLE table=default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16 [id=64aa6ea04e1749faaa914cd83971de41]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.324656 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d004e52539cc49bc8a26f77e0bb182cc consensus state has no leader
I20260928 14:50:22.324707 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d27a357d905e463ba9507f74e575acb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.325606 9827 raft_consensus.cc:482] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.325770 9827 raft_consensus.cc:504] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.326515 9827 leader_election.cc:288] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.327867 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 254ab608221e4fe2bc459f9d6fee925a (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.328377 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254ab608221e4fe2bc459f9d6fee925a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.329793 9389 tablet_service.cc:1467] Processing CreateTablet for tablet c85735981779438197f2c0f489681b96 (DEFAULT_TABLE table=default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.330135 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85735981779438197f2c0f489681b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.331540 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b97883acb4adfa4091653545e894b (DEFAULT_TABLE table=default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.331959 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b97883acb4adfa4091653545e894b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.332281 9815 tablet_replica.cc:330] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:22.332617 9815 raft_consensus.cc:2229] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.333477 9390 tablet_service.cc:1467] Processing CreateTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 (DEFAULT_TABLE table=default.Table_4d39dbabc10e4f8d812e0178e1e16815 [id=9ef3939e8d864755819b15d57ed3b443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.333812 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd24e60a0e944f6086ff9c9fbe2e8180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.334105 9815 raft_consensus.cc:2258] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.321471 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_413d0798da2e4456aa361e47f8f118d0" } modify_external_catalogs: true
I20260928 14:50:22.335521 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_413d0798da2e4456aa361e47f8f118d0" } modify_external_catalogs: true
I20260928 14:50:22.338200 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b" } modify_external_catalogs: true
I20260928 14:50:22.338629 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b" } modify_external_catalogs: true
I20260928 14:50:22.339076 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 6a828130854b4e4e8c44b2b45260e50e (DEFAULT_TABLE table=default.Table_d4695bfc77c1438196fb5f1daa0a6164 [id=135455fa96ab4b05ae173bd269ba5269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.339450 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a828130854b4e4e8c44b2b45260e50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.346292 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_67666bc5e90b44aab3b47c6d130d117f" } modify_external_catalogs: true
I20260928 14:50:22.346356 9815 ts_tablet_manager.cc:1905] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.347347 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 066df778654449bda96f68b5035c4d73 (DEFAULT_TABLE table=default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.347812 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 066df778654449bda96f68b5035c4d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.348243 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef1cee3a6904bc5950dbc6d4a5390ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.348410 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_67666bc5e90b44aab3b47c6d130d117f" } modify_external_catalogs: true
I20260928 14:50:22.349116 9393 tablet_service.cc:1467] Processing CreateTablet for tablet f3ac8adb23c5478fadb6cb6765459913 (DEFAULT_TABLE table=default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.344697 9545 tablet_service.cc:1467] Processing CreateTablet for tablet f3ac8adb23c5478fadb6cb6765459913 (DEFAULT_TABLE table=default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.351562 9793 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ae832871bd1142f7af10c084115ffc12" instance_seqno: 1790607017847513) as {username='slave'} at 127.8.181.2:47041; Asking this server to re-register.
I20260928 14:50:22.353207 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3ac8adb23c5478fadb6cb6765459913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.354110 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 57e56077833e41dbacf54c1757ba6a38 (DEFAULT_TABLE table=default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.359177 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e56077833e41dbacf54c1757ba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.359109 9534 tablet_service.cc:1467] Processing CreateTablet for tablet d61eb0b79a424ec5a4cbbe83cfb540df (DEFAULT_TABLE table=default.Table_9628f53ffd00439a887e6b4f86112c13 [id=fbd5774946e94346a6a1bd16b7250240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.353048 9533 tablet_service.cc:1467] Processing CreateTablet for tablet d27a357d905e463ba9507f74e575acb1 (DEFAULT_TABLE table=default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16 [id=64aa6ea04e1749faaa914cd83971de41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.365134 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d27a357d905e463ba9507f74e575acb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.362339 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (DEFAULT_TABLE table=default.Table_934f9198bb9640cd8a19ffbd721f3d24 [id=a8a5b906c0934e02abaf935134c22c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.365944 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 254ab608221e4fe2bc459f9d6fee925a (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.364699 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b97883acb4adfa4091653545e894b (DEFAULT_TABLE table=default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.374960 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:22.378834 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:22.380041 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8948e45987b94ca69004c42e224ce93f
I20260928 14:50:22.387295 9549 tablet_service.cc:1467] Processing CreateTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 (DEFAULT_TABLE table=default.Table_5ac0707793ba4f36a82ff882fe74ebf9 [id=8fe8d4808cbe43a3ad3d3f217582b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.390519 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 9648be4c626e44e0986c196704483955 (DEFAULT_TABLE table=default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.393558 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.397883 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2b819b194d4373a59a3e94267361c1 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.399900 9531 tablet_service.cc:1467] Processing CreateTablet for tablet c85735981779438197f2c0f489681b96 (DEFAULT_TABLE table=default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.400489 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e3bb5d92feef4555b3d91bc699b0fedd" } modify_external_catalogs: true
I20260928 14:50:22.400597 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 88015bcd867e40e5b9263930e820074a (DEFAULT_TABLE table=default.Table_3162055572e84dbe8f62a9ed44e21062 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.400728 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e3bb5d92feef4555b3d91bc699b0fedd" } modify_external_catalogs: true
I20260928 14:50:22.401234 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61eb0b79a424ec5a4cbbe83cfb540df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.401757 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d8b71be52644495e87e90d56bfd7de1e" } modify_external_catalogs: true
I20260928 14:50:22.401940 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d8b71be52644495e87e90d56bfd7de1e" } modify_external_catalogs: true
I20260928 14:50:22.404458 9855 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.405377 9855 ts_tablet_manager.cc:1397] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.213s user 0.014s sys 0.015s
I20260928 14:50:22.409385 9263 tablet_service.cc:1467] Processing CreateTablet for tablet c85735981779438197f2c0f489681b96 (DEFAULT_TABLE table=default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.409890 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:22.410388 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 9648be4c626e44e0986c196704483955 (DEFAULT_TABLE table=default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.411147 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3ac8adb23c5478fadb6cb6765459913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.408039 9529 tablet_service.cc:1467] Processing CreateTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 (DEFAULT_TABLE table=default.Table_4d39dbabc10e4f8d812e0178e1e16815 [id=9ef3939e8d864755819b15d57ed3b443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.412779 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:22.414201 9473 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:22.414638 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ea5cc25a78624d7b99527b5433bd32e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.415344 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea5cc25a78624d7b99527b5433bd32e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.415792 9848 tablet_bootstrap.cc:492] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.415934 9848 ts_tablet_manager.cc:1397] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.001s
I20260928 14:50:22.417093 9848 raft_consensus.cc:348] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.417310 9848 raft_consensus.cc:374] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.417685 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_38a7426d79f54a28be2cc6abd2f3c923"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.418195 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38a7426d79f54a28be2cc6abd2f3c923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.418193 9848 raft_consensus.cc:729] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.418408 9848 consensus_queue.cc:260] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.419390 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5c040fa6ba4e2785959874a3346bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.422592 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aea5d7d3ebf4324bf438d2078d9dab1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:22.422993 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.423336 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 091600d56fdc469d8b754acd8933808b (DEFAULT_TABLE table=default.Table_09b3fe6038b848ba945df814e1a6c8bf [id=52b5f678a6ee42beab450c26e91f92da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.423897 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8db468ad3c4bba8c701c3d8feba9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.424084 9793 ts_manager.cc:194] Registered new tserver with Master: ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:22.424495 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 88015bcd867e40e5b9263930e820074a (DEFAULT_TABLE table=default.Table_3162055572e84dbe8f62a9ed44e21062 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.424674 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b97883acb4adfa4091653545e894b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.425227 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.426788 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9648be4c626e44e0986c196704483955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.428568 9848 ts_tablet_manager.cc:1428] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260928 14:50:22.432614 9262 tablet_service.cc:1467] Processing CreateTablet for tablet d61eb0b79a424ec5a4cbbe83cfb540df (DEFAULT_TABLE table=default.Table_9628f53ffd00439a887e6b4f86112c13 [id=fbd5774946e94346a6a1bd16b7250240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.440652 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.441838 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091600d56fdc469d8b754acd8933808b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.444509 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254ab608221e4fe2bc459f9d6fee925a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.446064 9793 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" instance_seqno: 1790607017382411) as {username='slave'} at 127.8.181.1:48493; Asking this server to re-register.
I20260928 14:50:22.446610 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.446913 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.447026 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.447357 9543 tablet_service.cc:1467] Processing CreateTablet for tablet b65fd0746d1b474e9fbebe6f09053743 (DEFAULT_TABLE table=default.Table_73d808de82b24ab8a73d4186ddb7ea40 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.447600 9360 leader_election.cc:341] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 4aea5d7d3ebf4324bf438d2078d9dab1
W20260928 14:50:22.447762 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 84647us
I20260928 14:50:22.435505 9855 raft_consensus.cc:348] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.449333 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f39bb48fe52441c5a026c16c6230bd76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.449620 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 091600d56fdc469d8b754acd8933808b (DEFAULT_TABLE table=default.Table_09b3fe6038b848ba945df814e1a6c8bf [id=52b5f678a6ee42beab450c26e91f92da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.449644 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_577d089c2d454fed9b7ec794d9b71f43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.450194 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_577d089c2d454fed9b7ec794d9b71f43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.450511 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85735981779438197f2c0f489681b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.450881 9848 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:22.450812 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f39bb48fe52441c5a026c16c6230bd76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.449285 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (DEFAULT_TABLE table=default.Table_934f9198bb9640cd8a19ffbd721f3d24 [id=a8a5b906c0934e02abaf935134c22c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.452575 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8db468ad3c4bba8c701c3d8feba9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.453428 9404 tablet_service.cc:1467] Processing CreateTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 (DEFAULT_TABLE table=default.Table_5ac0707793ba4f36a82ff882fe74ebf9 [id=8fe8d4808cbe43a3ad3d3f217582b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.455282 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.455493 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.456250 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2b819b194d4373a59a3e94267361c1 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.456516 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb6a6cea334521b13b5ebd47fbab98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.456843 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2b819b194d4373a59a3e94267361c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.457231 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9648be4c626e44e0986c196704483955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.457504 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb6a6cea334521b13b5ebd47fbab98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.458130 9855 raft_consensus.cc:374] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.459748 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d39dbabc10e4f8d812e0178e1e16815" } new_table_name: "default.Table_c10738b4aa7a42c2a6eef90a1999483a" modify_external_catalogs: true
I20260928 14:50:22.460263 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f623bcce062e46e8814285fff7b584ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.460769 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f623bcce062e46e8814285fff7b584ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.461054 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d4695bfc77c1438196fb5f1daa0a6164" } new_table_name: "default.Table_4f67958edd6b445693683ebf4f469972" modify_external_catalogs: true
I20260928 14:50:22.461374 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_baeb1f09aaeb41198d89478f8ff2b440" } new_table_name: "default.Table_d42f6a8066b448a9aeb0d1c9ec0d9795" modify_external_catalogs: true
I20260928 14:50:22.461616 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5c040fa6ba4e2785959874a3346bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.460198 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e0f6421a3947442ea2ee9829ccece5e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.462332 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0f6421a3947442ea2ee9829ccece5e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.465513 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (DEFAULT_TABLE table=default.Table_17561d3b320f424e9824ecfff9d5d407 [id=8068756e5cb44215af3614c6e7a9a357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.467495 9400 tablet_service.cc:1467] Processing CreateTablet for tablet b65fd0746d1b474e9fbebe6f09053743 (DEFAULT_TABLE table=default.Table_73d808de82b24ab8a73d4186ddb7ea40 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.467808 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.470563 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88015bcd867e40e5b9263930e820074a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.471537 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_02ba088a0895494998f0bacb8786b831" } new_table_name: "default.Table_45f6644a6d6643238d8f7cf2953ecc43" modify_external_catalogs: true
I20260928 14:50:22.473624 9813 ts_tablet_manager.cc:1918] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.479979 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94ac5cd43c05479f8516fdc0c30cbf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.481622 9813 log.cc:1196] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/b50279cc5fcf43dc9ce0cafaacf93b3e
I20260928 14:50:22.489398 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65fd0746d1b474e9fbebe6f09053743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.500249 9958 mvcc.cc:205] Tried to move back new op lower bound from 7334326359624810496 to 7334326351417249792. Current Snapshot: MvccSnapshot[applied={T|T < 7334326359624810496 or (T in {7334326359624810496})}]
I20260928 14:50:22.502558 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 066df778654449bda96f68b5035c4d73 (DEFAULT_TABLE table=default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.503049 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 254ab608221e4fe2bc459f9d6fee925a (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.503093 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.503753 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 (DEFAULT_TABLE table=default.Table_5ac0707793ba4f36a82ff882fe74ebf9 [id=8fe8d4808cbe43a3ad3d3f217582b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.501677 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:22.505275 9360 leader_election.cc:341] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: Tablet not RUNNING: STOPPED
I20260928 14:50:22.505415 9360 leader_election.cc:302] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:22.506197 9851 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.422787 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b97883acb4adfa4091653545e894b (DEFAULT_TABLE table=default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.506887 9253 tablet_service.cc:1467] Processing CreateTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 (DEFAULT_TABLE table=default.Table_4d39dbabc10e4f8d812e0178e1e16815 [id=9ef3939e8d864755819b15d57ed3b443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.507277 9827 raft_consensus.cc:2726] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:22.508193 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 6a828130854b4e4e8c44b2b45260e50e (DEFAULT_TABLE table=default.Table_d4695bfc77c1438196fb5f1daa0a6164 [id=135455fa96ab4b05ae173bd269ba5269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.512216 9813 ts_tablet_manager.cc:1939] T b50279cc5fcf43dc9ce0cafaacf93b3e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.513787 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (DEFAULT_TABLE table=default.Table_17561d3b320f424e9824ecfff9d5d407 [id=8068756e5cb44215af3614c6e7a9a357]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.514178 9497 leader_election.cc:341] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.514312 9497 leader_election.cc:302] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.514565 9821 raft_consensus.cc:2726] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:22.519070 9855 raft_consensus.cc:729] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.519791 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 49) took 1607 ms. Trace:
I20260928 14:50:22.520409 9257 tablet_service.cc:1467] Processing CreateTablet for tablet d27a357d905e463ba9507f74e575acb1 (DEFAULT_TABLE table=default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16 [id=64aa6ea04e1749faaa914cd83971de41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.521605 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 57e56077833e41dbacf54c1757ba6a38 (DEFAULT_TABLE table=default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.525717 9255 tablet_service.cc:1467] Processing CreateTablet for tablet f3ac8adb23c5478fadb6cb6765459913 (DEFAULT_TABLE table=default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.522657 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 88015bcd867e40e5b9263930e820074a (DEFAULT_TABLE table=default.Table_3162055572e84dbe8f62a9ed44e21062 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.526986 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c85735981779438197f2c0f489681b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.528505 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 9648be4c626e44e0986c196704483955 (DEFAULT_TABLE table=default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.529168 9705 raft_consensus.cc:482] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.529412 9705 raft_consensus.cc:504] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.531206 9705 leader_election.cc:288] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.531867 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.533766 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 3c2b819b194d4373a59a3e94267361c1 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.536207 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.531909 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.536615 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.537184 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.537472 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d27a357d905e463ba9507f74e575acb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.538457 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a828130854b4e4e8c44b2b45260e50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.539085 9814 ts_tablet_manager.cc:1918] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.539220 9814 log.cc:1196] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4aea5d7d3ebf4324bf438d2078d9dab1
I20260928 14:50:22.539649 9814 ts_tablet_manager.cc:1939] T 4aea5d7d3ebf4324bf438d2078d9dab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:22.540292 9814 tablet_replica.cc:330] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:22.540568 9814 raft_consensus.cc:2229] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:22.540861 9814 pending_rounds.cc:62] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:22.540954 9814 pending_rounds.cc:68] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326361935077376 op_type: NO_OP noop_request { }
I20260928 14:50:22.541090 9814 raft_consensus.cc:2866] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:22.541220 9814 raft_consensus.cc:2258] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.541510 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2b819b194d4373a59a3e94267361c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.541971 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.542239 9851 ts_tablet_manager.cc:1397] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.230s user 0.004s sys 0.002s
I20260928 14:50:22.543128 9851 raft_consensus.cc:348] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.543386 9851 raft_consensus.cc:374] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.543467 9851 raft_consensus.cc:729] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.543730 9851 consensus_queue.cc:260] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.541989 9813 rpcz_store.cc:276] 0928 14:50:20.905197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.905314 (+ 117us) service_pool.cc:227] Handling call
0928 14:50:22.055785 (+1150471us) ts_tablet_manager.cc:1145] Deleting tablet b50279cc5fcf43dc9ce0cafaacf93b3e
0928 14:50:22.055796 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.188292 (+132496us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:22.415635 (+227343us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:22.512564 (+ 96929us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088292}
I20260928 14:50:22.544310 9851 ts_tablet_manager.cc:1428] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:22.544582 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 53) took 1554 ms. Trace:
I20260928 14:50:22.544642 9851 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.545276 9813 rpcz_store.cc:276] 0928 14:50:20.989866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:20.989953 (+ 87us) service_pool.cc:227] Handling call
0928 14:50:22.544451 (+1554498us) ts_tablet_manager.cc:1145] Deleting tablet 555b1577a6a1486e93e78125431ab215
0928 14:50:22.544460 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.544551 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1336333}
I20260928 14:50:22.545650 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd24e60a0e944f6086ff9c9fbe2e8180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.545789 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 55) took 1496 ms. Trace:
I20260928 14:50:22.547230 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (DEFAULT_TABLE table=default.Table_934f9198bb9640cd8a19ffbd721f3d24 [id=a8a5b906c0934e02abaf935134c22c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.547559 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:22.548127 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet b50279cc5fcf43dc9ce0cafaacf93b3e (table default.Table_af0f3ad2239b4d608f5059a112dd6f91 [id=3b23d10e59cb42238f2274ea2aca9a93]) successfully deleted
I20260928 14:50:22.548050 9813 rpcz_store.cc:276] 0928 14:50:21.049742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.049953 (+ 211us) service_pool.cc:227] Handling call
0928 14:50:22.545649 (+1495696us) ts_tablet_manager.cc:1145] Deleting tablet 63792bb2d5b54463a701c9e4e5f095e0
0928 14:50:22.545659 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.545759 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":309,"tablet-delete.queue_time_us":1337385}
W20260928 14:50:22.548410 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 555b1577a6a1486e93e78125431ab215 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 555b1577a6a1486e93e78125431ab215 already in progress: creating tablet
I20260928 14:50:22.548537 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 54) took 1501 ms. Trace:
W20260928 14:50:22.548697 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 63792bb2d5b54463a701c9e4e5f095e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63792bb2d5b54463a701c9e4e5f095e0 already in progress: creating tablet
I20260928 14:50:22.548774 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1947b7d284624c22a135dab29101c45c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.549273 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1947b7d284624c22a135dab29101c45c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.549798 9248 tablet_service.cc:1467] Processing CreateTablet for tablet b65fd0746d1b474e9fbebe6f09053743 (DEFAULT_TABLE table=default.Table_73d808de82b24ab8a73d4186ddb7ea40 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.550153 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 091600d56fdc469d8b754acd8933808b (DEFAULT_TABLE table=default.Table_09b3fe6038b848ba945df814e1a6c8bf [id=52b5f678a6ee42beab450c26e91f92da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.556262 9855 consensus_queue.cc:260] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.558647 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd24e60a0e944f6086ff9c9fbe2e8180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.561203 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94ac5cd43c05479f8516fdc0c30cbf22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.565997 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d27738fcfbc42f298e26149dfd28182 consensus state has no leader
W20260928 14:50:22.566135 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a828130854b4e4e8c44b2b45260e50e consensus state has no leader
I20260928 14:50:22.567512 9848 tablet_bootstrap.cc:654] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.559674 9813 rpcz_store.cc:276] 0928 14:50:21.047466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.047573 (+ 107us) service_pool.cc:227] Handling call
0928 14:50:22.548412 (+1500839us) ts_tablet_manager.cc:1145] Deleting tablet 315c446d87c84ae4bc9cb3243dca5538
0928 14:50:22.548421 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.548507 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":268,"tablet-delete.queue_time_us":1340066}
I20260928 14:50:22.574044 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 56) took 1518 ms. Trace:
I20260928 14:50:22.574379 9813 rpcz_store.cc:276] 0928 14:50:21.050407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.050533 (+ 126us) service_pool.cc:227] Handling call
0928 14:50:22.568477 (+1517944us) ts_tablet_manager.cc:1145] Deleting tablet cd8131f32f1a4153abf2967ca0a11619
0928 14:50:22.568487 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.569296 (+ 809us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":248,"tablet-delete.queue_time_us":1360067}
W20260928 14:50:22.574854 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cd8131f32f1a4153abf2967ca0a11619 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd8131f32f1a4153abf2967ca0a11619 already in progress: creating tablet
W20260928 14:50:22.575009 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 727cb249723946578bc5bb086d6e6c40 consensus state has no leader
I20260928 14:50:22.575255 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 63) took 1487 ms. Trace:
I20260928 14:50:22.575443 9813 rpcz_store.cc:276] 0928 14:50:21.087781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.087886 (+ 105us) service_pool.cc:227] Handling call
0928 14:50:22.575128 (+1487242us) ts_tablet_manager.cc:1145] Deleting tablet 9aeda483866146f89198e6f14456f0f2
0928 14:50:22.575137 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.575226 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280959}
W20260928 14:50:22.575865 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9aeda483866146f89198e6f14456f0f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeda483866146f89198e6f14456f0f2 already in progress: creating tablet
I20260928 14:50:22.575661 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet c9a7573c751d412aa8394d6277c28b7f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.576221 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 72) took 1165 ms. Trace:
I20260928 14:50:22.580457 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8db468ad3c4bba8c701c3d8feba9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.581588 9705 raft_consensus.cc:482] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.589116 9813 rpcz_store.cc:276] 0928 14:50:21.411184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.411280 (+ 96us) service_pool.cc:227] Handling call
0928 14:50:22.576092 (+1164812us) ts_tablet_manager.cc:1145] Deleting tablet e0ee1e19142b402f96056c387140b5ca
0928 14:50:22.576101 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.576191 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153351}
W20260928 14:50:22.589627 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e0ee1e19142b402f96056c387140b5ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0ee1e19142b402f96056c387140b5ca already in progress: creating tablet
I20260928 14:50:22.590078 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 71) took 1217 ms. Trace:
I20260928 14:50:22.590693 9813 rpcz_store.cc:276] 0928 14:50:21.372271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.372404 (+ 133us) service_pool.cc:227] Handling call
0928 14:50:22.589903 (+1217499us) ts_tablet_manager.cc:1145] Deleting tablet 17d7539290064c2c9fda29a5f16d375b
0928 14:50:22.589913 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.590048 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165048}
W20260928 14:50:22.591164 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 17d7539290064c2c9fda29a5f16d375b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d7539290064c2c9fda29a5f16d375b already in progress: creating tablet
I20260928 14:50:22.591542 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 73) took 1165 ms. Trace:
I20260928 14:50:22.591706 9813 rpcz_store.cc:276] 0928 14:50:21.426274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.426355 (+ 81us) service_pool.cc:227] Handling call
0928 14:50:22.591421 (+1165066us) ts_tablet_manager.cc:1145] Deleting tablet 9d6dc266ab8248d381e4850179455795
0928 14:50:22.591430 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.591510 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159183}
W20260928 14:50:22.592278 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9d6dc266ab8248d381e4850179455795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6dc266ab8248d381e4850179455795 already in progress: creating tablet
I20260928 14:50:22.592705 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 74) took 1164 ms. Trace:
I20260928 14:50:22.592850 9813 rpcz_store.cc:276] 0928 14:50:21.427822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.427934 (+ 112us) service_pool.cc:227] Handling call
0928 14:50:22.592589 (+1164655us) ts_tablet_manager.cc:1145] Deleting tablet 9b998502f90a4df08b4078f833ad8c05
0928 14:50:22.592598 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.592677 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154956}
W20260928 14:50:22.593273 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9b998502f90a4df08b4078f833ad8c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b998502f90a4df08b4078f833ad8c05 already in progress: creating tablet
I20260928 14:50:22.593667 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 75) took 1162 ms. Trace:
I20260928 14:50:22.596110 9855 ts_tablet_manager.cc:1428] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.151s user 0.002s sys 0.001s
I20260928 14:50:22.596236 9614 heartbeater.cc:503] Master 127.8.181.60:39777 was elected leader, sending a full tablet report...
I20260928 14:50:22.596441 9855 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.596417 9813 rpcz_store.cc:276] 0928 14:50:21.430782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.430959 (+ 177us) service_pool.cc:227] Handling call
0928 14:50:22.593555 (+1162596us) ts_tablet_manager.cc:1145] Deleting tablet 051b7f0b1d0f4f638f3e7a69a027196e
0928 14:50:22.593565 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.593637 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1143993}
I20260928 14:50:22.596585 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c2b819b194d4373a59a3e94267361c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.596818 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 051b7f0b1d0f4f638f3e7a69a027196e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 051b7f0b1d0f4f638f3e7a69a027196e already in progress: creating tablet
I20260928 14:50:22.597486 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 77) took 1139 ms. Trace:
I20260928 14:50:22.597622 9813 rpcz_store.cc:276] 0928 14:50:21.458520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.459174 (+ 654us) service_pool.cc:227] Handling call
0928 14:50:22.597335 (+1138161us) ts_tablet_manager.cc:1145] Deleting tablet 964985f048114f53ba1e685c7f1dbd6d
0928 14:50:22.597344 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:22.597447 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1124350}
W20260928 14:50:22.598538 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 964985f048114f53ba1e685c7f1dbd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 964985f048114f53ba1e685c7f1dbd6d already in progress: creating tablet
I20260928 14:50:22.598733 9855 tablet_bootstrap.cc:654] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.598951 9827 raft_consensus.cc:482] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.599097 9827 raft_consensus.cc:504] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.599411 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091600d56fdc469d8b754acd8933808b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.599709 9827 leader_election.cc:288] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.600317 9813 tablet_replica.cc:330] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.600428 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.600523 9813 raft_consensus.cc:2229] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.600616 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.601188 9813 raft_consensus.cc:2258] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:22.601198 9360 leader_election.cc:341] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ada3738d517e4558b34826e35c74196a
I20260928 14:50:22.602489 9813 ts_tablet_manager.cc:1905] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.604492 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65fd0746d1b474e9fbebe6f09053743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.606957 9705 raft_consensus.cc:504] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.610757 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254ab608221e4fe2bc459f9d6fee925a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.611352 9219 leader_election.cc:341] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:22.612566 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca5c040fa6ba4e2785959874a3346bf7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.612614 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 58025.5us
I20260928 14:50:22.617146 9848 tablet_bootstrap.cc:492] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.617334 9848 ts_tablet_manager.cc:1397] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.188s user 0.009s sys 0.002s
I20260928 14:50:22.618063 9848 raft_consensus.cc:348] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.618336 9848 raft_consensus.cc:374] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.618433 9848 raft_consensus.cc:729] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.618688 9848 consensus_queue.cc:260] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.619127 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.619889 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (table default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]) successfully deleted
W20260928 14:50:22.620146 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7b47d891c9264a03ac11f50f2b56edad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b47d891c9264a03ac11f50f2b56edad already in progress: creating tablet
I20260928 14:50:22.620839 9851 tablet_bootstrap.cc:654] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.620849 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65fd0746d1b474e9fbebe6f09053743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.621341 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04e1f1977af4af8aed072bbd77e6f4c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.621603 9427 raft_consensus.cc:2454] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:22.621879 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.622859 9848 ts_tablet_manager.cc:1428] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 14:50:22.623721 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:22.623828 9705 leader_election.cc:288] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.623939 9848 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.628034 9813 ts_tablet_manager.cc:1918] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.631192 9814 ts_tablet_manager.cc:1905] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.632002 9813 log.cc:1196] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/51e28b2e855542b68e3bea8180e7f606
I20260928 14:50:22.632426 9813 ts_tablet_manager.cc:1939] T 51e28b2e855542b68e3bea8180e7f606 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.632403 9705 raft_consensus.cc:482] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.632555 9705 raft_consensus.cc:504] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.628562 9848 tablet_bootstrap.cc:654] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.633112 9220 leader_election.cc:302] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:22.634354 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 51e28b2e855542b68e3bea8180e7f606 (table default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]) successfully deleted
I20260928 14:50:22.634773 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:22.635601 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 47ff819255f74f49a1ce0b5588aa03a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ff819255f74f49a1ce0b5588aa03a1 already in progress: creating tablet
I20260928 14:50:22.635807 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.636068 9569 raft_consensus.cc:2454] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
W20260928 14:50:22.636461 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8218bc963a9941a49e8329d0a04d8252 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8218bc963a9941a49e8329d0a04d8252 already in progress: creating tablet
I20260928 14:50:22.623679 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (DEFAULT_TABLE table=default.Table_17561d3b320f424e9824ecfff9d5d407 [id=8068756e5cb44215af3614c6e7a9a357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.637246 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091600d56fdc469d8b754acd8933808b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.637620 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88015bcd867e40e5b9263930e820074a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.637720 9220 leader_election.cc:341] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:22.638036 9220 leader_election.cc:341] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.639430 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88015bcd867e40e5b9263930e820074a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.638967 9219 leader_election.cc:302] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.639115 9705 leader_election.cc:288] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:22.642081 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 29e865f14ddc4b0c8ce0877cd99f5972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e865f14ddc4b0c8ce0877cd99f5972 already in progress: creating tablet
I20260928 14:50:22.642611 9813 tablet_replica.cc:330] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.643193 9813 raft_consensus.cc:2229] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.643417 9332 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:22.643864 9813 raft_consensus.cc:2258] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.645015 9813 ts_tablet_manager.cc:1905] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.653082 9813 ts_tablet_manager.cc:1918] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:22.654542 9793 ts_manager.cc:194] Registered new tserver with Master: 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:22.649947 9705 raft_consensus.cc:2781] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.655961 9705 raft_consensus.cc:482] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.656068 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94ac5cd43c05479f8516fdc0c30cbf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.657083 9821 raft_consensus.cc:482] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.657217 9821 raft_consensus.cc:504] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.658281 9821 leader_election.cc:288] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:22.664037 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61eb0b79a424ec5a4cbbe83cfb540df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.664085 10007 raft_consensus.cc:2781] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.664201 10007 raft_consensus.cc:482] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.664311 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9648be4c626e44e0986c196704483955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.664418 9705 raft_consensus.cc:3037] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.665241 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:22.655248 9848 tablet_bootstrap.cc:492] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:22.655790 9360 leader_election.cc:341] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ada3738d517e4558b34826e35c74196a
I20260928 14:50:22.658929 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.665683 9848 ts_tablet_manager.cc:1397] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
I20260928 14:50:22.665688 9286 raft_consensus.cc:2454] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:22.665675 9360 leader_election.cc:302] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:22.666101 9827 raft_consensus.cc:2726] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:22.666291 9813 log.cc:1196] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6bb86e4e2d234f7ab4de8fb8a1c6a4f8
W20260928 14:50:22.666712 9498 leader_election.cc:341] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.666766 9813 ts_tablet_manager.cc:1939] T 6bb86e4e2d234f7ab4de8fb8a1c6a4f8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.666718 9848 raft_consensus.cc:348] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.666863 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb6a6cea334521b13b5ebd47fbab98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.666935 9848 raft_consensus.cc:374] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.667027 9848 raft_consensus.cc:729] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.667217 9848 consensus_queue.cc:260] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.664314 10007 raft_consensus.cc:3037] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.667774 9848 ts_tablet_manager.cc:1428] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:22.668046 9497 leader_election.cc:302] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.668649 9821 raft_consensus.cc:2781] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.668751 9821 raft_consensus.cc:482] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.668818 9821 raft_consensus.cc:3037] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.669373 9813 tablet_replica.cc:330] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.669391 9848 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:22.669958 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9d5166a828e84d46af3112cdc7bb0a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5166a828e84d46af3112cdc7bb0a2a already in progress: creating tablet
W20260928 14:50:22.670207 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0e661ac0a85949a280d837ee0357eea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e661ac0a85949a280d837ee0357eea7 already in progress: creating tablet
I20260928 14:50:22.669595 9813 raft_consensus.cc:2229] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.670527 9813 raft_consensus.cc:2258] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.671015 9813 ts_tablet_manager.cc:1905] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.673666 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3ac8adb23c5478fadb6cb6765459913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.676865 9813 ts_tablet_manager.cc:1918] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.676993 9813 log.cc:1196] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4aea5d7d3ebf4324bf438d2078d9dab1
I20260928 14:50:22.677217 9848 tablet_bootstrap.cc:654] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.677362 9813 ts_tablet_manager.cc:1939] T 4aea5d7d3ebf4324bf438d2078d9dab1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.678666 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b97883acb4adfa4091653545e894b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.681589 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4aea5d7d3ebf4324bf438d2078d9dab1 (table default.Table_6b37f2324eea4e239c508ae9316abe0b [id=a7321b80e1574fc8a4e37cbd7377864b]) successfully deleted
I20260928 14:50:22.682546 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 066df778654449bda96f68b5035c4d73. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.682528 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7b47d891c9264a03ac11f50f2b56edad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b47d891c9264a03ac11f50f2b56edad already in progress: creating tablet
I20260928 14:50:22.682948 9813 tablet_replica.cc:330] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.683281 9813 raft_consensus.cc:2229] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.683658 9813 raft_consensus.cc:2258] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.684365 9813 ts_tablet_manager.cc:1905] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.688304 9855 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.643486 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.692971 9848 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.693171 9848 ts_tablet_manager.cc:1397] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.014s
I20260928 14:50:22.693988 9848 raft_consensus.cc:348] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.694325 9848 raft_consensus.cc:374] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.694424 9848 raft_consensus.cc:729] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.694818 9813 ts_tablet_manager.cc:1918] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.694739 9848 consensus_queue.cc:260] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.695195 9813 log.cc:1196] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ada3738d517e4558b34826e35c74196a
I20260928 14:50:22.695362 9848 ts_tablet_manager.cc:1428] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 14:50:22.695693 9848 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.695943 9813 ts_tablet_manager.cc:1939] T ada3738d517e4558b34826e35c74196a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.697052 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ada3738d517e4558b34826e35c74196a (table default.Table_79b89ecacda14a678766fdc9f414d3ef [id=8ac147130f624ae9af569c48b86b9ee0]) successfully deleted
W20260928 14:50:22.697913 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cf2dd699271542bd9b9604e746686c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2dd699271542bd9b9604e746686c53 already in progress: creating tablet
I20260928 14:50:22.698197 9848 tablet_bootstrap.cc:654] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:22.698822 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5a64ffa786f045b480efe51eb69d7074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a64ffa786f045b480efe51eb69d7074 already in progress: creating tablet
W20260928 14:50:22.699582 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 03245f72e0aa496d895968d8e5715b56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03245f72e0aa496d895968d8e5715b56 already in progress: creating tablet
W20260928 14:50:22.700690 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet def872f66b2541b9af6084e93d991ec2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet def872f66b2541b9af6084e93d991ec2 already in progress: creating tablet
W20260928 14:50:22.701572 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f05131db52e94d7c9f4856b0455246d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f05131db52e94d7c9f4856b0455246d2 already in progress: creating tablet
I20260928 14:50:22.701993 9855 ts_tablet_manager.cc:1397] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.092s user 0.013s sys 0.013s
W20260928 14:50:22.702368 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f095e4cbf95147d9afb83434ae1fd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f095e4cbf95147d9afb83434ae1fd29f already in progress: creating tablet
I20260928 14:50:22.702737 9813 tablet_replica.cc:330] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.703030 9813 raft_consensus.cc:2229] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.707635 9813 raft_consensus.cc:2258] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.708106 9848 tablet_bootstrap.cc:492] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.708249 9848 ts_tablet_manager.cc:1397] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.006s
I20260928 14:50:22.708312 9815 ts_tablet_manager.cc:1918] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.708372 9813 ts_tablet_manager.cc:1905] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.708448 9815 log.cc:1196] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/894af8262a004e41a6ccc2641f8f7605
I20260928 14:50:22.708787 9815 ts_tablet_manager.cc:1939] T 894af8262a004e41a6ccc2641f8f7605 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:22.709040 9848 raft_consensus.cc:348] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.709283 9848 raft_consensus.cc:374] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.709383 9848 raft_consensus.cc:729] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.709684 9848 consensus_queue.cc:260] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.710304 9848 ts_tablet_manager.cc:1428] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:22.710511 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 894af8262a004e41a6ccc2641f8f7605 (table default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]) successfully deleted
I20260928 14:50:22.710707 9848 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.712559 9848 tablet_bootstrap.cc:654] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.715421 9794 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" instance_seqno: 1790607018306793) as {username='slave'} at 127.8.181.3:52493; Asking this server to re-register.
I20260928 14:50:22.715559 9848 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.715698 9848 ts_tablet_manager.cc:1397] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260928 14:50:22.716478 9848 raft_consensus.cc:348] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.716730 9848 raft_consensus.cc:374] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.716814 9848 raft_consensus.cc:729] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.717067 9848 consensus_queue.cc:260] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:22.717242 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8193754d28d34c18bfc38ae0abd05f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8193754d28d34c18bfc38ae0abd05f4c already in progress: creating tablet
W20260928 14:50:22.717478 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 89959226fd6247d4b89c54cc6ef4ede6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89959226fd6247d4b89c54cc6ef4ede6 already in progress: creating tablet
I20260928 14:50:22.717684 9848 ts_tablet_manager.cc:1428] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260928 14:50:22.717733 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8948e45987b94ca69004c42e224ce93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8948e45987b94ca69004c42e224ce93f already in progress: creating tablet
W20260928 14:50:22.717922 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bad2124268994f04ae7153ea5aaeeab0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bad2124268994f04ae7153ea5aaeeab0 already in progress: creating tablet
I20260928 14:50:22.717980 9848 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.718994 9813 ts_tablet_manager.cc:1918] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.719241 9813 log.cc:1196] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:22.719681 9813 ts_tablet_manager.cc:1939] T b04e1f1977af4af8aed072bbd77e6f4c P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:22.719904 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2a30439ac5a8485a9b6ebbe1371087b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a30439ac5a8485a9b6ebbe1371087b1 already in progress: creating tablet
I20260928 14:50:22.720012 9848 tablet_bootstrap.cc:654] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.720932 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e56077833e41dbacf54c1757ba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.723562 9848 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.723696 9848 ts_tablet_manager.cc:1397] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260928 14:50:22.725868 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet b04e1f1977af4af8aed072bbd77e6f4c (table default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]) successfully deleted
I20260928 14:50:22.726256 9813 tablet_replica.cc:330] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:22.726481 9813 raft_consensus.cc:2229] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.726783 9813 raft_consensus.cc:2258] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.727728 9848 raft_consensus.cc:348] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.728009 9848 raft_consensus.cc:374] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.728149 9848 raft_consensus.cc:729] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.728542 9848 consensus_queue.cc:260] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.728832 9614 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:22.729821 9855 raft_consensus.cc:348] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.730365 9848 ts_tablet_manager.cc:1428] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:22.730657 9848 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.732218 9848 tablet_bootstrap.cc:654] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.733249 9813 ts_tablet_manager.cc:1905] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.734654 9848 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.735189 9848 ts_tablet_manager.cc:1397] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260928 14:50:22.735893 9848 raft_consensus.cc:348] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.736128 9848 raft_consensus.cc:374] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.736208 9848 raft_consensus.cc:729] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.736474 9848 consensus_queue.cc:260] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.738247 9848 ts_tablet_manager.cc:1428] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:22.738574 9848 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.739737 9813 ts_tablet_manager.cc:1918] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.739854 9813 log.cc:1196] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5ef1cee3a6904bc5950dbc6d4a5390ee
I20260928 14:50:22.740307 9813 ts_tablet_manager.cc:1939] T 5ef1cee3a6904bc5950dbc6d4a5390ee P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:22.740357 9848 tablet_bootstrap.cc:654] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.741293 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5ef1cee3a6904bc5950dbc6d4a5390ee (table default.Table_40ee866dbebc49a98a8bdfb97554b162 [id=3b2db46abf2940f0937f31278b4f180c]) successfully deleted
I20260928 14:50:22.741858 9855 raft_consensus.cc:374] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.741955 9855 raft_consensus.cc:729] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:22.741993 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8948e45987b94ca69004c42e224ce93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8948e45987b94ca69004c42e224ce93f already in progress: creating tablet
W20260928 14:50:22.742607 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 89959226fd6247d4b89c54cc6ef4ede6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89959226fd6247d4b89c54cc6ef4ede6 already in progress: creating tablet
W20260928 14:50:22.743285 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8193754d28d34c18bfc38ae0abd05f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8193754d28d34c18bfc38ae0abd05f4c already in progress: creating tablet
W20260928 14:50:22.743947 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2a30439ac5a8485a9b6ebbe1371087b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a30439ac5a8485a9b6ebbe1371087b1 already in progress: creating tablet
W20260928 14:50:22.744544 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bad2124268994f04ae7153ea5aaeeab0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bad2124268994f04ae7153ea5aaeeab0 already in progress: creating tablet
I20260928 14:50:22.744879 9855 consensus_queue.cc:260] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.745170 9851 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:22.745306 9851 ts_tablet_manager.cc:1397] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.201s user 0.008s sys 0.000s
I20260928 14:50:22.746140 9851 raft_consensus.cc:348] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.746335 9851 raft_consensus.cc:374] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.746413 9851 raft_consensus.cc:729] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.746631 9851 consensus_queue.cc:260] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.747231 9851 ts_tablet_manager.cc:1428] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:22.748319 9851 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:22.749852 9851 tablet_bootstrap.cc:654] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.751761 9848 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.751896 9848 ts_tablet_manager.cc:1397] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.007s
I20260928 14:50:22.752652 9848 raft_consensus.cc:348] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.752859 9848 raft_consensus.cc:374] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.752952 9848 raft_consensus.cc:729] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.753158 9848 consensus_queue.cc:260] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.753662 9848 ts_tablet_manager.cc:1428] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:22.753926 9848 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.755259 9848 tablet_bootstrap.cc:654] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.757696 9848 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.757903 9848 ts_tablet_manager.cc:1397] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260928 14:50:22.758643 9848 raft_consensus.cc:348] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.758909 9848 raft_consensus.cc:374] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.759047 9848 raft_consensus.cc:729] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.759335 9848 consensus_queue.cc:260] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:22.759975 9848 ts_tablet_manager.cc:1428] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:22.760315 9848 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.761790 9848 tablet_bootstrap.cc:654] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.762856 9821 raft_consensus.cc:504] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.763427 9821 leader_election.cc:288] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:22.764108 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_934f9198bb9640cd8a19ffbd721f3d24" } new_table_name: "default.Table_7e7048dd3ec54844a2182f31361f62e3" modify_external_catalogs: true
I20260928 14:50:22.765373 9794 ts_manager.cc:194] Registered new tserver with Master: 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.766198 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:22.766472 9428 raft_consensus.cc:3037] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.770284 9568 raft_consensus.cc:2379] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:22.775403 9428 raft_consensus.cc:2454] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
W20260928 14:50:22.786634 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd24e60a0e944f6086ff9c9fbe2e8180 consensus state has no leader
I20260928 14:50:22.787173 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 999aa56f1683464d9612a2ddbfbebbda from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.787909 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7b4158a2d2da439f82044ce95e9c7508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.788511 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b4158a2d2da439f82044ce95e9c7508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.790334 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dd8de2e47dbc40659b08dd991ad571b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.790921 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd8de2e47dbc40659b08dd991ad571b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.794275 9498 leader_election.cc:302] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.794776 9821 raft_consensus.cc:2781] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:22.797510 9848 tablet_bootstrap.cc:492] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:22.797807 9848 ts_tablet_manager.cc:1397] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.037s user 0.018s sys 0.005s
I20260928 14:50:22.798897 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet ee16f4482a424538812f6356655acf77 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.800427 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:22.802745 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 311e4286b2a943ee924ac1c25dc9ca46 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.803453 9821 raft_consensus.cc:686] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:22.805334 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 8b914e3c8243490d92378a8765d6390f (DEFAULT_TABLE table=default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.808559 9848 raft_consensus.cc:348] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.808807 9848 raft_consensus.cc:374] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.808892 9848 raft_consensus.cc:729] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.808981 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b914e3c8243490d92378a8765d6390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.809156 9848 consensus_queue.cc:260] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.810937 9848 ts_tablet_manager.cc:1428] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 14:50:22.811740 9827 raft_consensus.cc:482] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.811918 9827 raft_consensus.cc:504] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.812513 9827 leader_election.cc:288] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.814633 9821 consensus_queue.cc:237] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.815991 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.816218 9568 raft_consensus.cc:2454] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:22.816685 9848 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:22.817149 9855 ts_tablet_manager.cc:1428] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.113s user 0.006s sys 0.028s
I20260928 14:50:22.817699 9360 leader_election.cc:302] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.818392 9827 raft_consensus.cc:2781] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.818523 9827 raft_consensus.cc:482] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.818624 9827 raft_consensus.cc:3037] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.819020 9848 tablet_bootstrap.cc:654] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.826102 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 8b914e3c8243490d92378a8765d6390f (DEFAULT_TABLE table=default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.826488 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b914e3c8243490d92378a8765d6390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.826488 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_12b926cfeead4b05a434279fb8a0df41" } modify_external_catalogs: true
I20260928 14:50:22.826713 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_12b926cfeead4b05a434279fb8a0df41" } modify_external_catalogs: true
W20260928 14:50:22.828040 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bdb6a6cea334521b13b5ebd47fbab98 consensus state has no leader
I20260928 14:50:22.828404 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_66332b3d2ff9456496408d9a898ed929" } modify_external_catalogs: true
I20260928 14:50:22.828637 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_66332b3d2ff9456496408d9a898ed929" } modify_external_catalogs: true
I20260928 14:50:22.832525 9855 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.832595 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8b9e5857660a46159398f3e1588dadad" } modify_external_catalogs: true
I20260928 14:50:22.832741 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8b9e5857660a46159398f3e1588dadad" } modify_external_catalogs: true
I20260928 14:50:22.834045 9855 tablet_bootstrap.cc:654] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.834208 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea5cc25a78624d7b99527b5433bd32e3" } modify_external_catalogs: true
I20260928 14:50:22.834388 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea5cc25a78624d7b99527b5433bd32e3" } modify_external_catalogs: true
I20260928 14:50:22.841324 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c9a7573c751d412aa8394d6277c28b7f
I20260928 14:50:22.841845 8952 catalog_manager.cc:6565] ReplaceTablet: tablet c9a7573c751d412aa8394d6277c28b7f deleted and replaced by tablet 764f0ee9d8a149e3a295fe790beb1019
I20260928 14:50:22.842865 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:22.843554 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c9a7573c751d412aa8394d6277c28b7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9a7573c751d412aa8394d6277c28b7f already in progress: creating tablet
I20260928 14:50:22.843832 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:22.844291 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 999aa56f1683464d9612a2ddbfbebbda deleted and replaced by tablet dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:22.844542 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 6a50b4fe8d86464f933baec07478db25 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:22.844844 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:22.845615 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 999aa56f1683464d9612a2ddbfbebbda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 999aa56f1683464d9612a2ddbfbebbda already in progress: creating tablet
I20260928 14:50:22.846139 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:22.847491 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:22.848297 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4c101b1f03bb411f963f2348397c03e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c101b1f03bb411f963f2348397c03e2 already in progress: creating tablet
I20260928 14:50:22.854247 9855 tablet_bootstrap.cc:492] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.854511 9855 ts_tablet_manager.cc:1397] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.004s
I20260928 14:50:22.855898 9855 raft_consensus.cc:348] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.855887 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_efdda1920fdd4a118b80b0f5485931b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.856244 9855 raft_consensus.cc:374] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.856333 9855 raft_consensus.cc:729] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:22.856633 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efdda1920fdd4a118b80b0f5485931b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.856542 9855 consensus_queue.cc:260] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.857030 9855 ts_tablet_manager.cc:1428] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:22.857260 9855 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.857980 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cd097e6f93214ec0b7966e4b467d51e2" } modify_external_catalogs: true
I20260928 14:50:22.858209 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cd097e6f93214ec0b7966e4b467d51e2" } modify_external_catalogs: true
I20260928 14:50:22.860492 9855 tablet_bootstrap.cc:654] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.866362 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.866663 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.866894 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:22.867332 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c9a7573c751d412aa8394d6277c28b7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9a7573c751d412aa8394d6277c28b7f already in progress: creating tablet
W20260928 14:50:22.867576 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4c101b1f03bb411f963f2348397c03e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c101b1f03bb411f963f2348397c03e2 already in progress: creating tablet
W20260928 14:50:22.867766 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 999aa56f1683464d9612a2ddbfbebbda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 999aa56f1683464d9612a2ddbfbebbda already in progress: creating tablet
I20260928 14:50:22.871941 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ee16f4482a424538812f6356655acf77
I20260928 14:50:22.872349 8951 catalog_manager.cc:6565] ReplaceTablet: tablet ee16f4482a424538812f6356655acf77 deleted and replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:22.872700 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.872702 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2daaa607d7bb425caea915bbbdb6b8f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:22.873207 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2daaa607d7bb425caea915bbbdb6b8f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.873243 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:22.874571 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ee16f4482a424538812f6356655acf77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee16f4482a424538812f6356655acf77 already in progress: creating tablet
W20260928 14:50:22.874702 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ee16f4482a424538812f6356655acf77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee16f4482a424538812f6356655acf77 already in progress: creating tablet
I20260928 14:50:22.875326 8952 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 764f0ee9d8a149e3a295fe790beb1019
I20260928 14:50:22.875711 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_afef2b8c01784afca888d12fea0bb492" } new_table_name: "default.Table_b83606ed237744d88ba3ebb26186e236" modify_external_catalogs: true
I20260928 14:50:22.878865 9827 raft_consensus.cc:504] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:22.883037 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 113693us
I20260928 14:50:22.886041 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:22.886256 9568 raft_consensus.cc:3037] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.889050 9568 raft_consensus.cc:2454] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:22.889518 9360 leader_election.cc:302] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.890362 9827 leader_election.cc:288] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.890586 9827 raft_consensus.cc:2781] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:22.890733 9827 raft_consensus.cc:686] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:22.894179 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:22.894140 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5ac0707793ba4f36a82ff882fe74ebf9" } new_table_name: "default.Table_c2ea7b972a3441858741b741d8452bd7" modify_external_catalogs: true
I20260928 14:50:22.895228 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.895244 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1947b7d284624c22a135dab29101c45c" } new_table_name: "default.Table_f4fab128ab184dc0b574746a3df0aae3" modify_external_catalogs: true
W20260928 14:50:22.896776 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ffd9bc260ae4373a946ce82ba5f0d48 already in progress: creating tablet
I20260928 14:50:22.896783 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:22.897464 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ffd9bc260ae4373a946ce82ba5f0d48 already in progress: creating tablet
I20260928 14:50:22.904325 10010 raft_consensus.cc:482] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:22.904913 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 consensus state has no leader
I20260928 14:50:22.891021 9827 consensus_queue.cc:237] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:22.909510 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca5c040fa6ba4e2785959874a3346bf7 consensus state has no leader
I20260928 14:50:22.912657 9855 tablet_bootstrap.cc:492] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.912886 9855 ts_tablet_manager.cc:1397] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.001s
I20260928 14:50:22.913666 9855 raft_consensus.cc:348] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.913879 9855 raft_consensus.cc:374] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.913934 9855 raft_consensus.cc:729] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.914166 9855 consensus_queue.cc:260] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.905301 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4025017d30034ea3adc6b5fd55d18617" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:22.914633 9855 ts_tablet_manager.cc:1428] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:22.914880 9855 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:22.916286 9855 tablet_bootstrap.cc:654] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.917990 9286 raft_consensus.cc:3037] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.917724 9219 leader_election.cc:302] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.919838 10029 raft_consensus.cc:482] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.920014 10029 raft_consensus.cc:504] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:22.920848 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8296732efcb349ab9cc87e3ff1e11fd0 has no consensus state
I20260928 14:50:22.921378 10029 leader_election.cc:288] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.921406 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "315c446d87c84ae4bc9cb3243dca5538" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.921664 9568 raft_consensus.cc:2454] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:22.922133 9360 leader_election.cc:302] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.922452 10029 raft_consensus.cc:2781] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.922676 10029 raft_consensus.cc:482] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.922825 10029 raft_consensus.cc:3037] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.924896 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:22.925134 9815 tablet_replica.cc:330] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:22.925163 9855 tablet_bootstrap.cc:492] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:22.925331 9815 raft_consensus.cc:2229] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:22.925571 9815 raft_consensus.cc:2258] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:22.926304 9815 ts_tablet_manager.cc:1905] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:22.932330 9815 ts_tablet_manager.cc:1918] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:22.932529 9815 log.cc:1196] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:22.932991 9815 ts_tablet_manager.cc:1939] T 63792bb2d5b54463a701c9e4e5f095e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:22.933221 8949 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet ce25abb4559241f58054f27435fd6078 (table default.Table_ab8b665217b04cf7a742ad3a5bda5573 [id=a95034bdd2ac4f5e9a36e1e16b407355]). Expected version 2 got 0
I20260928 14:50:22.933892 10033 raft_consensus.cc:482] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.934103 10033 raft_consensus.cc:504] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.934444 9855 ts_tablet_manager.cc:1397] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.001s
I20260928 14:50:22.934808 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 63792bb2d5b54463a701c9e4e5f095e0 (table default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]) successfully deleted
I20260928 14:50:22.935560 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 86d21f615343473a95cd1f5040aebc79 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.935981 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d21f615343473a95cd1f5040aebc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.936159 9855 raft_consensus.cc:348] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.936374 9855 raft_consensus.cc:374] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:22.936395 8949 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_45f6644a6d6643238d8f7cf2953ecc43 [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 4 got 0
I20260928 14:50:22.936481 9855 raft_consensus.cc:729] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:22.935499 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 86d21f615343473a95cd1f5040aebc79 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.934878 10029 raft_consensus.cc:504] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.937294 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d21f615343473a95cd1f5040aebc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.935760 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 962a5dee53514f7ab5a63242f7d70446 (DEFAULT_TABLE table=default.Table_f623bcce062e46e8814285fff7b584ff [id=1692d8fdf9b240f6a1662de9319db005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.937897 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962a5dee53514f7ab5a63242f7d70446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.937970 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 962a5dee53514f7ab5a63242f7d70446 (DEFAULT_TABLE table=default.Table_f623bcce062e46e8814285fff7b584ff [id=1692d8fdf9b240f6a1662de9319db005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.938449 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962a5dee53514f7ab5a63242f7d70446. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:22.938421 9360 leader_election.cc:341] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 555b1577a6a1486e93e78125431ab215
I20260928 14:50:22.941592 10033 leader_election.cc:288] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.942806 10029 leader_election.cc:288] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.943329 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (DEFAULT_TABLE table=default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d [id=290e5d7ef835430987ca8992b8142bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.942518 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "315c446d87c84ae4bc9cb3243dca5538" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:22.943961 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f79fcac805b42ba8b66949fbdfeb8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.943419 9855 consensus_queue.cc:260] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.935997 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (DEFAULT_TABLE table=default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d [id=290e5d7ef835430987ca8992b8142bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.946096 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f79fcac805b42ba8b66949fbdfeb8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.946487 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2898a032e1488b98c31b5e83371a71 (DEFAULT_TABLE table=default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.946882 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 0e53b8b73b37464687d343493d186660 (DEFAULT_TABLE table=default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.950588 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2898a032e1488b98c31b5e83371a71 (DEFAULT_TABLE table=default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.950915 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2898a032e1488b98c31b5e83371a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.953799 9393 tablet_service.cc:1467] Processing CreateTablet for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (DEFAULT_TABLE table=default.Table_577d089c2d454fed9b7ec794d9b71f43 [id=164d4835accf45a8852840a00eae16ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.954154 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadb919c4554e5c89f8bb19cf3ddd75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.957862 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 0e53b8b73b37464687d343493d186660 (DEFAULT_TABLE table=default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.958196 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e53b8b73b37464687d343493d186660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.904556 10010 raft_consensus.cc:504] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:22.959882 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 68239.6us
I20260928 14:50:22.963392 9568 raft_consensus.cc:3037] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.965859 9568 raft_consensus.cc:2454] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:22.966176 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2898a032e1488b98c31b5e83371a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.969664 9360 leader_election.cc:302] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.969941 10029 raft_consensus.cc:2781] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:22.969928 9532 tablet_service.cc:1467] Processing CreateTablet for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (DEFAULT_TABLE table=default.Table_577d089c2d454fed9b7ec794d9b71f43 [id=164d4835accf45a8852840a00eae16ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.970084 10029 raft_consensus.cc:686] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:22.970248 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadb919c4554e5c89f8bb19cf3ddd75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.970340 10029 consensus_queue.cc:237] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.971787 9705 raft_consensus.cc:504] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.972024 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d27738fcfbc42f298e26149dfd28182" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.972239 9569 raft_consensus.cc:2454] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:22.972330 9705 leader_election.cc:288] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.974095 9219 leader_election.cc:302] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:22.974188 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:22.974375 9219 leader_election.cc:341] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:22.974500 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296732efcb349ab9cc87e3ff1e11fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.975857 10010 leader_election.cc:288] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.976011 10010 raft_consensus.cc:2781] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.970872 10023 raft_consensus.cc:482] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.976363 10010 raft_consensus.cc:482] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:22.976455 10010 raft_consensus.cc:3037] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.978169 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 8b914e3c8243490d92378a8765d6390f (DEFAULT_TABLE table=default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.978377 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e53b8b73b37464687d343493d186660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.980767 10033 raft_consensus.cc:482] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.980929 10033 raft_consensus.cc:504] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.981468 10033 leader_election.cc:288] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.981916 10018 raft_consensus.cc:482] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.982131 10018 raft_consensus.cc:504] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.982802 10018 leader_election.cc:288] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:22.983042 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d26550613aa4988910ec66eeb8b2f07" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.983209 9569 raft_consensus.cc:2454] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:22.983242 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:22.983368 9705 raft_consensus.cc:482] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:22.983503 9705 raft_consensus.cc:504] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.983812 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:22.984259 9497 leader_election.cc:341] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:22.984604 9498 leader_election.cc:341] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:22.984712 9498 leader_election.cc:302] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:22.984917 10018 raft_consensus.cc:2726] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:22.984663 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6179576a67a644d9bf10f0a9fb84cf49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.985126 9360 leader_election.cc:302] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.985352 10029 raft_consensus.cc:2781] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:22.985476 10029 raft_consensus.cc:482] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:22.985574 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6179576a67a644d9bf10f0a9fb84cf49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:22.985633 10029 raft_consensus.cc:3037] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.988127 10029 raft_consensus.cc:504] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.989022 10029 leader_election.cc:288] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:22.989195 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d26550613aa4988910ec66eeb8b2f07" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:22.989352 9569 raft_consensus.cc:3037] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:22.989617 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:22.990001 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296732efcb349ab9cc87e3ff1e11fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.991778 9569 raft_consensus.cc:2454] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:22.991948 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b914e3c8243490d92378a8765d6390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:22.992139 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.992592 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_84d5571edfa649fcb6d2b43b7c99f1e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:22.993464 9286 raft_consensus.cc:2454] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:22.998834 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "315c446d87c84ae4bc9cb3243dca5538" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:22.999169 9569 raft_consensus.cc:2379] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate ae832871bd1142f7af10c084115ffc12 in this term.
I20260928 14:50:22.982573 10023 raft_consensus.cc:504] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:22.992353 9360 leader_election.cc:302] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:22.993432 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d27738fcfbc42f298e26149dfd28182" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:23.000276 9813 tablet_replica.cc:330] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.000386 9428 raft_consensus.cc:2454] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:23.000298 10029 raft_consensus.cc:2781] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.000669 10029 raft_consensus.cc:686] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:23.000944 10029 consensus_queue.cc:237] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.002282 10021 raft_consensus.cc:2726] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.002713 9855 ts_tablet_manager.cc:1428] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:23.002998 9855 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:23.004539 9855 tablet_bootstrap.cc:654] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:22.999727 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:22.999998 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 555b1577a6a1486e93e78125431ab215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.005692 9705 leader_election.cc:288] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.002592 10007 raft_consensus.cc:504] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:23.007407 9219 leader_election.cc:341] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:23.008906 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.001129 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_03bbf67d11074023a23cb3067cf6b53d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.009418 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:23.009943 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03bbf67d11074023a23cb3067cf6b53d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.004148 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_27e0a92c193545919fef5e1d2cefdbab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.011054 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27e0a92c193545919fef5e1d2cefdbab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.014377 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0e53b8b73b37464687d343493d186660
I20260928 14:50:23.015017 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eb8e41236cc945d8957a137aca04ed41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.015465 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb8e41236cc945d8957a137aca04ed41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.017408 10023 leader_election.cc:288] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.018507 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:23.018692 9569 raft_consensus.cc:3037] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.017344 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:23.021435 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0e53b8b73b37464687d343493d186660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e53b8b73b37464687d343493d186660 already in progress: creating tablet
I20260928 14:50:23.021577 9569 raft_consensus.cc:2454] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:23.021842 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.021951 9219 leader_election.cc:302] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:23.022210 10023 raft_consensus.cc:2781] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.023340 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dd8de2e47dbc40659b08dd991ad571b2" } new_table_name: "default.Table_24d1275ef415467cb0fd23d519f914f2" modify_external_catalogs: true
I20260928 14:50:23.028012 10007 leader_election.cc:288] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.028224 10021 raft_consensus.cc:482] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.029857 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.031517 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:23.030157 9705 raft_consensus.cc:482] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.031854 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 311e4286b2a943ee924ac1c25dc9ca46 deleted and replaced by tablet f1f9b6cbf2d949839216e807130b2eb9
I20260928 14:50:23.031996 9705 raft_consensus.cc:504] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.032590 9705 leader_election.cc:288] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.033430 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:23.034106 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.034396 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:23.034610 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.034567 10010 raft_consensus.cc:504] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.035182 10010 leader_election.cc:288] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:23.035377 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 32e7e11092d1475cba53e51a0f61d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e7e11092d1475cba53e51a0f61d6f1 already in progress: creating tablet
I20260928 14:50:23.035349 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.035619 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.036437 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d27738fcfbc42f298e26149dfd28182" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:23.036640 9568 raft_consensus.cc:3037] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.030359 10021 raft_consensus.cc:504] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:23.037451 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 311e4286b2a943ee924ac1c25dc9ca46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 311e4286b2a943ee924ac1c25dc9ca46 already in progress: creating tablet
I20260928 14:50:23.007678 8952 catalog_manager.cc:5495] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:23.038460 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.038642 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.039297 9568 raft_consensus.cc:2454] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:23.040377 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6a50b4fe8d86464f933baec07478db25
I20260928 14:50:23.040699 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 6a50b4fe8d86464f933baec07478db25 deleted and replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:23.040949 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7b4158a2d2da439f82044ce95e9c7508" } new_table_name: "default.Table_8522c5741c0547aba590628989bcf58e" modify_external_catalogs: true
I20260928 14:50:23.041729 9219 leader_election.cc:302] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:23.042071 10010 raft_consensus.cc:2781] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.042217 10010 raft_consensus.cc:686] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:23.042524 10010 consensus_queue.cc:237] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.043924 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.045972 10021 leader_election.cc:288] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:23.045953 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6a50b4fe8d86464f933baec07478db25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a50b4fe8d86464f933baec07478db25 already in progress: creating tablet
I20260928 14:50:23.046111 9286 raft_consensus.cc:2454] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.047003 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.052045 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.052343 9568 raft_consensus.cc:2379] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate ae832871bd1142f7af10c084115ffc12 in this term.
I20260928 14:50:23.054991 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 86d21f615343473a95cd1f5040aebc79 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.055500 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86d21f615343473a95cd1f5040aebc79. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.056751 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9f843006a1e43a49f177433c7a3e1ea has no consensus state
I20260928 14:50:23.057878 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 962a5dee53514f7ab5a63242f7d70446 (DEFAULT_TABLE table=default.Table_f623bcce062e46e8814285fff7b584ff [id=1692d8fdf9b240f6a1662de9319db005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.058158 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.058245 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962a5dee53514f7ab5a63242f7d70446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.061105 9851 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:23.061270 9851 ts_tablet_manager.cc:1397] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.313s user 0.011s sys 0.016s
I20260928 14:50:23.062058 9851 raft_consensus.cc:348] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.062306 9851 raft_consensus.cc:374] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.062387 9851 raft_consensus.cc:729] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.062605 9851 consensus_queue.cc:260] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.063205 9851 ts_tablet_manager.cc:1428] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:23.063521 9851 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:23.065274 9851 tablet_bootstrap.cc:654] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:23.065280 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82b042c6ffc148939dcba9b710f198d3 has no consensus state
I20260928 14:50:23.068907 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet d0f099714e924a968fbd792e5f69bba4 with delete_type TABLET_DATA_DELETED (replaced by tablet 051b7f0b1d0f4f638f3e7a69a027196e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.069325 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f01267d094954f7c847b2dc00adbabb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.069909 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01267d094954f7c847b2dc00adbabb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.069936 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (DEFAULT_TABLE table=default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d [id=290e5d7ef835430987ca8992b8142bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.070283 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f79fcac805b42ba8b66949fbdfeb8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.071491 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_878c137d7b9a413691d0488b19f1441c" } modify_external_catalogs: true
I20260928 14:50:23.071704 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_878c137d7b9a413691d0488b19f1441c" } modify_external_catalogs: true
I20260928 14:50:23.073086 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_aec40460d7f342a2985b89fc3e947fae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.073639 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aec40460d7f342a2985b89fc3e947fae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.081498 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab8b665217b04cf7a742ad3a5bda5573" } modify_external_catalogs: true
I20260928 14:50:23.082062 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab8b665217b04cf7a742ad3a5bda5573" } modify_external_catalogs: true
I20260928 14:50:23.082774 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.086611 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet c9cee872de1f4ce8b803cb8e8fb018d2 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.090960 9827 raft_consensus.cc:482] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.091218 9827 raft_consensus.cc:504] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.091804 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.092356 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.092485 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2898a032e1488b98c31b5e83371a71 (DEFAULT_TABLE table=default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.092886 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2898a032e1488b98c31b5e83371a71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.093130 9360 leader_election.cc:341] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:23.095445 9827 leader_election.cc:288] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.096496 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 03245f72e0aa496d895968d8e5715b56 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.092296 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.097564 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_36af68297033436da7f4857adf0b42ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.098165 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296732efcb349ab9cc87e3ff1e11fd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.098278 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36af68297033436da7f4857adf0b42ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.101050 9266 tablet_service.cc:1467] Processing CreateTablet for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (DEFAULT_TABLE table=default.Table_577d089c2d454fed9b7ec794d9b71f43 [id=164d4835accf45a8852840a00eae16ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.101473 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadb919c4554e5c89f8bb19cf3ddd75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.102087 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cce07af2389446a1b409612d248028cf" } modify_external_catalogs: true
I20260928 14:50:23.102655 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cce07af2389446a1b409612d248028cf" } modify_external_catalogs: true
I20260928 14:50:23.108084 9813 raft_consensus.cc:2229] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:23.108649 9813 pending_rounds.cc:62] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:23.108728 9813 pending_rounds.cc:68] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326366214012928 op_type: NO_OP noop_request { }
I20260928 14:50:23.108858 9813 raft_consensus.cc:2866] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:23.108983 9813 raft_consensus.cc:2258] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.112594 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3162055572e84dbe8f62a9ed44e21062" } new_table_name: "default.Table_831f7fae5027486199eec1b90890aa35" modify_external_catalogs: true
I20260928 14:50:23.113063 9814 ts_tablet_manager.cc:1918] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:23.113194 9814 log.cc:1196] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/51e28b2e855542b68e3bea8180e7f606
I20260928 14:50:23.113198 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 (DEFAULT_TABLE table=default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.113570 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 852b70b1f7444ad2ab92d66d580a0db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.113624 9814 ts_tablet_manager.cc:1939] T 51e28b2e855542b68e3bea8180e7f606 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:23.114323 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 101) took 1243 ms. Trace:
I20260928 14:50:23.114427 9814 rpcz_store.cc:276] 0928 14:50:21.870394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:21.870441 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:22.540230 (+669789us) ts_tablet_manager.cc:1145] Deleting tablet 51e28b2e855542b68e3bea8180e7f606
0928 14:50:22.540238 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.001433 (+461195us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.112958 (+111525us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.114291 (+ 1333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":669574}
I20260928 14:50:23.114691 9398 tablet_service.cc:1467] Processing CreateTablet for tablet d806161b858145e1a4fa946587ae1529 (DEFAULT_TABLE table=default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.114773 9814 tablet_replica.cc:330] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:23.114989 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d806161b858145e1a4fa946587ae1529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.114969 9814 raft_consensus.cc:2229] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.115104 9814 raft_consensus.cc:2258] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.115612 9814 ts_tablet_manager.cc:1905] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.117934 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.119448 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_27e0a92c193545919fef5e1d2cefdbab" } new_table_name: "default.Table_783c475fe2dc470c85133e418a70741a" modify_external_catalogs: true
I20260928 14:50:23.107699 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_50d42e9768d34d79ad94f455c707b4b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.119935 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50d42e9768d34d79ad94f455c707b4b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:23.121730 10035 consensus_queue.cc:1159] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ae832871bd1142f7af10c084115ffc12" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260928 14:50:23.122745 9813 ts_tablet_manager.cc:1905] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.123188 9400 tablet_service.cc:1467] Processing CreateTablet for tablet b9f843006a1e43a49f177433c7a3e1ea (DEFAULT_TABLE table=default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.123649 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f843006a1e43a49f177433c7a3e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.126109 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.126437 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f348f9e962748a0992d85b9d3d72aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.127986 10023 raft_consensus.cc:686] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:23.128273 10023 consensus_queue.cc:237] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.130386 9397 tablet_service.cc:1467] Processing CreateTablet for tablet dc8400fdb8d948b084733011b16df1b3 (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.136566 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 (DEFAULT_TABLE table=default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.136994 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 852b70b1f7444ad2ab92d66d580a0db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.137032 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 0e53b8b73b37464687d343493d186660 (DEFAULT_TABLE table=default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.137480 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e53b8b73b37464687d343493d186660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.138109 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.041616 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d26550613aa4988910ec66eeb8b2f07" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.140808 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_168ad97cac4b47538b65747275af38c6" } new_table_name: "default.Table_66d032c076df4decbc0ff1548031369f" modify_external_catalogs: true
I20260928 14:50:23.141011 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.141614 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.141891 9286 raft_consensus.cc:3037] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.140777 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet e0ee1e19142b402f96056c387140b5ca from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.143360 9532 tablet_service.cc:1467] Processing CreateTablet for tablet d806161b858145e1a4fa946587ae1529 (DEFAULT_TABLE table=default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.147550 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c9cee872de1f4ce8b803cb8e8fb018d2
I20260928 14:50:23.147945 8946 catalog_manager.cc:6565] ReplaceTablet: tablet c9cee872de1f4ce8b803cb8e8fb018d2 deleted and replaced by tablet c556381a95fa42e284dab68a7f401e63
I20260928 14:50:23.148422 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 066df778654449bda96f68b5035c4d73
I20260928 14:50:23.148906 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.149086 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7cc4c49a4962473699103528b64a1005
W20260928 14:50:23.149988 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:23.153640 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.153903 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.154228 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.154592 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 82b042c6ffc148939dcba9b710f198d3 (DEFAULT_TABLE table=default.Table_8522c5741c0547aba590628989bcf58e [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:23.155798 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a753aaf7f8c4498b6ba35fa27d8c537 has no consensus state
I20260928 14:50:23.156992 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ce25abb4559241f58054f27435fd6078
I20260928 14:50:23.157891 9813 ts_tablet_manager.cc:1918] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:23.158107 9813 log.cc:1196] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8d26550613aa4988910ec66eeb8b2f07
I20260928 14:50:23.158737 9813 ts_tablet_manager.cc:1939] T 8d26550613aa4988910ec66eeb8b2f07 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.159323 9813 tablet_replica.cc:330] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.159781 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8d26550613aa4988910ec66eeb8b2f07 (table default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]) successfully deleted
I20260928 14:50:23.160753 9569 raft_consensus.cc:2379] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate ae832871bd1142f7af10c084115ffc12 in this term.
I20260928 14:50:23.160794 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.160316 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet ce25abb4559241f58054f27435fd6078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.162067 9813 raft_consensus.cc:2229] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.162294 9813 raft_consensus.cc:2258] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:23.162633 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c8624f9349a4608a48943487f01c7c8 consensus state has no leader
I20260928 14:50:23.163298 9848 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.163513 9848 ts_tablet_manager.cc:1397] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.347s user 0.008s sys 0.023s
I20260928 14:50:23.164325 9848 raft_consensus.cc:348] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.164631 9848 raft_consensus.cc:374] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.164708 9813 ts_tablet_manager.cc:1905] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.164889 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc8400fdb8d948b084733011b16df1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.165340 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b042c6ffc148939dcba9b710f198d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.164749 9848 raft_consensus.cc:729] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.172272 9848 consensus_queue.cc:260] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.173875 9848 ts_tablet_manager.cc:1428] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 14:50:23.174661 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d806161b858145e1a4fa946587ae1529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.160763 9530 tablet_service.cc:1467] Processing CreateTablet for tablet dc8400fdb8d948b084733011b16df1b3 (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.177969 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc8400fdb8d948b084733011b16df1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.179797 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "315c446d87c84ae4bc9cb3243dca5538" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.181686 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f348f9e962748a0992d85b9d3d72aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.182528 9548 tablet_service.cc:1467] Processing CreateTablet for tablet b9f843006a1e43a49f177433c7a3e1ea (DEFAULT_TABLE table=default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.182742 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.182451 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 82b042c6ffc148939dcba9b710f198d3 (DEFAULT_TABLE table=default.Table_8522c5741c0547aba590628989bcf58e [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.183779 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f843006a1e43a49f177433c7a3e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.186810 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.186751 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "315c446d87c84ae4bc9cb3243dca5538" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.188575 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.188704 9848 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.188968 9287 raft_consensus.cc:2454] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.195708 9848 tablet_bootstrap.cc:654] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.196607 9286 raft_consensus.cc:2454] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:23.196991 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.200160 9848 tablet_bootstrap.cc:492] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.200325 9848 ts_tablet_manager.cc:1397] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260928 14:50:23.201154 9813 ts_tablet_manager.cc:1918] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.201296 9813 log.cc:1196] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:23.201668 9813 ts_tablet_manager.cc:1939] T cd8131f32f1a4153abf2967ca0a11619 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.203099 9848 raft_consensus.cc:348] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.203311 9848 raft_consensus.cc:374] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.203416 9848 raft_consensus.cc:729] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.203634 9848 consensus_queue.cc:260] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.204229 9848 ts_tablet_manager.cc:1428] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:23.204960 9848 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.206002 9813 tablet_replica.cc:330] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.206146 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cd8131f32f1a4153abf2967ca0a11619 (table default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]) successfully deleted
I20260928 14:50:23.206291 9813 raft_consensus.cc:2229] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.208441 8952 catalog_manager.cc:5495] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:23.209180 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:23.209599 8952 catalog_manager.cc:5495] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:23.210016 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_45f6644a6d6643238d8f7cf2953ecc43 [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 4 got 0
I20260928 14:50:23.206590 9813 raft_consensus.cc:2258] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.213029 9813 ts_tablet_manager.cc:1905] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.214475 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.214715 9394 tablet_service.cc:1467] Processing CreateTablet for tablet d199c65d3b4040388360fd8302d7cb8c (DEFAULT_TABLE table=default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.214921 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bea51859e0c4bc984288f94c2fcea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.215303 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d26550613aa4988910ec66eeb8b2f07" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.215550 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d199c65d3b4040388360fd8302d7cb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.215576 9286 raft_consensus.cc:2454] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.216377 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63792bb2d5b54463a701c9e4e5f095e0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.217242 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d26550613aa4988910ec66eeb8b2f07" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.217692 9286 raft_consensus.cc:3037] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.214476 9397 tablet_service.cc:1467] Processing CreateTablet for tablet ca7fa45e25b0455e92412b844cd78cdc (DEFAULT_TABLE table=default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.220124 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca7fa45e25b0455e92412b844cd78cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.220247 9286 raft_consensus.cc:2454] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
W20260928 14:50:23.220687 9360 leader_election.cc:341] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 555b1577a6a1486e93e78125431ab215
I20260928 14:50:23.220844 9360 leader_election.cc:302] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:23.221022 9360 raft_consensus.cc:2670] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:23.222121 9848 tablet_bootstrap.cc:654] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:23.223037 9360 leader_election.cc:341] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.223167 9360 leader_election.cc:302] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.223527 10029 raft_consensus.cc:2726] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.224265 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (DEFAULT_TABLE table=default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.224639 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a753aaf7f8c4498b6ba35fa27d8c537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.229038 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c98a8c2519314eb2a4007165e1132926" } modify_external_catalogs: true
I20260928 14:50:23.229254 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c98a8c2519314eb2a4007165e1132926" } modify_external_catalogs: true
I20260928 14:50:23.229555 9256 tablet_service.cc:1467] Processing CreateTablet for tablet dc8400fdb8d948b084733011b16df1b3 (DEFAULT_TABLE table=default.Table_5acbe80699db42c9a3d1d00365be633d [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:23.232462 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 88015bcd867e40e5b9263930e820074a (table default.Table_831f7fae5027486199eec1b90890aa35 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:23.235702 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc8400fdb8d948b084733011b16df1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.237972 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:23.239642 9395 tablet_service.cc:1467] Processing CreateTablet for tablet f1f9b6cbf2d949839216e807130b2eb9 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.240962 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.241061 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f9b6cbf2d949839216e807130b2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.243781 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_90c26f1761434c4da4b1b562e70a7093" } modify_external_catalogs: true
I20260928 14:50:23.244022 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_90c26f1761434c4da4b1b562e70a7093" } modify_external_catalogs: true
I20260928 14:50:23.244758 9404 tablet_service.cc:1467] Processing CreateTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 (DEFAULT_TABLE table=default.Table_f01267d094954f7c847b2dc00adbabb1 [id=23a200906c414328a1fdd9624c105637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.245584 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e1682c926dbb4ce884db79cdac24b3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.246137 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1682c926dbb4ce884db79cdac24b3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.246193 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 (DEFAULT_TABLE table=default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.246635 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 852b70b1f7444ad2ab92d66d580a0db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.249053 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_73404af3072b48e8bec8e4a727523609"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.249698 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73404af3072b48e8bec8e4a727523609 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.252182 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89035a3d41a4af78a8e7afbdb89c7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.250471 9400 tablet_service.cc:1467] Processing CreateTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 (DEFAULT_TABLE table=default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.264081 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fab191faa15444d5b265c05a6ad8f3d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.264639 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fab191faa15444d5b265c05a6ad8f3d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.265952 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f0f4d7e303b24a83932decc1af4a5311"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.265978 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad76e04bff34480284586d17fd78ba4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.266479 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0f4d7e303b24a83932decc1af4a5311 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:23.266542 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad76e04bff34480284586d17fd78ba4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.268937 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_36cf8fd2a6414734ab97181860917d4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.269416 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36cf8fd2a6414734ab97181860917d4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.271469 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8522c5741c0547aba590628989bcf58e" } new_table_name: "default.Table_a7caeee85f464e589dd70456b01066c0" modify_external_catalogs: true
I20260928 14:50:23.272907 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_577d089c2d454fed9b7ec794d9b71f43" } new_table_name: "default.Table_a1cd272b31e1467a86c2b1b03892c003" modify_external_catalogs: true
I20260928 14:50:23.274290 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 3c2b819b194d4373a59a3e94267361c1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.284945 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:23.285728 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.286078 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 767958659f4f450497eb5f2a3902993e (DEFAULT_TABLE table=default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.286520 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 1738a95895914cc4936a38e1d189d538 (DEFAULT_TABLE table=default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.286826 9406 tablet_service.cc:1467] Processing CreateTablet for tablet afe58ef9809540cb942e3ec44296e36f (DEFAULT_TABLE table=default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.287189 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 (DEFAULT_TABLE table=default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.287568 9388 tablet_service.cc:1467] Processing CreateTablet for tablet c556381a95fa42e284dab68a7f401e63 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.289305 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.289750 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd9f9cb48a945d19420a8bdb9bb9576. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.290026 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.290174 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c556381a95fa42e284dab68a7f401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.293215 10029 raft_consensus.cc:482] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.293356 9995 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:23.293358 10029 raft_consensus.cc:504] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.293648 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe58ef9809540cb942e3ec44296e36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.294060 10029 leader_election.cc:288] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.294929 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce25abb4559241f58054f27435fd6078" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.297690 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767958659f4f450497eb5f2a3902993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.297937 9814 ts_tablet_manager.cc:1918] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.298094 9814 log.cc:1196] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:23.298414 9814 ts_tablet_manager.cc:1939] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:23.298709 9263 tablet_service.cc:1467] Processing CreateTablet for tablet d806161b858145e1a4fa946587ae1529 (DEFAULT_TABLE table=default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.298964 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d806161b858145e1a4fa946587ae1529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.301643 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.301853 9995 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: loading cluster ID for follower catalog manager: success
I20260928 14:50:23.302889 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.303198 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f348f9e962748a0992d85b9d3d72aeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.304868 9360 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.306804 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 82b042c6ffc148939dcba9b710f198d3 (DEFAULT_TABLE table=default.Table_8522c5741c0547aba590628989bcf58e [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.306891 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.307189 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b042c6ffc148939dcba9b710f198d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.307327 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.307550 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e3c8ef3e20451dbf91b671655974e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.307789 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet ce25abb4559241f58054f27435fd6078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.308329 9256 tablet_service.cc:1467] Processing CreateTablet for tablet b9f843006a1e43a49f177433c7a3e1ea (DEFAULT_TABLE table=default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.308701 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f843006a1e43a49f177433c7a3e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.309669 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.310663 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 1738a95895914cc4936a38e1d189d538 (DEFAULT_TABLE table=default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.310959 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1738a95895914cc4936a38e1d189d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.313799 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1738a95895914cc4936a38e1d189d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.313856 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 32e7e11092d1475cba53e51a0f61d6f1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.314620 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_71ce0c67c5c44812bcd7181bb4b27fe4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.315133 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71ce0c67c5c44812bcd7181bb4b27fe4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.317250 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.317968 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 3f8db468ad3c4bba8c701c3d8feba9f4 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:23.319939 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdadb919c4554e5c89f8bb19cf3ddd75 consensus state has no leader
I20260928 14:50:23.320154 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:23.320554 8951 catalog_manager.cc:6565] ReplaceTablet: tablet 3c2b819b194d4373a59a3e94267361c1 deleted and replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8
W20260928 14:50:23.320998 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82b042c6ffc148939dcba9b710f198d3 consensus state has no leader
I20260928 14:50:23.323571 9252 tablet_service.cc:1467] Processing CreateTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 (DEFAULT_TABLE table=default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.323956 9255 tablet_service.cc:1467] Processing CreateTablet for tablet ca7fa45e25b0455e92412b844cd78cdc (DEFAULT_TABLE table=default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.324431 9265 tablet_service.cc:1467] Processing CreateTablet for tablet d199c65d3b4040388360fd8302d7cb8c (DEFAULT_TABLE table=default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.329274 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b042c6ffc148939dcba9b710f198d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.329242 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce25abb4559241f58054f27435fd6078" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:23.329864 9360 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.330016 9360 leader_election.cc:302] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.330121 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.330425 10029 raft_consensus.cc:2726] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.330531 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.332638 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.333055 9995 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: acquiring CA information for follower catalog manager: success
I20260928 14:50:23.337426 9813 ts_tablet_manager.cc:1918] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.337603 9813 log.cc:1196] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/555b1577a6a1486e93e78125431ab215
I20260928 14:50:23.337967 9813 ts_tablet_manager.cc:1939] T 555b1577a6a1486e93e78125431ab215 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.339375 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 555b1577a6a1486e93e78125431ab215 (table default.Table_5cf2132eafc942ba8344d4eb8869ab1d [id=283ef53f09744a14b652fcb6e4ddc052]) successfully deleted
I20260928 14:50:23.341327 9848 tablet_bootstrap.cc:492] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.341490 9848 ts_tablet_manager.cc:1397] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.137s user 0.023s sys 0.030s
I20260928 14:50:23.342396 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet ce25abb4559241f58054f27435fd6078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.342360 9848 raft_consensus.cc:348] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.342517 9813 tablet_replica.cc:330] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.342579 9848 raft_consensus.cc:374] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.342644 9848 raft_consensus.cc:729] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.342763 9813 raft_consensus.cc:2229] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:23.342975 9813 pending_rounds.cc:62] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:23.342886 9848 consensus_queue.cc:260] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.343048 9813 pending_rounds.cc:68] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326366088949760 op_type: NO_OP noop_request { }
I20260928 14:50:23.343156 9813 raft_consensus.cc:2866] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:23.345031 9848 ts_tablet_manager.cc:1428] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:23.345161 9813 raft_consensus.cc:2258] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.345424 9848 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.347388 9848 tablet_bootstrap.cc:654] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.348801 9813 ts_tablet_manager.cc:1905] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.355247 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 1738a95895914cc4936a38e1d189d538 (DEFAULT_TABLE table=default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.355832 9536 tablet_service.cc:1467] Processing CreateTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 (DEFAULT_TABLE table=default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.356536 9995 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 14:50:23.358615 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1738a95895914cc4936a38e1d189d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.359370 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd9f9cb48a945d19420a8bdb9bb9576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.359509 9848 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.359642 9848 ts_tablet_manager.cc:1397] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260928 14:50:23.360651 9848 raft_consensus.cc:348] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.360927 9848 raft_consensus.cc:374] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.361078 9848 raft_consensus.cc:729] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.361312 9539 tablet_service.cc:1467] Processing CreateTablet for tablet d199c65d3b4040388360fd8302d7cb8c (DEFAULT_TABLE table=default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.361328 9848 consensus_queue.cc:260] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.361992 9848 ts_tablet_manager.cc:1428] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:23.362315 9848 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.363924 9848 tablet_bootstrap.cc:654] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.358484 9543 tablet_service.cc:1467] Processing CreateTablet for tablet ca7fa45e25b0455e92412b844cd78cdc (DEFAULT_TABLE table=default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.364023 9813 ts_tablet_manager.cc:1918] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:23.366914 9813 log.cc:1196] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/315c446d87c84ae4bc9cb3243dca5538
I20260928 14:50:23.368739 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d199c65d3b4040388360fd8302d7cb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.369488 9813 ts_tablet_manager.cc:1939] T 315c446d87c84ae4bc9cb3243dca5538 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.370242 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 315c446d87c84ae4bc9cb3243dca5538 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
W20260928 14:50:23.371253 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0e53b8b73b37464687d343493d186660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e53b8b73b37464687d343493d186660 already in progress: creating tablet
I20260928 14:50:23.371979 9813 tablet_replica.cc:330] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.372339 9813 raft_consensus.cc:2229] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.373246 9813 raft_consensus.cc:2258] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.378028 9813 ts_tablet_manager.cc:1905] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.382026 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca7fa45e25b0455e92412b844cd78cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.385048 9813 ts_tablet_manager.cc:1918] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.385216 9813 log.cc:1196] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:23.385697 9848 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.385895 9848 ts_tablet_manager.cc:1397] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.000s
I20260928 14:50:23.372236 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (DEFAULT_TABLE table=default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.386636 9848 raft_consensus.cc:348] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.386996 10029 raft_consensus.cc:482] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.387111 10029 raft_consensus.cc:504] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.387691 10029 leader_election.cc:288] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.388224 9848 raft_consensus.cc:374] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.388352 9848 raft_consensus.cc:729] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:23.389261 9360 leader_election.cc:341] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:23.389449 9848 consensus_queue.cc:260] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.390439 9848 ts_tablet_manager.cc:1428] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:23.390794 9848 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.392359 9848 tablet_bootstrap.cc:654] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.397082 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.398345 9538 tablet_service.cc:1467] Processing CreateTablet for tablet c556381a95fa42e284dab68a7f401e63 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.398727 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.398948 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.398998 9813 ts_tablet_manager.cc:1939] T 63792bb2d5b54463a701c9e4e5f095e0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.399125 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 767958659f4f450497eb5f2a3902993e (DEFAULT_TABLE table=default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.399444 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.399758 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 (DEFAULT_TABLE table=default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.399925 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 63792bb2d5b54463a701c9e4e5f095e0 (table default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]) successfully deleted
I20260928 14:50:23.400063 9549 tablet_service.cc:1467] Processing CreateTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 (DEFAULT_TABLE table=default.Table_f01267d094954f7c847b2dc00adbabb1 [id=23a200906c414328a1fdd9624c105637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.400439 9534 tablet_service.cc:1467] Processing CreateTablet for tablet afe58ef9809540cb942e3ec44296e36f (DEFAULT_TABLE table=default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.400815 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a753aaf7f8c4498b6ba35fa27d8c537. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.401769 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 311e4286b2a943ee924ac1c25dc9ca46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 311e4286b2a943ee924ac1c25dc9ca46 already in progress: creating tablet
W20260928 14:50:23.402465 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 32e7e11092d1475cba53e51a0f61d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e7e11092d1475cba53e51a0f61d6f1 already in progress: creating tablet
I20260928 14:50:23.404965 9813 tablet_replica.cc:330] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.405169 9813 raft_consensus.cc:2229] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.405401 9813 raft_consensus.cc:2258] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.405987 9813 ts_tablet_manager.cc:1905] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.409642 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e3c8ef3e20451dbf91b671655974e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.411080 9848 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.411226 9848 ts_tablet_manager.cc:1397] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
I20260928 14:50:23.412029 9848 raft_consensus.cc:348] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.412240 9848 raft_consensus.cc:374] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.412328 9848 raft_consensus.cc:729] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.412528 9848 consensus_queue.cc:260] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.412948 9848 ts_tablet_manager.cc:1428] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:23.413201 9848 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.414701 9848 tablet_bootstrap.cc:654] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.416833 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767958659f4f450497eb5f2a3902993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.427098 9813 ts_tablet_manager.cc:1918] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.427565 9813 log.cc:1196] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:23.428061 9813 ts_tablet_manager.cc:1939] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.429073 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d0f099714e924a968fbd792e5f69bba4 (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
W20260928 14:50:23.430151 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c9cee872de1f4ce8b803cb8e8fb018d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9cee872de1f4ce8b803cb8e8fb018d2 already in progress: creating tablet
W20260928 14:50:23.430979 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 066df778654449bda96f68b5035c4d73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 066df778654449bda96f68b5035c4d73 already in progress: creating tablet
W20260928 14:50:23.431804 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7cc4c49a4962473699103528b64a1005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc4c49a4962473699103528b64a1005 already in progress: creating tablet
I20260928 14:50:23.432308 9813 tablet_replica.cc:330] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.432915 9813 raft_consensus.cc:2229] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.433171 9813 raft_consensus.cc:2258] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.434409 9813 ts_tablet_manager.cc:1905] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.442070 9848 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.442227 9848 ts_tablet_manager.cc:1397] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.002s
I20260928 14:50:23.442938 9848 raft_consensus.cc:348] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.443264 9848 raft_consensus.cc:374] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.443346 9848 raft_consensus.cc:729] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.443727 9848 consensus_queue.cc:260] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.444059 9546 tablet_service.cc:1467] Processing CreateTablet for tablet f1f9b6cbf2d949839216e807130b2eb9 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.444361 9848 ts_tablet_manager.cc:1428] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:23.444669 9848 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.447274 9848 tablet_bootstrap.cc:654] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.454972 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89035a3d41a4af78a8e7afbdb89c7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.451354 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.457582 9813 ts_tablet_manager.cc:1918] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.457852 9813 log.cc:1196] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ce25abb4559241f58054f27435fd6078
I20260928 14:50:23.457995 9848 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.458174 9848 ts_tablet_manager.cc:1397] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260928 14:50:23.458695 9813 ts_tablet_manager.cc:1939] T ce25abb4559241f58054f27435fd6078 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.459219 9848 raft_consensus.cc:348] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.459580 9848 raft_consensus.cc:374] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.459710 9848 raft_consensus.cc:729] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.459990 9848 consensus_queue.cc:260] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.460526 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ce25abb4559241f58054f27435fd6078 (table default.Table_ab8b665217b04cf7a742ad3a5bda5573 [id=a95034bdd2ac4f5e9a36e1e16b407355]) successfully deleted
I20260928 14:50:23.460623 9848 ts_tablet_manager.cc:1428] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:23.460866 9848 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.461062 9813 tablet_replica.cc:330] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.461375 9813 raft_consensus.cc:2229] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.468255 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bea51859e0c4bc984288f94c2fcea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.469203 9813 raft_consensus.cc:2258] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.469589 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.470610 9848 tablet_bootstrap.cc:654] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.472105 9813 ts_tablet_manager.cc:1905] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.473578 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe58ef9809540cb942e3ec44296e36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.476610 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:23.477790 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.478447 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.482969 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c556381a95fa42e284dab68a7f401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.484786 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f9b6cbf2d949839216e807130b2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.486704 9848 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.487036 9848 ts_tablet_manager.cc:1397] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.000s
I20260928 14:50:23.489110 9848 raft_consensus.cc:348] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.489665 9848 raft_consensus.cc:374] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.489867 9848 raft_consensus.cc:729] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.490309 9848 consensus_queue.cc:260] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.491415 9848 ts_tablet_manager.cc:1428] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:23.492017 9848 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.497725 9848 tablet_bootstrap.cc:654] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.502611 9813 ts_tablet_manager.cc:1918] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.502856 9813 log.cc:1196] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/894af8262a004e41a6ccc2641f8f7605
I20260928 14:50:23.503667 9813 ts_tablet_manager.cc:1939] T 894af8262a004e41a6ccc2641f8f7605 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.505200 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 894af8262a004e41a6ccc2641f8f7605 (table default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]) successfully deleted
W20260928 14:50:23.506140 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f3ac8adb23c5478fadb6cb6765459913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3ac8adb23c5478fadb6cb6765459913 already in progress: creating tablet
W20260928 14:50:23.507313 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3c2b819b194d4373a59a3e94267361c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2b819b194d4373a59a3e94267361c1 already in progress: creating tablet
W20260928 14:50:23.508839 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4bea51859e0c4bc984288f94c2fcea2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bea51859e0c4bc984288f94c2fcea2e already in progress: creating tablet
I20260928 14:50:23.513895 9848 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.514040 9848 ts_tablet_manager.cc:1397] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.007s
I20260928 14:50:23.514887 9848 raft_consensus.cc:348] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.515184 9848 raft_consensus.cc:374] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.515421 9848 raft_consensus.cc:729] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.515764 9848 consensus_queue.cc:260] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.516657 9848 ts_tablet_manager.cc:1428] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 14:50:23.517046 9848 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.520313 9848 tablet_bootstrap.cc:654] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.533986 9855 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:23.534169 9855 ts_tablet_manager.cc:1397] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.531s user 0.020s sys 0.034s
I20260928 14:50:23.534886 9855 raft_consensus.cc:348] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.535130 9855 raft_consensus.cc:374] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.535194 9855 raft_consensus.cc:729] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.535408 9855 consensus_queue.cc:260] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.539837 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbd9f9cb48a945d19420a8bdb9bb9576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.540350 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d199c65d3b4040388360fd8302d7cb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.540588 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca7fa45e25b0455e92412b844cd78cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.541842 9851 tablet_bootstrap.cc:492] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:23.543171 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e (DEFAULT_TABLE table=default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.543520 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bea51859e0c4bc984288f94c2fcea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.543562 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84d5571edfa649fcb6d2b43b7c99f1e9" } modify_external_catalogs: true
I20260928 14:50:23.543754 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84d5571edfa649fcb6d2b43b7c99f1e9" } modify_external_catalogs: true
W20260928 14:50:23.546180 9821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s user 0.009s sys 0.019s
I20260928 14:50:23.546264 9855 ts_tablet_manager.cc:1428] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.012s user 0.003s sys 0.004s
W20260928 14:50:23.546341 9821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s user 0.009s sys 0.019s
I20260928 14:50:23.546808 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_73404af3072b48e8bec8e4a727523609" } modify_external_catalogs: true
I20260928 14:50:23.546974 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_73404af3072b48e8bec8e4a727523609" } modify_external_catalogs: true
I20260928 14:50:23.548154 9855 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:23.548993 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0628bbb0b50640ff9da42eef50691d9d" } modify_external_catalogs: true
I20260928 14:50:23.549182 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0628bbb0b50640ff9da42eef50691d9d" } modify_external_catalogs: true
I20260928 14:50:23.551250 9851 ts_tablet_manager.cc:1397] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.479s user 0.002s sys 0.001s
I20260928 14:50:23.551440 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0f099714e924a968fbd792e5f69bba4" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.551784 9855 tablet_bootstrap.cc:654] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.551987 9286 raft_consensus.cc:2454] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.552564 9360 leader_election.cc:302] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:23.552783 9360 raft_consensus.cc:2670] T d0f099714e924a968fbd792e5f69bba4 P ae832871bd1142f7af10c084115ffc12: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:23.552701 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_75ebbf9cfadf40a6860cc3f8e3ba8df0" } new_table_name: "default.Table_f47141b8eb2943ac80856e2e37111856" modify_external_catalogs: true
I20260928 14:50:23.552836 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_09403204efb345808fc758bce9e3fb5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.553360 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09403204efb345808fc758bce9e3fb5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.557942 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_09b3fe6038b848ba945df814e1a6c8bf" } new_table_name: "default.Table_7df4761c9b5d4ff889efaabd26915a37" modify_external_catalogs: true
W20260928 14:50:23.560920 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c9cee872de1f4ce8b803cb8e8fb018d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9cee872de1f4ce8b803cb8e8fb018d2 already in progress: creating tablet
W20260928 14:50:23.561216 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 066df778654449bda96f68b5035c4d73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 066df778654449bda96f68b5035c4d73 already in progress: creating tablet
W20260928 14:50:23.561627 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7cc4c49a4962473699103528b64a1005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc4c49a4962473699103528b64a1005 already in progress: creating tablet
W20260928 14:50:23.561915 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ce25abb4559241f58054f27435fd6078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce25abb4559241f58054f27435fd6078 already in progress: creating tablet
W20260928 14:50:23.562361 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f3ac8adb23c5478fadb6cb6765459913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3ac8adb23c5478fadb6cb6765459913 already in progress: creating tablet
I20260928 14:50:23.566030 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (DEFAULT_TABLE table=default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.569307 9855 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:23.569543 9855 ts_tablet_manager.cc:1397] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20260928 14:50:23.569713 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a753aaf7f8c4498b6ba35fa27d8c537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.570473 9855 raft_consensus.cc:348] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.570837 9855 raft_consensus.cc:374] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.571134 9855 raft_consensus.cc:729] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.571532 9855 consensus_queue.cc:260] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.572400 9855 ts_tablet_manager.cc:1428] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:23.572778 9855 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:23.576803 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4bea51859e0c4bc984288f94c2fcea2e because the tablet was not found. No further retry: Not found: Tablet not found: 4bea51859e0c4bc984288f94c2fcea2e
W20260928 14:50:23.577255 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3c2b819b194d4373a59a3e94267361c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2b819b194d4373a59a3e94267361c1 already in progress: creating tablet
I20260928 14:50:23.580585 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5acbe80699db42c9a3d1d00365be633d" } new_table_name: "default.Table_5691c7f9b2304012b66ce7f4b04cf947" modify_external_catalogs: true
I20260928 14:50:23.581295 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 051b7f0b1d0f4f638f3e7a69a027196e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.581812 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet f3ac8adb23c5478fadb6cb6765459913 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:23.582264 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c" } modify_external_catalogs: true
I20260928 14:50:23.582463 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c" } modify_external_catalogs: true
I20260928 14:50:23.583645 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet dd70cf6ee2d343878c90ae4818f1eb8f
I20260928 14:50:23.583940 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c93036c59a7a4b62994b6a2761851a1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.584451 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93036c59a7a4b62994b6a2761851a1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.584343 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f059d30d44564a2689382ef6ab37e7d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.584609 9821 consensus_queue.cc:1035] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:23.584828 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f059d30d44564a2689382ef6ab37e7d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.585813 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:23.585829 10029 raft_consensus.cc:482] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.586004 10029 raft_consensus.cc:504] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.586333 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7fef1dc0110344edb4f6e3ffb68382c0" } modify_external_catalogs: true
I20260928 14:50:23.586515 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7fef1dc0110344edb4f6e3ffb68382c0" } modify_external_catalogs: true
I20260928 14:50:23.586611 10029 leader_election.cc:288] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.587767 8954 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 14d917035d7547aca30bbb91f32e37e5
I20260928 14:50:23.588140 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5686e39c7ea54cef8e5e4e5570f30b00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.588578 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5686e39c7ea54cef8e5e4e5570f30b00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.589061 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b998502f90a4df08b4078f833ad8c05" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.589304 9569 raft_consensus.cc:2454] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.589726 9360 leader_election.cc:302] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:23.589848 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 091600d56fdc469d8b754acd8933808b consensus state has no leader
I20260928 14:50:23.590111 10029 raft_consensus.cc:2781] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.590204 10029 raft_consensus.cc:482] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.590302 10029 raft_consensus.cc:3037] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.590466 9827 raft_consensus.cc:482] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.590471 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bd5ccd4f42694ce1b58645b61e1a380f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.590595 9827 raft_consensus.cc:504] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:23.591014 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd5ccd4f42694ce1b58645b61e1a380f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.591121 9827 leader_election.cc:288] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.593042 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.593627 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6153a2da670a4ced9fcc45cb16cdb91e" } new_table_name: "default.Table_3b55641c17274c3892109312ab176330" modify_external_catalogs: true
I20260928 14:50:23.594422 10029 raft_consensus.cc:504] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.595700 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.595690 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fab191faa15444d5b265c05a6ad8f3d7" } new_table_name: "default.Table_ea9c8d7bd23a4c1997dbdb43ec245185" modify_external_catalogs: true
I20260928 14:50:23.596012 9569 raft_consensus.cc:2454] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
W20260928 14:50:23.596405 9360 leader_election.cc:341] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.595718 9266 tablet_service.cc:1467] Processing CreateTablet for tablet afe58ef9809540cb942e3ec44296e36f (DEFAULT_TABLE table=default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.597594 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b998502f90a4df08b4078f833ad8c05" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:23.597895 9569 raft_consensus.cc:3037] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.598491 9247 tablet_service.cc:1467] Processing CreateTablet for tablet f1f9b6cbf2d949839216e807130b2eb9 (DEFAULT_TABLE table=default.Table_102c885d8b48453a84696844fe43f393 [id=3d4e8c920b14490fb8d10202db71bb52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.598783 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.599049 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.599400 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:23.601068 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet dd70cf6ee2d343878c90ae4818f1eb8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd70cf6ee2d343878c90ae4818f1eb8f already in progress: creating tablet
I20260928 14:50:23.601114 9569 raft_consensus.cc:2454] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
W20260928 14:50:23.601367 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d199c65d3b4040388360fd8302d7cb8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d199c65d3b4040388360fd8302d7cb8c already in progress: creating tablet
I20260928 14:50:23.601419 9360 leader_election.cc:302] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.601997 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe58ef9809540cb942e3ec44296e36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.602051 9827 raft_consensus.cc:2781] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.602155 9827 raft_consensus.cc:482] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.602146 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:23.602250 9827 raft_consensus.cc:3037] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.602617 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 3f8db468ad3c4bba8c701c3d8feba9f4 deleted and replaced by tablet 7ef356a4c9d34af4b300d38eab49a569
I20260928 14:50:23.602993 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ac61e6a117344388a152319868485978"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:23.603590 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac61e6a117344388a152319868485978 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.604859 9827 raft_consensus.cc:504] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.605422 9827 leader_election.cc:288] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.606757 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:23.607540 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f8db468ad3c4bba8c701c3d8feba9f4 already in progress: creating tablet
I20260928 14:50:23.614172 9360 leader_election.cc:302] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:23.614951 9827 raft_consensus.cc:2781] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.615540 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:23.615927 9569 raft_consensus.cc:3037] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.617708 10029 leader_election.cc:288] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.622299 9855 tablet_bootstrap.cc:654] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.622720 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.628012 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_47b8571c3cd34d6080638815b62259d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.628415 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 4025017d30034ea3adc6b5fd55d18617 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:23.628687 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b8571c3cd34d6080638815b62259d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:23.628883 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:23.629469 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 8296732efcb349ab9cc87e3ff1e11fd0 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:23.630518 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc8400fdb8d948b084733011b16df1b3 consensus state has no leader
I20260928 14:50:23.631829 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:23.632531 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebaf10326ec24b99ae2ab1ba8779d1a3 already in progress: creating tablet
I20260928 14:50:23.633490 9827 raft_consensus.cc:686] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:23.633769 9827 consensus_queue.cc:237] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.601903 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 767958659f4f450497eb5f2a3902993e (DEFAULT_TABLE table=default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:23.636574 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 55541.8us
I20260928 14:50:23.638409 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c8624f9349a4608a48943487f01c7c8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:23.639108 9360 leader_election.cc:341] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.638031 9569 raft_consensus.cc:2454] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
W20260928 14:50:23.640488 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4bd612753b914a079ccf89249b073018 consensus state has no leader
W20260928 14:50:23.640707 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b has no consensus state
I20260928 14:50:23.641064 9360 leader_election.cc:302] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.641535 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f9b6cbf2d949839216e807130b2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.641557 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b998502f90a4df08b4078f833ad8c05" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:23.643289 9360 leader_election.cc:341] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.643522 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b998502f90a4df08b4078f833ad8c05" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:23.643991 9360 leader_election.cc:341] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.645917 10029 raft_consensus.cc:2781] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.646286 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767958659f4f450497eb5f2a3902993e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.647390 9257 tablet_service.cc:1467] Processing CreateTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 (DEFAULT_TABLE table=default.Table_f01267d094954f7c847b2dc00adbabb1 [id=23a200906c414328a1fdd9624c105637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.647286 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 894af8262a004e41a6ccc2641f8f7605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.649061 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89035a3d41a4af78a8e7afbdb89c7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.649842 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 105) took 1512 ms. Trace:
I20260928 14:50:23.654201 10029 raft_consensus.cc:686] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:23.654603 10029 consensus_queue.cc:237] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.655931 9398 tablet_service.cc:1467] Processing CreateTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 (DEFAULT_TABLE table=default.Table_e1682c926dbb4ce884db79cdac24b3f9 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.656390 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dacb0eef514609bcaf503ccc9845e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.660136 9814 rpcz_store.cc:276] 0928 14:50:22.062233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.062290 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:23.114719 (+1052429us) ts_tablet_manager.cc:1145] Deleting tablet b04e1f1977af4af8aed072bbd77e6f4c
0928 14:50:23.114729 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.160381 (+ 45652us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.297833 (+137452us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.574218 (+276385us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1052165}
I20260928 14:50:23.660739 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 (DEFAULT_TABLE table=default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.661017 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4025017d30034ea3adc6b5fd55d18617
I20260928 14:50:23.661154 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e3c8ef3e20451dbf91b671655974e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.661499 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 4025017d30034ea3adc6b5fd55d18617 deleted and replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea
I20260928 14:50:23.650722 9851 raft_consensus.cc:348] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.662729 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4025017d30034ea3adc6b5fd55d18617 with delete_type TABLET_DATA_DELETED (replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.662998 9813 tablet_replica.cc:330] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.663077 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 108) took 1560 ms. Trace:
I20260928 14:50:23.663261 9813 raft_consensus.cc:2229] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.663233 9814 rpcz_store.cc:276] 0928 14:50:22.102150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.102214 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:23.660583 (+1558369us) ts_tablet_manager.cc:1145] Deleting tablet 5a64ffa786f045b480efe51eb69d7074
0928 14:50:23.660596 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.663014 (+ 2418us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1539704}
I20260928 14:50:23.663774 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 109) took 1560 ms. Trace:
I20260928 14:50:23.663932 9814 rpcz_store.cc:276] 0928 14:50:22.103286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.103340 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:23.663613 (+1560273us) ts_tablet_manager.cc:1145] Deleting tablet 03245f72e0aa496d895968d8e5715b56
0928 14:50:23.663626 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.663719 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1542538}
I20260928 14:50:23.664407 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 107) took 1562 ms. Trace:
I20260928 14:50:23.664726 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.665297 9855 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:23.665460 9855 ts_tablet_manager.cc:1397] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.002s
I20260928 14:50:23.665723 9264 tablet_service.cc:1467] Processing CreateTablet for tablet c556381a95fa42e284dab68a7f401e63 (DEFAULT_TABLE table=default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.666110 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c556381a95fa42e284dab68a7f401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.666206 9855 raft_consensus.cc:348] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.666590 9855 raft_consensus.cc:374] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.666759 9855 raft_consensus.cc:729] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.667047 9855 consensus_queue.cc:260] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.667740 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.667832 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:23.668221 8948 catalog_manager.cc:6565] ReplaceTablet: tablet 8296732efcb349ab9cc87e3ff1e11fd0 deleted and replaced by tablet 1f012857690f4f91a941a5f642b9c989
I20260928 14:50:23.669018 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.670949 9855 ts_tablet_manager.cc:1428] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:23.671248 9855 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:23.680596 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.681051 9851 raft_consensus.cc:374] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.683185 9821 consensus_queue.cc:1035] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.690640 9855 tablet_bootstrap.cc:654] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.692354 9813 pending_rounds.cc:62] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
W20260928 14:50:23.698105 9498 consensus_peers.cc:487] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:23.698910 9813 pending_rounds.cc:68] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326365451296768 op_type: NO_OP noop_request { }
I20260928 14:50:23.699218 9813 raft_consensus.cc:2866] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:23.700505 9813 raft_consensus.cc:2258] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.701927 9813 ts_tablet_manager.cc:1905] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.703447 9855 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:23.703591 9855 ts_tablet_manager.cc:1397] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260928 14:50:23.697849 9287 raft_consensus.cc:1261] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Refusing update from remote peer ae832871bd1142f7af10c084115ffc12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.714222 10062 consensus_queue.cc:1035] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.714469 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "605ccf9ad9ca4eb985374e065c48601a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:23.714668 9428 raft_consensus.cc:3037] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.717316 9428 raft_consensus.cc:2454] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:23.720269 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d27738fcfbc42f298e26149dfd28182" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:23.720541 9428 raft_consensus.cc:3037] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.720486 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81f1875265642c3a428e658dca558d0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:23.722479 9848 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.722672 9848 ts_tablet_manager.cc:1397] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.206s user 0.041s sys 0.103s
I20260928 14:50:23.723520 9848 raft_consensus.cc:348] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.723694 9428 raft_consensus.cc:2454] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:23.723768 9848 raft_consensus.cc:374] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.724993 9848 raft_consensus.cc:729] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.725236 9848 consensus_queue.cc:260] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.725875 9827 raft_consensus.cc:482] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.726027 9827 raft_consensus.cc:504] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.725914 9848 ts_tablet_manager.cc:1428] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:23.726570 9827 leader_election.cc:288] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.726867 9848 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.730149 9848 tablet_bootstrap.cc:654] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.730260 9813 ts_tablet_manager.cc:1918] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:23.730432 9813 log.cc:1196] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4025017d30034ea3adc6b5fd55d18617
I20260928 14:50:23.730947 9813 ts_tablet_manager.cc:1939] T 4025017d30034ea3adc6b5fd55d18617 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.733239 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4025017d30034ea3adc6b5fd55d18617 (table default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]) successfully deleted
I20260928 14:50:23.733467 10054 raft_consensus.cc:482] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.733812 9855 raft_consensus.cc:348] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.734021 9855 raft_consensus.cc:374] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:23.734216 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8296732efcb349ab9cc87e3ff1e11fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8296732efcb349ab9cc87e3ff1e11fd0 already in progress: creating tablet
I20260928 14:50:23.734017 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:23.734830 9360 leader_election.cc:341] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.735078 9855 raft_consensus.cc:729] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.735321 9855 consensus_queue.cc:260] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.736311 9855 ts_tablet_manager.cc:1428] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260928 14:50:23.738363 9855 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:23.733664 10054 raft_consensus.cc:504] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.741685 10054 leader_election.cc:288] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.741820 10066 raft_consensus.cc:482] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.741989 10066 raft_consensus.cc:504] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:23.742427 9498 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: ce25abb4559241f58054f27435fd6078
I20260928 14:50:23.742827 10066 leader_election.cc:288] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.743067 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.743327 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeda483866146f89198e6f14456f0f2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:23.743521 9428 raft_consensus.cc:2454] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:23.743875 9498 leader_election.cc:302] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:23.743903 9360 leader_election.cc:341] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.744027 9360 leader_election.cc:302] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.744109 10066 raft_consensus.cc:2781] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.744203 10066 raft_consensus.cc:482] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.744261 10062 raft_consensus.cc:2726] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.744282 10066 raft_consensus.cc:3037] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.745762 9851 raft_consensus.cc:729] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.746196 10066 raft_consensus.cc:504] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.746819 10066 leader_election.cc:288] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.747296 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeda483866146f89198e6f14456f0f2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:23.747486 9428 raft_consensus.cc:3037] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.747900 9855 tablet_bootstrap.cc:654] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.750597 9428 raft_consensus.cc:2454] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:23.751029 9498 leader_election.cc:302] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:23.753453 10062 raft_consensus.cc:482] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.753615 10062 raft_consensus.cc:504] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.753979 10066 raft_consensus.cc:2781] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.754160 10062 leader_election.cc:288] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.754380 10066 raft_consensus.cc:686] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:23.754606 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.754674 10066 consensus_queue.cc:237] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.754805 9568 raft_consensus.cc:2454] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.664561 9814 rpcz_store.cc:276] 0928 14:50:22.101415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.101464 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:23.664252 (+1562788us) ts_tablet_manager.cc:1145] Deleting tablet cf2dd699271542bd9b9604e746686c53
0928 14:50:23.664263 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.664351 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1543027}
I20260928 14:50:23.755466 9360 leader_election.cc:302] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:23.755795 10062 raft_consensus.cc:2781] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.755900 10062 raft_consensus.cc:482] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.755985 10062 raft_consensus.cc:3037] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.758606 10062 raft_consensus.cc:504] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.759769 10062 leader_election.cc:288] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.759943 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:23.760134 9568 raft_consensus.cc:3037] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.761304 9569 raft_consensus.cc:1261] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer ae832871bd1142f7af10c084115ffc12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.761900 10062 consensus_queue.cc:1035] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.762795 9568 raft_consensus.cc:2454] T 0795ca09ecfe433195e016d5d1f0dbc0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:23.763279 9360 leader_election.cc:302] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:23.763566 10062 raft_consensus.cc:2781] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.763888 10062 raft_consensus.cc:686] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:23.764153 10062 consensus_queue.cc:237] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.767556 9848 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.767726 9848 ts_tablet_manager.cc:1397] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.004s
I20260928 14:50:23.768556 9848 raft_consensus.cc:348] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.768896 9848 raft_consensus.cc:374] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.769011 9848 raft_consensus.cc:729] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.769233 9848 consensus_queue.cc:260] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.769927 9848 ts_tablet_manager.cc:1428] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:23.770241 9848 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.771337 9855 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:23.771512 9855 ts_tablet_manager.cc:1397] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.002s
I20260928 14:50:23.772416 9855 raft_consensus.cc:348] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.772675 9855 raft_consensus.cc:374] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.772754 9855 raft_consensus.cc:729] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.772960 9855 consensus_queue.cc:260] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.773874 10054 raft_consensus.cc:482] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.774034 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce25abb4559241f58054f27435fd6078" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.774502 9848 tablet_bootstrap.cc:654] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.770004 9851 consensus_queue.cc:260] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.772586 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeda483866146f89198e6f14456f0f2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.776157 10054 raft_consensus.cc:504] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.777968 10054 leader_election.cc:288] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:23.777204 9497 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.778312 9497 leader_election.cc:302] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.779322 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8131f32f1a4153abf2967ca0a11619" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.779815 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeda483866146f89198e6f14456f0f2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:23.780665 9498 leader_election.cc:341] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:23.780647 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.781863 10057 mvcc.cc:205] Tried to move back new op lower bound from 7334326368813883392 to 7334326365847654400. Current Snapshot: MvccSnapshot[applied={T|T < 7334326368813883392}]
W20260928 14:50:23.782713 9497 leader_election.cc:341] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.781260 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 110) took 1637 ms. Trace:
W20260928 14:50:23.782999 9497 leader_election.cc:341] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.783234 10054 raft_consensus.cc:2726] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.782346 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0795ca09ecfe433195e016d5d1f0dbc0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.780821 9285 raft_consensus.cc:2454] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:23.783973 9851 ts_tablet_manager.cc:1428] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.229s user 0.001s sys 0.001s
I20260928 14:50:23.784298 9851 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:23.786720 9851 tablet_bootstrap.cc:654] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.786840 9855 ts_tablet_manager.cc:1428] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:23.787137 9855 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:23.788389 9848 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.788544 9848 ts_tablet_manager.cc:1397] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260928 14:50:23.788576 9855 tablet_bootstrap.cc:654] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.789817 9814 rpcz_store.cc:276] 0928 14:50:22.135886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.135937 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:23.755076 (+1619139us) ts_tablet_manager.cc:1145] Deleting tablet def872f66b2541b9af6084e93d991ec2
0928 14:50:23.755084 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.772882 (+ 17798us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618748}
I20260928 14:50:23.791360 9814 tablet_replica.cc:330] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:23.791616 9814 raft_consensus.cc:2229] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.791854 9814 raft_consensus.cc:2258] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.792434 9814 ts_tablet_manager.cc:1905] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.795353 9848 raft_consensus.cc:348] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.795579 9848 raft_consensus.cc:374] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.795660 9848 raft_consensus.cc:729] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.795874 9848 consensus_queue.cc:260] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.785359 10068 raft_consensus.cc:482] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.799255 9848 ts_tablet_manager.cc:1428] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:23.799544 9848 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.799283 10068 raft_consensus.cc:504] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.799948 9283 raft_consensus.cc:2454] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:23.800472 9497 leader_election.cc:302] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.800837 10054 raft_consensus.cc:2781] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.800969 10054 raft_consensus.cc:482] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.801059 10054 raft_consensus.cc:3037] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.801419 10077 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:23.801512 10068 leader_election.cc:288] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:23.802096 9263 consensus_meta.cc:287] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Time spent flushing consensus metadata: real 0.501s user 0.001s sys 0.003s
I20260928 14:50:23.803293 9848 tablet_bootstrap.cc:654] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.803699 10054 raft_consensus.cc:504] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:23.805096 9498 leader_election.cc:341] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:23.805409 10054 leader_election.cc:288] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.805699 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8131f32f1a4153abf2967ca0a11619" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.805888 9283 raft_consensus.cc:3037] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.807034 10078 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:23.808256 9283 raft_consensus.cc:2454] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:23.808714 9497 leader_election.cc:302] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.808939 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8131f32f1a4153abf2967ca0a11619" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.809232 9569 raft_consensus.cc:2379] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:23.814925 9848 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.815560 9848 ts_tablet_manager.cc:1397] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.002s
I20260928 14:50:23.816226 9851 tablet_bootstrap.cc:492] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:23.816418 9851 ts_tablet_manager.cc:1397] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.003s
I20260928 14:50:23.816272 9848 raft_consensus.cc:348] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.816509 9848 raft_consensus.cc:374] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.816601 9848 raft_consensus.cc:729] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.816809 9848 consensus_queue.cc:260] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.817314 9851 raft_consensus.cc:348] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.817626 9851 raft_consensus.cc:374] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.817817 9851 raft_consensus.cc:729] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.818253 9851 consensus_queue.cc:260] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.820982 9848 ts_tablet_manager.cc:1428] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:23.821261 9848 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.823693 10054 raft_consensus.cc:2781] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.823860 10054 raft_consensus.cc:686] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:23.824319 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.824342 10054 consensus_queue.cc:237] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:23.826333 9848 tablet_bootstrap.cc:654] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.834815 9848 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.845369 9848 ts_tablet_manager.cc:1397] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20260928 14:50:23.847571 9848 raft_consensus.cc:348] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.847800 9848 raft_consensus.cc:374] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.847867 9848 raft_consensus.cc:729] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.848074 9848 consensus_queue.cc:260] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.848600 9848 ts_tablet_manager.cc:1428] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260928 14:50:23.848886 9848 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:23.850272 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.850503 9848 tablet_bootstrap.cc:654] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.851006 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.852391 9549 tablet_service.cc:1467] Processing CreateTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 (DEFAULT_TABLE table=default.Table_e1682c926dbb4ce884db79cdac24b3f9 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.852759 9569 raft_consensus.cc:1261] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.852802 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.853664 10070 consensus_queue.cc:1035] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:23.857833 9220 leader_election.cc:341] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: b04e1f1977af4af8aed072bbd77e6f4c
I20260928 14:50:23.858119 9220 leader_election.cc:302] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.858505 9848 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:23.858651 9848 ts_tablet_manager.cc:1397] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
W20260928 14:50:23.859037 9220 raft_consensus.cc:2670] T b04e1f1977af4af8aed072bbd77e6f4c P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:23.859674 9848 raft_consensus.cc:348] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.859917 9848 raft_consensus.cc:374] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:23.860234 9848 raft_consensus.cc:729] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:23.860647 9848 consensus_queue.cc:260] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:23.861238 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d199c65d3b4040388360fd8302d7cb8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d199c65d3b4040388360fd8302d7cb8c already in progress: creating tablet
I20260928 14:50:23.861304 9848 ts_tablet_manager.cc:1428] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:23.861699 9848 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:23.862352 9220 leader_election.cc:341] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 315c446d87c84ae4bc9cb3243dca5538
W20260928 14:50:23.863056 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet dd70cf6ee2d343878c90ae4818f1eb8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd70cf6ee2d343878c90ae4818f1eb8f already in progress: creating tablet
W20260928 14:50:23.863350 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f8db468ad3c4bba8c701c3d8feba9f4 already in progress: creating tablet
I20260928 14:50:23.864326 10066 raft_consensus.cc:482] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.864835 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dacb0eef514609bcaf503ccc9845e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.865163 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.866531 9220 leader_election.cc:302] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.865888 10066 raft_consensus.cc:504] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.867676 10066 leader_election.cc:288] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.867432 10071 raft_consensus.cc:3037] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.868613 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964985f048114f53ba1e685c7f1dbd6d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:23.868667 10058 raft_consensus.cc:482] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.869040 9428 raft_consensus.cc:2454] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:23.868983 10058 raft_consensus.cc:504] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.870355 10058 leader_election.cc:288] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.870784 9851 ts_tablet_manager.cc:1428] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:23.871224 9851 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:23.873144 9851 tablet_bootstrap.cc:654] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.874159 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a64ffa786f045b480efe51eb69d7074" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:23.874794 9360 leader_election.cc:341] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.876181 9814 ts_tablet_manager.cc:1918] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.876317 9814 log.cc:1196] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:23.876770 9814 ts_tablet_manager.cc:1939] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:23.877112 10071 raft_consensus.cc:2726] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.877187 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 121) took 1655 ms. Trace:
I20260928 14:50:23.877305 9814 rpcz_store.cc:276] 0928 14:50:22.222192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.222991 (+ 799us) service_pool.cc:227] Handling call
0928 14:50:23.791082 (+1568091us) ts_tablet_manager.cc:1145] Deleting tablet d0f099714e924a968fbd792e5f69bba4
0928 14:50:23.791092 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:23.804798 (+ 13706us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.876056 (+ 71258us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:23.877154 (+ 1098us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1567855}
I20260928 14:50:23.877501 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964985f048114f53ba1e685c7f1dbd6d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.878016 10058 raft_consensus.cc:482] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:23.878211 9220 leader_election.cc:341] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: d0f099714e924a968fbd792e5f69bba4
I20260928 14:50:23.878356 9220 leader_election.cc:302] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.878295 10058 raft_consensus.cc:504] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:23.878530 9220 raft_consensus.cc:2670] T d0f099714e924a968fbd792e5f69bba4 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:23.879349 10058 leader_election.cc:288] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:23.879458 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:23.879904 9498 leader_election.cc:302] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:23.879990 9360 leader_election.cc:341] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.880574 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.880679 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 51e28b2e855542b68e3bea8180e7f606 (table default.Table_56f6005a38c2496fafff14de10939fff [id=b1bdb9cfc412450a9526f12b2da3e5da]) successfully deleted
I20260928 14:50:23.880599 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a64ffa786f045b480efe51eb69d7074" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:23.880980 9497 leader_election.cc:341] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:23.881243 9360 leader_election.cc:341] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.881371 9360 leader_election.cc:302] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.881485 10066 raft_consensus.cc:2781] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:23.881595 10066 raft_consensus.cc:482] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:23.881706 10066 raft_consensus.cc:3037] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.881812 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet b04e1f1977af4af8aed072bbd77e6f4c (table default.Table_ec0feb0e0b194af7beeb68c4666c5ea6 [id=28f6aae7f4db4617889c1c25a441ddbd]) successfully deleted
W20260928 14:50:23.882110 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5a64ffa786f045b480efe51eb69d7074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a64ffa786f045b480efe51eb69d7074 already in progress: creating tablet
W20260928 14:50:23.882361 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 03245f72e0aa496d895968d8e5715b56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03245f72e0aa496d895968d8e5715b56 already in progress: creating tablet
I20260928 14:50:23.883581 10066 raft_consensus.cc:504] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.884163 10066 leader_election.cc:288] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:23.885411 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964985f048114f53ba1e685c7f1dbd6d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:23.885663 9428 raft_consensus.cc:3037] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:23.888412 9428 raft_consensus.cc:2454] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:23.888936 9498 leader_election.cc:302] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:23.889226 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 4025017d30034ea3adc6b5fd55d18617 with delete_type TABLET_DATA_DELETED (replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.889228 10066 raft_consensus.cc:2781] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:23.889639 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964985f048114f53ba1e685c7f1dbd6d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:23.889861 9815 tablet_replica.cc:330] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:23.890427 9815 raft_consensus.cc:2229] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
W20260928 14:50:23.890524 9497 leader_election.cc:341] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:23.890703 9220 leader_election.cc:341] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 8d26550613aa4988910ec66eeb8b2f07
I20260928 14:50:23.890820 9220 leader_election.cc:302] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.891037 9815 raft_consensus.cc:2258] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.891634 10071 raft_consensus.cc:2726] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.891712 9815 ts_tablet_manager.cc:1905] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.891975 9220 leader_election.cc:302] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.894381 9427 raft_consensus.cc:1261] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.895280 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.895700 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.896770 9261 tablet_service.cc:1467] Processing CreateTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 (DEFAULT_TABLE table=default.Table_e1682c926dbb4ce884db79cdac24b3f9 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.897426 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_95aa50142a644abc89afc76523360723"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.897799 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_90d4de6f126c4de4a82a42b44755e566"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:23.897998 10071 raft_consensus.cc:2726] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:23.898051 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95aa50142a644abc89afc76523360723 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:23.898299 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90d4de6f126c4de4a82a42b44755e566 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:23.899313 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebaf10326ec24b99ae2ab1ba8779d1a3 already in progress: creating tablet
W20260928 14:50:23.899516 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8296732efcb349ab9cc87e3ff1e11fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8296732efcb349ab9cc87e3ff1e11fd0 already in progress: creating tablet
W20260928 14:50:23.899972 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cf2dd699271542bd9b9604e746686c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2dd699271542bd9b9604e746686c53 already in progress: creating tablet
I20260928 14:50:23.901862 10070 consensus_queue.cc:1035] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.902038 9398 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6b0867466459ca14413559800ff64 (DEFAULT_TABLE table=default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.902436 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6b0867466459ca14413559800ff64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.902446 9220 leader_election.cc:341] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:23.902592 9220 leader_election.cc:302] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:23.903195 10070 raft_consensus.cc:2726] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.903250 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf [id=763f6cc484294611b96035248c14066d]). Expected version 1 got 0
I20260928 14:50:23.903525 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 8700d651fd7144bd9ecc15cfedcfb434 (table default.Table_5933bd9ddd9d49e79e0c351ae30d030e [id=0219eb70be1e4602b9b5542bafc4ddf0]). Expected version 3 got 0
W20260928 14:50:23.904052 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet def872f66b2541b9af6084e93d991ec2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet def872f66b2541b9af6084e93d991ec2 already in progress: creating tablet
I20260928 14:50:23.904551 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d0f099714e924a968fbd792e5f69bba4 (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
I20260928 14:50:23.906774 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.906828 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f81f1875265642c3a428e658dca558d0 (table default.Table_f47141b8eb2943ac80856e2e37111856 [id=5ac524ecad68439eb40c058be3ee262a]). Expected version 1 got 0
I20260928 14:50:23.907161 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.907341 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.908699 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dacb0eef514609bcaf503ccc9845e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.912199 9266 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6b0867466459ca14413559800ff64 (DEFAULT_TABLE table=default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.912531 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6b0867466459ca14413559800ff64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.913942 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.914915 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.915093 9813 tablet_replica.cc:330] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:23.915144 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.915162 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4025017d30034ea3adc6b5fd55d18617 with delete_type TABLET_DATA_DELETED (replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.915372 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 4025017d30034ea3adc6b5fd55d18617 with delete_type TABLET_DATA_DELETED (replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.916181 9813 raft_consensus.cc:2229] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.916359 9813 raft_consensus.cc:2258] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.917712 9813 ts_tablet_manager.cc:1905] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.921111 10062 raft_consensus.cc:2726] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.923002 9394 tablet_service.cc:1467] Processing CreateTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.923390 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9342e920ae48278ab3f3c6d639fc94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:23.926471 9360 leader_election.cc:341] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:23.926949 9427 raft_consensus.cc:1261] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.927212 9814 tablet_replica.cc:330] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:23.928180 9814 raft_consensus.cc:2229] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:23.929025 9814 raft_consensus.cc:2258] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:23.930774 9814 ts_tablet_manager.cc:1905] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:23.933547 9848 tablet_bootstrap.cc:654] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:23.933717 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 5b695c68118b49359f1899d30208b1b7 (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.933818 9813 ts_tablet_manager.cc:1918] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:23.937325 9360 leader_election.cc:302] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:23.937757 9813 log.cc:1196] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:23.946492 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1738a95895914cc4936a38e1d189d538
I20260928 14:50:23.896114 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.927380 9264 tablet_service.cc:1467] Processing CreateTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.953030 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9342e920ae48278ab3f3c6d639fc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.938930 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.939883 10071 consensus_queue.cc:1035] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.950141 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.950402 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 5b695c68118b49359f1899d30208b1b7 (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.958211 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b695c68118b49359f1899d30208b1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.952111 9267 tablet_service.cc:1467] Processing CreateTablet for tablet a19995a0d8af4d3ca562bade80ce006f (DEFAULT_TABLE table=default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.960819 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19995a0d8af4d3ca562bade80ce006f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.961401 10066 raft_consensus.cc:686] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:23.961817 9548 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6b0867466459ca14413559800ff64 (DEFAULT_TABLE table=default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.962592 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6b0867466459ca14413559800ff64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.962827 9567 raft_consensus.cc:1261] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:23.964035 10029 raft_consensus.cc:482] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:23.964059 9827 raft_consensus.cc:2726] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:23.964326 10071 consensus_queue.cc:1035] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:23.962176 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:23.966989 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d26550613aa4988910ec66eeb8b2f07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.967149 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 315c446d87c84ae4bc9cb3243dca5538 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d6dc266ab8248d381e4850179455795) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.966961 8955 catalog_manager.cc:5495] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:23.967521 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:23.967759 8955 catalog_manager.cc:5495] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:23.968096 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 8c8624f9349a4608a48943487f01c7c8 (table default.Table_66d032c076df4decbc0ff1548031369f [id=b8333e21752c4aabb04a7caeeb0515a3]). Expected version 1 got 0
I20260928 14:50:23.970039 9534 tablet_service.cc:1467] Processing CreateTablet for tablet a19995a0d8af4d3ca562bade80ce006f (DEFAULT_TABLE table=default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.970935 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 63792bb2d5b54463a701c9e4e5f095e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.972818 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b695c68118b49359f1899d30208b1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.974722 9813 ts_tablet_manager.cc:1939] T 0e661ac0a85949a280d837ee0357eea7 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:23.976941 10029 raft_consensus.cc:504] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.981185 9256 tablet_service.cc:1467] Processing CreateTablet for tablet cadfdf093ab04b61af441cff6c9c510b (DEFAULT_TABLE table=default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.981622 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cadfdf093ab04b61af441cff6c9c510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.982743 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc (DEFAULT_TABLE table=default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe [id=e00f618e9273435db59f9445f6485b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.985335 9400 tablet_service.cc:1467] Processing CreateTablet for tablet a19995a0d8af4d3ca562bade80ce006f (DEFAULT_TABLE table=default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.985291 9536 tablet_service.cc:1467] Processing CreateTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (DEFAULT_TABLE table=default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.985911 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.987320 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:23.987831 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.965907 10066 consensus_queue.cc:237] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:23.989812 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 30b0e3b18c724493a44c99d990013f34 (DEFAULT_TABLE table=default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.990550 8955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_f47141b8eb2943ac80856e2e37111856 [id=5ac524ecad68439eb40c058be3ee262a] alter complete (version 1)
I20260928 14:50:23.991153 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19995a0d8af4d3ca562bade80ce006f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.993498 10029 leader_election.cc:288] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:23.993818 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ee1e19142b402f96056c387140b5ca" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:23.995751 9392 tablet_service.cc:1467] Processing CreateTablet for tablet ba281355b2f44b77a4ff99d49c084162 (DEFAULT_TABLE table=default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.996114 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba281355b2f44b77a4ff99d49c084162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.996829 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:23.997037 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19995a0d8af4d3ca562bade80ce006f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:23.997761 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.998059 9539 tablet_service.cc:1467] Processing CreateTablet for tablet ba281355b2f44b77a4ff99d49c084162 (DEFAULT_TABLE table=default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.998423 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 5b695c68118b49359f1899d30208b1b7 (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:23.993568 9538 tablet_service.cc:1467] Processing CreateTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.001264 9360 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.001765 9398 tablet_service.cc:1467] Processing CreateTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (DEFAULT_TABLE table=default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.002089 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.002574 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 (DEFAULT_TABLE table=default.Table_71ce0c67c5c44812bcd7181bb4b27fe4 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.003115 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.003690 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b0e3b18c724493a44c99d990013f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.005069 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc (DEFAULT_TABLE table=default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe [id=e00f618e9273435db59f9445f6485b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.006291 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 30b0e3b18c724493a44c99d990013f34 (DEFAULT_TABLE table=default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.006661 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b0e3b18c724493a44c99d990013f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.009619 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 (DEFAULT_TABLE table=default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.010371 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef356a4c9d34af4b300d38eab49a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.012871 9388 tablet_service.cc:1467] Processing CreateTablet for tablet cadfdf093ab04b61af441cff6c9c510b (DEFAULT_TABLE table=default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.013284 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cadfdf093ab04b61af441cff6c9c510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.015020 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.018847 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (DEFAULT_TABLE table=default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.021060 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c19e95d4db2943829d59bae7577a5e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.024039 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6179576a67a644d9bf10f0a9fb84cf49" } modify_external_catalogs: true
I20260928 14:50:24.024232 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6179576a67a644d9bf10f0a9fb84cf49" } modify_external_catalogs: true
I20260928 14:50:24.024771 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f623bcce062e46e8814285fff7b584ff" } new_table_name: "default.Table_76b48abaef274af990732cd99117b001" modify_external_catalogs: true
I20260928 14:50:24.025353 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fbd97ee29f194fc6b1d87ef35df81670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.026446 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd97ee29f194fc6b1d87ef35df81670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:24.024971 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c19e95d4db2943829d59bae7577a5e2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.031898 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_45f6644a6d6643238d8f7cf2953ecc43" } new_table_name: "default.Table_327215c77105491289e905e60ba09b2c" modify_external_catalogs: true
I20260928 14:50:24.033274 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_85a8c601ea1f447bbb522d1548841757" } modify_external_catalogs: true
I20260928 14:50:24.033449 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_85a8c601ea1f447bbb522d1548841757" } modify_external_catalogs: true
I20260928 14:50:24.034293 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38a7426d79f54a28be2cc6abd2f3c923" } modify_external_catalogs: true
I20260928 14:50:24.034473 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38a7426d79f54a28be2cc6abd2f3c923" } modify_external_catalogs: true
I20260928 14:50:24.035099 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 11f9b039838a430eac3fd422f0f4d087 (DEFAULT_TABLE table=default.Table_c93036c59a7a4b62994b6a2761851a1f [id=e249dfbd0f314fe7a4283f46d66dfd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.035499 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f9b039838a430eac3fd422f0f4d087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.038487 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.038687 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.038854 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.041234 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc978ea3a194282aacc6ede22076c21 (DEFAULT_TABLE table=default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.042654 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.044504 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.045835 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_17150629add64106b091e64cc5d8a03b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.046422 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17150629add64106b091e64cc5d8a03b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.047500 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.047679 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16a0f674114ac8b4520fbce2d383d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.047681 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6397496f537745d7800ee7ebb76ce3a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.048219 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6397496f537745d7800ee7ebb76ce3a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.048269 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc978ea3a194282aacc6ede22076c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.049479 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_09403204efb345808fc758bce9e3fb5e" } modify_external_catalogs: true
I20260928 14:50:24.050096 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_09403204efb345808fc758bce9e3fb5e" } modify_external_catalogs: true
I20260928 14:50:24.052418 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 (DEFAULT_TABLE table=default.Table_71ce0c67c5c44812bcd7181bb4b27fe4 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.052812 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f10fd4b5f42e182b686cc1ccefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.053884 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc (DEFAULT_TABLE table=default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe [id=e00f618e9273435db59f9445f6485b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.055652 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa9167742a94a0ab586e15205a0ccdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.064919 9855 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:24.065222 9855 ts_tablet_manager.cc:1397] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.278s user 0.012s sys 0.027s
I20260928 14:50:24.065671 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16a0f674114ac8b4520fbce2d383d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.006628 9537 tablet_service.cc:1467] Processing CreateTablet for tablet cadfdf093ab04b61af441cff6c9c510b (DEFAULT_TABLE table=default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.008435 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (DEFAULT_TABLE table=default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.070117 10062 raft_consensus.cc:482] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.079720 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6e3a73ecfc16413ea124559696001ab6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.080150 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 962a5dee53514f7ab5a63242f7d70446 consensus state has no leader
W20260928 14:50:24.080291 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e3a73ecfc16413ea124559696001ab6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.080603 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_47b8571c3cd34d6080638815b62259d6" } new_table_name: "default.Table_53869c9eac514b32b785b8131fa5561f" modify_external_catalogs: true
I20260928 14:50:24.083045 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f98414a2078e42889dfadeb64bfb5506"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.083633 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f98414a2078e42889dfadeb64bfb5506 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.091156 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f01267d094954f7c847b2dc00adbabb1" } new_table_name: "default.Table_81ca6df5fc2849cab83083e994d3627a" modify_external_catalogs: true
I20260928 14:50:24.092119 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_73d808de82b24ab8a73d4186ddb7ea40" } new_table_name: "default.Table_ca8c415e575244b4a42d5d0ca9dd5d53" modify_external_catalogs: true
I20260928 14:50:24.093142 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f10fd4b5f42e182b686cc1ccefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.093740 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.094220 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.095994 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 274ab65ebc2d41db9dc5d8a0139f9bc9
I20260928 14:50:24.096874 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e4c780211fed497b923908fb5dda2c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.104698 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4c780211fed497b923908fb5dda2c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.108305 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:24.108665 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 11f9b039838a430eac3fd422f0f4d087 (DEFAULT_TABLE table=default.Table_c93036c59a7a4b62994b6a2761851a1f [id=e249dfbd0f314fe7a4283f46d66dfd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.109372 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc978ea3a194282aacc6ede22076c21 (DEFAULT_TABLE table=default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.110149 9249 tablet_service.cc:1467] Processing CreateTablet for tablet ba281355b2f44b77a4ff99d49c084162 (DEFAULT_TABLE table=default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.111423 9821 raft_consensus.cc:482] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.113703 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet dfacaf069e3746aeb8ca11d95e65c5ea
I20260928 14:50:24.114168 9821 raft_consensus.cc:504] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:24.114850 9821 leader_election.cc:288] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:24.115094 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8b914e3c8243490d92378a8765d6390f
W20260928 14:50:24.116910 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8048f3de070f48f4ab8d08a35c727c8e consensus state has no leader
I20260928 14:50:24.119407 9530 tablet_service.cc:1467] Processing CreateTablet for tablet b61fa4c4cff54e55b6e640d1b6376236 (DEFAULT_TABLE table=default.Table_90d4de6f126c4de4a82a42b44755e566 [id=38a18331beae4386a199edd7e5491230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.128923 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b695c68118b49359f1899d30208b1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.129586 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 (DEFAULT_TABLE table=default.Table_95aa50142a644abc89afc76523360723 [id=544d8d04f58f4aee9d4b04c45d9f9cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.132000 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 8048f3de070f48f4ab8d08a35c727c8e (DEFAULT_TABLE table=default.Table_47b8571c3cd34d6080638815b62259d6 [id=dcd8a6c7a1f14a699d65dac5a1178c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.133054 9545 tablet_service.cc:1467] Processing CreateTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.137123 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 1f012857690f4f91a941a5f642b9c989 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.137296 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61fa4c4cff54e55b6e640d1b6376236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.137499 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa9167742a94a0ab586e15205a0ccdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.137975 9855 raft_consensus.cc:348] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.138757 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc978ea3a194282aacc6ede22076c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.140436 9855 raft_consensus.cc:374] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.146497 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f9b039838a430eac3fd422f0f4d087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.149104 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f012857690f4f91a941a5f642b9c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.149408 9855 raft_consensus.cc:729] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.149685 9855 consensus_queue.cc:260] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.151714 9855 ts_tablet_manager.cc:1428] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.085s user 0.002s sys 0.000s
I20260928 14:50:24.151758 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 0e661ac0a85949a280d837ee0357eea7 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:24.151983 9855 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:24.152571 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf9342e920ae48278ab3f3c6d639fc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.152778 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8048f3de070f48f4ab8d08a35c727c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.153712 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.155277 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.156179 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.156381 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.157181 9813 tablet_replica.cc:330] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:24.157409 9813 raft_consensus.cc:2229] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:24.157444 10061 raft_consensus.cc:482] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.157265 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dc507eb5822445f7979ec88c8ca800b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.157621 9813 raft_consensus.cc:2258] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:24.158030 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc507eb5822445f7979ec88c8ca800b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.158170 9813 ts_tablet_manager.cc:1905] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:24.157727 10061 raft_consensus.cc:504] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.159443 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cadfdf093ab04b61af441cff6c9c510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.159802 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c43a160922bd4823a24ff9dcc2426cc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.160447 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c43a160922bd4823a24ff9dcc2426cc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.158051 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7e00ed21ddb54c429a68c09c19656d68" } modify_external_catalogs: true
I20260928 14:50:24.161420 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ee844aa3c24336b4acb66dc43186e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.167600 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba281355b2f44b77a4ff99d49c084162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.172986 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa9167742a94a0ab586e15205a0ccdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.173281 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba281355b2f44b77a4ff99d49c084162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.173236 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 30b0e3b18c724493a44c99d990013f34 (DEFAULT_TABLE table=default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.155366 9266 tablet_service.cc:1467] Processing CreateTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (DEFAULT_TABLE table=default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.175580 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef356a4c9d34af4b300d38eab49a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.179323 10063 mvcc.cc:205] Tried to move back new op lower bound from 7334326369535766528 to 7334326366385000448. Current Snapshot: MvccSnapshot[applied={T|T < 7334326369535766528}]
I20260928 14:50:24.179840 10078 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:24.180603 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.181125 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e661ac0a85949a280d837ee0357eea7" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.181376 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfacaf069e3746aeb8ca11d95e65c5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.181670 10068 raft_consensus.cc:482] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.183007 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ee1e19142b402f96056c387140b5ca" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:24.183454 9497 leader_election.cc:341] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:24.185854 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e89035a3d41a4af78a8e7afbdb89c7e0 consensus state has no leader
I20260928 14:50:24.186367 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b0e3b18c724493a44c99d990013f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.188604 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.188835 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7e00ed21ddb54c429a68c09c19656d68" } modify_external_catalogs: true
W20260928 14:50:24.191557 9360 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.191746 9360 leader_election.cc:302] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:24.192570 9827 raft_consensus.cc:2726] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.192868 9394 tablet_service.cc:1467] Processing CreateTablet for tablet b61fa4c4cff54e55b6e640d1b6376236 (DEFAULT_TABLE table=default.Table_90d4de6f126c4de4a82a42b44755e566 [id=38a18331beae4386a199edd7e5491230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.190534 10061 leader_election.cc:288] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:24.199193 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b65fd0746d1b474e9fbebe6f09053743 consensus state has no leader
I20260928 14:50:24.159436 10062 raft_consensus.cc:504] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:24.205835 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61fa4c4cff54e55b6e640d1b6376236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.188982 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (DEFAULT_TABLE table=default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.206952 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 1f012857690f4f91a941a5f642b9c989 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.207324 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f012857690f4f91a941a5f642b9c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.207305 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc978ea3a194282aacc6ede22076c21 (DEFAULT_TABLE table=default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.207865 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 11f9b039838a430eac3fd422f0f4d087 (DEFAULT_TABLE table=default.Table_c93036c59a7a4b62994b6a2761851a1f [id=e249dfbd0f314fe7a4283f46d66dfd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.208266 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.208702 10068 raft_consensus.cc:504] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:24.209261 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.209498 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.209710 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.209898 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.210225 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ef356a4c9d34af4b300d38eab49a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.210186 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 (DEFAULT_TABLE table=default.Table_95aa50142a644abc89afc76523360723 [id=544d8d04f58f4aee9d4b04c45d9f9cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.210526 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ee844aa3c24336b4acb66dc43186e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.208415 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.212721 9848 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:24.214563 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 8048f3de070f48f4ab8d08a35c727c8e (DEFAULT_TABLE table=default.Table_47b8571c3cd34d6080638815b62259d6 [id=dcd8a6c7a1f14a699d65dac5a1178c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.217056 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 (DEFAULT_TABLE table=default.Table_71ce0c67c5c44812bcd7181bb4b27fe4 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.218640 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f81f1875265642c3a428e658dca558d0 (table default.Table_f47141b8eb2943ac80856e2e37111856 [id=5ac524ecad68439eb40c058be3ee262a]). Expected version 1 got 0
I20260928 14:50:24.216939 10062 leader_election.cc:288] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:24.240738 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 82b042c6ffc148939dcba9b710f198d3 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82b042c6ffc148939dcba9b710f198d3 consensus state has no leader
I20260928 14:50:24.245350 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def872f66b2541b9af6084e93d991ec2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.247682 10068 leader_election.cc:288] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:24.252466 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc978ea3a194282aacc6ede22076c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.253588 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.257146 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f9b039838a430eac3fd422f0f4d087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.260773 9251 tablet_service.cc:1467] Processing CreateTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.267336 10054 raft_consensus.cc:482] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.268076 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 57e56077833e41dbacf54c1757ba6a38
W20260928 14:50:24.268819 10090 log.cc:924] Time spent T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
W20260928 14:50:24.268987 9360 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:24.269152 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 45281.1us
I20260928 14:50:24.270345 9848 ts_tablet_manager.cc:1397] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.380s user 0.001s sys 0.005s
I20260928 14:50:24.270754 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.271602 10054 raft_consensus.cc:504] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.272197 10054 leader_election.cc:288] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:24.272218 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8048f3de070f48f4ab8d08a35c727c8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.273427 9498 leader_election.cc:341] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:24.273620 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def872f66b2541b9af6084e93d991ec2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:24.274029 9392 tablet_service.cc:1467] Processing CreateTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea (DEFAULT_TABLE table=default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.274406 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfacaf069e3746aeb8ca11d95e65c5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.273124 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 11714d0ca321429c95de223320794a0e (DEFAULT_TABLE table=default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.277747 9498 leader_election.cc:302] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:24.271158 9848 raft_consensus.cc:348] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:24.282549 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 84505.8us
I20260928 14:50:24.282085 9532 tablet_service.cc:1467] Processing CreateTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 (DEFAULT_TABLE table=default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.287349 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5933bd9ddd9d49e79e0c351ae30d030e" } new_table_name: "default.Table_b455ca1869df43c4a331171a93e88351" modify_external_catalogs: true
I20260928 14:50:24.287560 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6b34a358cd1549abb1b21255b0d0edcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.288199 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b34a358cd1549abb1b21255b0d0edcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.288779 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d1c37b5352ee46ab8d992eb5f34846e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.289320 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1c37b5352ee46ab8d992eb5f34846e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.293771 9398 tablet_service.cc:1467] Processing CreateTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 (DEFAULT_TABLE table=default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.294107 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_79506823cf5645bc8ad031339cd93937"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.294637 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79506823cf5645bc8ad031339cd93937 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.295668 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_66d032c076df4decbc0ff1548031369f" } new_table_name: "default.Table_1d54df7671a0472193f255cb56c15768" modify_external_catalogs: true
W20260928 14:50:24.298890 9360 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.305336 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.305630 10054 raft_consensus.cc:2726] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:24.305930 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.309000 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:24.309845 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8700d651fd7144bd9ecc15cfedcfb434 consensus state has no leader
I20260928 14:50:24.310864 9848 raft_consensus.cc:374] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.311089 9848 raft_consensus.cc:729] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:24.311600 9360 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.311780 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11714d0ca321429c95de223320794a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.312184 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d5a67ec9ce403d91ef1f6d52380b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.312500 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_03bbf67d11074023a23cb3067cf6b53d" } modify_external_catalogs: true
I20260928 14:50:24.312671 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_03bbf67d11074023a23cb3067cf6b53d" } modify_external_catalogs: true
I20260928 14:50:24.313743 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 11714d0ca321429c95de223320794a0e (DEFAULT_TABLE table=default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.314165 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11714d0ca321429c95de223320794a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.314203 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2daaa607d7bb425caea915bbbdb6b8f7" } modify_external_catalogs: true
I20260928 14:50:24.314391 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2daaa607d7bb425caea915bbbdb6b8f7" } modify_external_catalogs: true
I20260928 14:50:24.314905 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.315131 9403 tablet_service.cc:1467] Processing CreateTablet for tablet b1df25948af14998a26b36bb5b466a1e (DEFAULT_TABLE table=default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d [id=37f211d75f004ca08ff659cd19d592e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.324610 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fbd97ee29f194fc6b1d87ef35df81670" } modify_external_catalogs: true
I20260928 14:50:24.324785 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fbd97ee29f194fc6b1d87ef35df81670" } modify_external_catalogs: true
I20260928 14:50:24.325923 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8404ce5ed5f045669de5e3f460d848bb" } modify_external_catalogs: true
I20260928 14:50:24.326064 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8404ce5ed5f045669de5e3f460d848bb" } modify_external_catalogs: true
I20260928 14:50:24.326679 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d5a67ec9ce403d91ef1f6d52380b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.327796 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d1c37b5352ee46ab8d992eb5f34846e8" } new_table_name: "default.Table_95fcbbaa43154ab58db0787656b14c17" modify_external_catalogs: true
I20260928 14:50:24.328926 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.329408 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.330024 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d (DEFAULT_TABLE table=default.Table_6397496f537745d7800ee7ebb76ce3a6 [id=8aeb1610df884d82ac12f54569e7ed98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.327135 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.333572 9406 tablet_service.cc:1467] Processing CreateTablet for tablet a7be6013a04c4222ab34a19e77e48a37 (DEFAULT_TABLE table=default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.333868 9546 tablet_service.cc:1467] Processing CreateTablet for tablet b1df25948af14998a26b36bb5b466a1e (DEFAULT_TABLE table=default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d [id=37f211d75f004ca08ff659cd19d592e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.334300 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a08d91a06ca4effbc8fc4e83d88fe93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.336552 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:24.325660 9848 consensus_queue.cc:260] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:24.338236 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 852b70b1f7444ad2ab92d66d580a0db7
I20260928 14:50:24.330120 9536 tablet_service.cc:1467] Processing CreateTablet for tablet a7be6013a04c4222ab34a19e77e48a37 (DEFAULT_TABLE table=default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.341001 9540 tablet_service.cc:1467] Processing CreateTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 (DEFAULT_TABLE table=default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.341408 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 11714d0ca321429c95de223320794a0e
I20260928 14:50:24.342628 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:24.343163 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.345642 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1df25948af14998a26b36bb5b466a1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.352134 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42f7fb96f92a4e35b8561832e1d812d8 has no consensus state
I20260928 14:50:24.352279 9815 ts_tablet_manager.cc:1918] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:24.352404 9815 log.cc:1196] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4025017d30034ea3adc6b5fd55d18617
I20260928 14:50:24.352633 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c85735981779438197f2c0f489681b96
I20260928 14:50:24.361495 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.359352 9567 raft_consensus.cc:1261] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer ae832871bd1142f7af10c084115ffc12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:24.366806 9542 tablet_service.cc:1467] Processing CreateTablet for tablet a303792e4c804844bc6037fabb425be4 (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.367187 9815 ts_tablet_manager.cc:1939] T 4025017d30034ea3adc6b5fd55d18617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:24.375541 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be6013a04c4222ab34a19e77e48a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.381233 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d (DEFAULT_TABLE table=default.Table_6397496f537745d7800ee7ebb76ce3a6 [id=8aeb1610df884d82ac12f54569e7ed98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.388077 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0e6b85eeae4048bf8a6adc4ac9a93174"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.388531 9855 tablet_bootstrap.cc:654] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:24.388721 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e6b85eeae4048bf8a6adc4ac9a93174 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.390022 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_90d4de6f126c4de4a82a42b44755e566" } new_table_name: "default.Table_646488b2fae745c7bf73cfff72b67473" modify_external_catalogs: true
I20260928 14:50:24.390556 9815 tablet_replica.cc:330] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:24.390821 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.394718 8916 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu pid 9741
I20260928 14:50:24.394878 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ffc5bee62845519a4b7ee8c914e70d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.399020 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b61fa4c4cff54e55b6e640d1b6376236 consensus state has no leader
I20260928 14:50:24.402997 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_95aa50142a644abc89afc76523360723" } new_table_name: "default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f" modify_external_catalogs: true
I20260928 14:50:24.403199 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5fc2ded1f8094f3090ab1aaf1e46af72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.403719 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.404894 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.405349 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.407590 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad844de91e4040c3a8ae4873c0fa6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.410089 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28ee844aa3c24336b4acb66dc43186e9 consensus state has no leader
I20260928 14:50:24.411733 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a303792e4c804844bc6037fabb425be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.414182 9815 raft_consensus.cc:2229] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:24.415022 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 390f10fd4b5f42e182b686cc1ccefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.421018 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.421060 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 82b9dad76ac94a03811e4793e0234aad (DEFAULT_TABLE table=default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.421430 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50f7410dd549f399449487556f813d (DEFAULT_TABLE table=default.Table_c43a160922bd4823a24ff9dcc2426cc7 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.424813 9815 raft_consensus.cc:2258] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:24.425143 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d267fa0a698437986feb52cd9c15cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.421501 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 86f11c5ca3154bac934cae3842f16de4 (DEFAULT_TABLE table=default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.435207 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1ee21c77ab98461184377947a7f2e3de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.435817 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee21c77ab98461184377947a7f2e3de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.257892 10095 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.441651 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 1f012857690f4f91a941a5f642b9c989 (DEFAULT_TABLE table=default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.443610 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfacaf069e3746aeb8ca11d95e65c5ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.444483 9219 leader_election.cc:341] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:24.449878 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ab3473736270443b95023ad0ed180aa3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.451498 9851 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.532s user 0.040s sys 0.070s
I20260928 14:50:24.451462 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 (DEFAULT_TABLE table=default.Table_95aa50142a644abc89afc76523360723 [id=544d8d04f58f4aee9d4b04c45d9f9cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.444865 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 8048f3de070f48f4ab8d08a35c727c8e (DEFAULT_TABLE table=default.Table_47b8571c3cd34d6080638815b62259d6 [id=dcd8a6c7a1f14a699d65dac5a1178c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.452006 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.452796 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16a0f674114ac8b4520fbce2d383d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.453449 9851 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.532s user 0.040s sys 0.070s
W20260928 14:50:24.453678 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3473736270443b95023ad0ed180aa3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.454639 9889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260928 14:50:24.462648 9263 tablet_service.cc:1467] Processing CreateTablet for tablet b61fa4c4cff54e55b6e640d1b6376236 (DEFAULT_TABLE table=default.Table_90d4de6f126c4de4a82a42b44755e566 [id=38a18331beae4386a199edd7e5491230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.468525 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8048f3de070f48f4ab8d08a35c727c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.470578 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5fc2ded1f8094f3090ab1aaf1e46af72" } modify_external_catalogs: true
I20260928 14:50:24.470775 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5fc2ded1f8094f3090ab1aaf1e46af72" } modify_external_catalogs: true
I20260928 14:50:24.347690 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.477686 9851 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:24.477737 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.477846 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.477856 9851 ts_tablet_manager.cc:1397] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.607s user 0.040s sys 0.073s
I20260928 14:50:24.479509 9851 raft_consensus.cc:348] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.479735 9851 raft_consensus.cc:374] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.480357 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ee844aa3c24336b4acb66dc43186e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.480751 9848 ts_tablet_manager.cc:1428] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.079s user 0.001s sys 0.002s
I20260928 14:50:24.480918 9851 raft_consensus.cc:729] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.481153 9851 consensus_queue.cc:260] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.483073 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.485590 9390 tablet_service.cc:1467] Processing CreateTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 (DEFAULT_TABLE table=default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.486037 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f012857690f4f91a941a5f642b9c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.487684 9851 ts_tablet_manager.cc:1428] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:24.479782 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:24.489353 9399 tablet_service.cc:1467] Processing CreateTablet for tablet a303792e4c804844bc6037fabb425be4 (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.489500 9426 raft_consensus.cc:2454] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:24.489786 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.490195 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50f7410dd549f399449487556f813d (DEFAULT_TABLE table=default.Table_c43a160922bd4823a24ff9dcc2426cc7 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.490512 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.490507 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.490681 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1df25948af14998a26b36bb5b466a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.490877 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a303792e4c804844bc6037fabb425be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.491117 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be6013a04c4222ab34a19e77e48a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.491357 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad844de91e4040c3a8ae4873c0fa6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.491657 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d267fa0a698437986feb52cd9c15cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.494414 9815 ts_tablet_manager.cc:1905] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:24.495406 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50f7410dd549f399449487556f813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.502429 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61fa4c4cff54e55b6e640d1b6376236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.501010 9261 tablet_service.cc:1467] Processing CreateTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 (DEFAULT_TABLE table=default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.505262 9360 leader_election.cc:302] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:24.505635 9498 leader_election.cc:302] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:24.507220 10061 raft_consensus.cc:2726] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.507434 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 11714d0ca321429c95de223320794a0e (DEFAULT_TABLE table=default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.509822 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 82b9dad76ac94a03811e4793e0234aad (DEFAULT_TABLE table=default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.511111 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 206240us
I20260928 14:50:24.513761 9848 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:24.515419 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5f5d8f2d9acd405098447edd7df4f85f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.515931 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50f7410dd549f399449487556f813d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.515980 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f5d8f2d9acd405098447edd7df4f85f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.516407 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 86f11c5ca3154bac934cae3842f16de4 (DEFAULT_TABLE table=default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.517664 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cce29ecaa696477da8fdfa101b74b05a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.518208 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce29ecaa696477da8fdfa101b74b05a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.518218 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.518460 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b9dad76ac94a03811e4793e0234aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.519012 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a08d91a06ca4effbc8fc4e83d88fe93. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.519002 9360 consensus_peers.cc:487] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:24.519716 9360 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.519858 9360 leader_election.cc:302] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:24.520427 10061 raft_consensus.cc:2726] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.520556 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ffc5bee62845519a4b7ee8c914e70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.522053 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:24.523146 9848 tablet_bootstrap.cc:654] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:24.524202 9393 tablet_service.cc:1467] Processing CreateTablet for tablet be232889594147bdbe2d4825c3e8c7d0 (DEFAULT_TABLE table=default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef [id=fa7396482f54455193f716a38798ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.520606 10061 consensus_queue.cc:1035] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260928 14:50:24.526050 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0f3ce7289c2f4c3e81f9c9ca6e87bf16" } new_table_name: "default.Table_db313c82c68e436bbccf67e69c6c10cf" modify_external_catalogs: true
I20260928 14:50:24.527277 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 42f7fb96f92a4e35b8561832e1d812d8 (DEFAULT_TABLE table=default.Table_95fcbbaa43154ab58db0787656b14c17 [id=82ac2d539ff5441d90b267e47f95ce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.527721 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be232889594147bdbe2d4825c3e8c7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.527809 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_55ee447211854085bcb9b589d08b9f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.528296 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ee447211854085bcb9b589d08b9f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.539111 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11714d0ca321429c95de223320794a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.541119 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_354f08bdef784c8ab09d3cabf60e928b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.541674 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_354f08bdef784c8ab09d3cabf60e928b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:24.539670 9497 leader_election.cc:341] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.543329 9851 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:24.543888 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.544871 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f0f4d7e303b24a83932decc1af4a5311" } modify_external_catalogs: true
I20260928 14:50:24.545761 10054 raft_consensus.cc:2781] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:24.545866 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f0f4d7e303b24a83932decc1af4a5311" } modify_external_catalogs: true
I20260928 14:50:24.546873 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b83606ed237744d88ba3ebb26186e236" } modify_external_catalogs: true
I20260928 14:50:24.547091 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b83606ed237744d88ba3ebb26186e236" } modify_external_catalogs: true
I20260928 14:50:24.545534 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 42f7fb96f92a4e35b8561832e1d812d8 (DEFAULT_TABLE table=default.Table_95fcbbaa43154ab58db0787656b14c17 [id=82ac2d539ff5441d90b267e47f95ce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.547717 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1d54df7671a0472193f255cb56c15768" } modify_external_catalogs: true
I20260928 14:50:24.547907 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1d54df7671a0472193f255cb56c15768" } modify_external_catalogs: true
I20260928 14:50:24.548817 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 5 got 0
I20260928 14:50:24.549317 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d" } new_table_name: "default.Table_84280ea01fa6441ebb483c2c09cb42db" modify_external_catalogs: true
I20260928 14:50:24.553630 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86f11c5ca3154bac934cae3842f16de4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.553850 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d27a357d905e463ba9507f74e575acb1 consensus state has no leader
I20260928 14:50:24.556757 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c43a160922bd4823a24ff9dcc2426cc7" } new_table_name: "default.Table_73af8a4d32214efba99d9f0665af93a8" modify_external_catalogs: true
I20260928 14:50:24.556963 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5f5d8f2d9acd405098447edd7df4f85f" } modify_external_catalogs: true
I20260928 14:50:24.557174 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5f5d8f2d9acd405098447edd7df4f85f" } modify_external_catalogs: true
I20260928 14:50:24.557510 10078 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.558137 10054 raft_consensus.cc:482] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:24.558247 10054 raft_consensus.cc:3037] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:24.562150 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f97651e18ff042809ba35856d05b379b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.562669 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f97651e18ff042809ba35856d05b379b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.550272 9549 tablet_service.cc:1467] Processing CreateTablet for tablet be232889594147bdbe2d4825c3e8c7d0 (DEFAULT_TABLE table=default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef [id=fa7396482f54455193f716a38798ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.565636 8951 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4e2189ebe65b457daf16a8d009b14ee4
I20260928 14:50:24.567772 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.568421 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:24.568759 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c50f7410dd549f399449487556f813d consensus state has no leader
I20260928 14:50:24.569039 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8c8624f9349a4608a48943487f01c7c8
I20260928 14:50:24.571792 9247 tablet_service.cc:1467] Processing CreateTablet for tablet b1df25948af14998a26b36bb5b466a1e (DEFAULT_TABLE table=default.Table_bc58081b53ff4c6fb1f3cc58a09eea6d [id=37f211d75f004ca08ff659cd19d592e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.572852 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86f11c5ca3154bac934cae3842f16de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.574683 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.577095 10096 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:24.579495 9266 tablet_service.cc:1467] Processing CreateTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 (DEFAULT_TABLE table=default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.582095 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d5a67ec9ce403d91ef1f6d52380b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.582888 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1df25948af14998a26b36bb5b466a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.586040 9170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:24.586951 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 73bbcf31960d478087a0a91337c34ec8 (DEFAULT_TABLE table=default.Table_79506823cf5645bc8ad031339cd93937 [id=40cbb3838eac45129f8df57636ce48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.589218 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c8624f9349a4608a48943487f01c7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.592759 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.594726 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a08d91a06ca4effbc8fc4e83d88fe93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.595484 9814 ts_tablet_manager.cc:1918] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.595624 9814 log.cc:1196] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8d26550613aa4988910ec66eeb8b2f07
I20260928 14:50:24.595954 9814 ts_tablet_manager.cc:1939] T 8d26550613aa4988910ec66eeb8b2f07 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:24.596695 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 125) took 2372 ms. Trace:
I20260928 14:50:24.596791 9814 rpcz_store.cc:276] 0928 14:50:22.224453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.224507 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:23.927136 (+1702629us) ts_tablet_manager.cc:1145] Deleting tablet 8d26550613aa4988910ec66eeb8b2f07
0928 14:50:23.927158 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.250963 (+323805us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.588555 (+337592us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.596641 (+ 8086us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1702013}
I20260928 14:50:24.597268 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 114) took 2400 ms. Trace:
I20260928 14:50:24.597352 9814 rpcz_store.cc:276] 0928 14:50:22.196490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.241409 (+ 44919us) service_pool.cc:227] Handling call
0928 14:50:24.597106 (+2355697us) ts_tablet_manager.cc:1145] Deleting tablet f095e4cbf95147d9afb83434ae1fd29f
0928 14:50:24.597116 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.597211 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2355408}
I20260928 14:50:24.597647 9814 tablet_replica.cc:330] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:24.597819 9814 raft_consensus.cc:2229] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:24.597978 9814 raft_consensus.cc:2258] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:24.598486 9814 ts_tablet_manager.cc:1905] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:24.598917 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.605325 9851 tablet_bootstrap.cc:654] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:24.605461 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f7fb96f92a4e35b8561832e1d812d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.607529 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad844de91e4040c3a8ae4873c0fa6ba4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.608884 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1df25948af14998a26b36bb5b466a1e consensus state has no leader
I20260928 14:50:24.611093 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73bbcf31960d478087a0a91337c34ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.612399 9264 tablet_service.cc:1467] Processing CreateTablet for tablet a7be6013a04c4222ab34a19e77e48a37 (DEFAULT_TABLE table=default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.612788 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be6013a04c4222ab34a19e77e48a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.612919 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 (DEFAULT_TABLE table=default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.613299 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0489aea8bb0a45daaaec6a48db756c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.613408 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:24.614115 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:24.616282 9813 ts_tablet_manager.cc:1918] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.616407 9813 log.cc:1196] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9aeda483866146f89198e6f14456f0f2
I20260928 14:50:24.616343 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cfe5ca1f74cb4f2babaf347be5b9a8f5" } new_table_name: "default.Table_158e9f6008914923b2f3ad53d5817d59" modify_external_catalogs: true
I20260928 14:50:24.616849 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ccdf4724e4eb4c6aac11f06d9d673a92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.617003 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.617461 9813 ts_tablet_manager.cc:1939] T 9aeda483866146f89198e6f14456f0f2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:24.617446 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccdf4724e4eb4c6aac11f06d9d673a92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.617892 9813 tablet_replica.cc:330] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:24.617944 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d313471146084c3c806a3c01b1c77538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.618404 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d313471146084c3c806a3c01b1c77538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.618672 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f47141b8eb2943ac80856e2e37111856" } new_table_name: "default.Table_039a4d4fbb964bdb995a4b30b21ef7bf" modify_external_catalogs: true
I20260928 14:50:24.620046 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 5127a4bb7e114ec09235c9e29f614156 (DEFAULT_TABLE table=default.Table_0e6b85eeae4048bf8a6adc4ac9a93174 [id=3f884201d03c4681a15f1fa2be74ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.620680 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d267fa0a698437986feb52cd9c15cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.626811 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9aeda483866146f89198e6f14456f0f2 (table default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]) successfully deleted
I20260928 14:50:24.628580 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_725d6b822a1d4f99a2232890822325ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.629043 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_725d6b822a1d4f99a2232890822325ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.630244 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d (DEFAULT_TABLE table=default.Table_6397496f537745d7800ee7ebb76ce3a6 [id=8aeb1610df884d82ac12f54569e7ed98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.630601 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ffc5bee62845519a4b7ee8c914e70d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.632351 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed0d79a39b2543049506422432990617 consensus state has no leader
I20260928 14:50:24.634325 9267 tablet_service.cc:1467] Processing CreateTablet for tablet a303792e4c804844bc6037fabb425be4 (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.634752 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a303792e4c804844bc6037fabb425be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.646167 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.647236 9394 tablet_service.cc:1467] Processing CreateTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 (DEFAULT_TABLE table=default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6 [id=720e4385ef6d42cbbaa26b3fc3cb5521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.650028 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3b535897db044370b2eb23087fb0fb85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.650595 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b535897db044370b2eb23087fb0fb85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.652302 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5127a4bb7e114ec09235c9e29f614156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.653594 10058 raft_consensus.cc:482] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.653728 10058 raft_consensus.cc:504] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.654340 10058 leader_election.cc:288] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:24.657100 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.657464 9813 raft_consensus.cc:2229] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:24.663689 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b9dad76ac94a03811e4793e0234aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.664388 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30d06c910fa4142a6248e8bfd00f4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.665292 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c101b1f03bb411f963f2348397c03e2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.665946 9813 raft_consensus.cc:2258] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:24.666723 9360 leader_election.cc:341] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:24.671360 9360 consensus_peers.cc:487] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:24.672086 9813 ts_tablet_manager.cc:1905] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:24.676470 9497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 54738us
I20260928 14:50:24.677000 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_72430aa5ab3f43e980725bfa019f0da6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.678187 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72430aa5ab3f43e980725bfa019f0da6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.679747 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.680716 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f7fb96f92a4e35b8561832e1d812d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.683900 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 73bbcf31960d478087a0a91337c34ec8 (DEFAULT_TABLE table=default.Table_79506823cf5645bc8ad031339cd93937 [id=40cbb3838eac45129f8df57636ce48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.689586 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.685549 10054 raft_consensus.cc:504] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.694782 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c8624f9349a4608a48943487f01c7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.696355 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be232889594147bdbe2d4825c3e8c7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.693090 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c101b1f03bb411f963f2348397c03e2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:24.698239 9498 consensus_peers.cc:487] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd8131f32f1a4153abf2967ca0a11619. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:24.699359 9360 leader_election.cc:341] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.700172 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:24.700387 9426 raft_consensus.cc:3037] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:24.700929 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.701349 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.701366 9360 leader_election.cc:302] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:24.701928 10058 raft_consensus.cc:2726] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.702556 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.706229 10054 leader_election.cc:288] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:24.707600 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 86f11c5ca3154bac934cae3842f16de4 (DEFAULT_TABLE table=default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.708122 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86f11c5ca3154bac934cae3842f16de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.712196 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8d26550613aa4988910ec66eeb8b2f07 (table default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]) successfully deleted
I20260928 14:50:24.712297 10094 consensus_queue.cc:1035] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:24.712801 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f095e4cbf95147d9afb83434ae1fd29f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f095e4cbf95147d9afb83434ae1fd29f already in progress: creating tablet
I20260928 14:50:24.712980 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73bbcf31960d478087a0a91337c34ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.713655 10070 raft_consensus.cc:482] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.715617 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 (DEFAULT_TABLE table=default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.709095 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:24.721025 9497 consensus_peers.cc:487] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:24.721710 9426 raft_consensus.cc:2454] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:24.719869 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50f7410dd549f399449487556f813d (DEFAULT_TABLE table=default.Table_c43a160922bd4823a24ff9dcc2426cc7 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.722133 9220 leader_election.cc:341] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:24.722167 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f81f1875265642c3a428e658dca558d0 (table default.Table_039a4d4fbb964bdb995a4b30b21ef7bf [id=5ac524ecad68439eb40c058be3ee262a]). Expected version 2 got 1
I20260928 14:50:24.720456 10070 raft_consensus.cc:504] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.722939 10070 leader_election.cc:288] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:24.724488 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0489aea8bb0a45daaaec6a48db756c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.724803 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c2ea7b972a3441858741b741d8452bd7" } modify_external_catalogs: true
I20260928 14:50:24.724995 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c2ea7b972a3441858741b741d8452bd7" } modify_external_catalogs: true
I20260928 14:50:24.725502 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 5127a4bb7e114ec09235c9e29f614156 (DEFAULT_TABLE table=default.Table_0e6b85eeae4048bf8a6adc4ac9a93174 [id=3f884201d03c4681a15f1fa2be74ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.728943 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 (DEFAULT_TABLE table=default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.729228 9498 leader_election.cc:302] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:24.730350 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ca5c040fa6ba4e2785959874a3346bf7
I20260928 14:50:24.731027 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:24.735206 9249 tablet_service.cc:1467] Processing CreateTablet for tablet be232889594147bdbe2d4825c3e8c7d0 (DEFAULT_TABLE table=default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef [id=fa7396482f54455193f716a38798ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.730263 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.737308 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 73bbcf31960d478087a0a91337c34ec8 (DEFAULT_TABLE table=default.Table_79506823cf5645bc8ad031339cd93937 [id=40cbb3838eac45129f8df57636ce48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.737643 10095 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.737809 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6feba01e78004e50a71c610c9a63aeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.738188 9545 tablet_service.cc:1467] Processing CreateTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 (DEFAULT_TABLE table=default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6 [id=720e4385ef6d42cbbaa26b3fc3cb5521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.741093 10078 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:24.741746 10054 raft_consensus.cc:2781] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:24.741978 10054 raft_consensus.cc:686] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:24.743680 10058 raft_consensus.cc:482] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.743901 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.743889 10058 raft_consensus.cc:504] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.745229 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5127a4bb7e114ec09235c9e29f614156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.746929 10058 leader_election.cc:288] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:24.747990 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e17941e9c752452db972f396574c6bb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.748039 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8ab3c482b7f2466091a9c8741dc3a1c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.748135 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1e945f1c54281856bfabe08fba42e (DEFAULT_TABLE table=default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.748579 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ab3c482b7f2466091a9c8741dc3a1c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:24.748605 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e17941e9c752452db972f396574c6bb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.750988 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.751251 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1e945f1c54281856bfabe08fba42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.752365 9393 tablet_service.cc:1467] Processing CreateTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 (DEFAULT_TABLE table=default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.752904 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b4b4c775fe4eacaaa557d4daa2a600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.754197 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 (DEFAULT_TABLE table=default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.755321 10054 consensus_queue.cc:237] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.756101 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e865f14ddc4b0c8ce0877cd99f5972" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:24.756697 9360 leader_election.cc:341] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.758991 10094 raft_consensus.cc:482] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:24.759167 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 8520b28899bc42b08e239502adb8fece (DEFAULT_TABLE table=default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.759404 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 46fe647c6d80431bbb76899126d01c3b (DEFAULT_TABLE table=default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.759678 10094 raft_consensus.cc:504] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.760231 10094 leader_election.cc:288] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:24.760592 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30d06c910fa4142a6248e8bfd00f4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.761134 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6feba01e78004e50a71c610c9a63aeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.761297 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:24.764851 9360 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.765367 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46fe647c6d80431bbb76899126d01c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.765437 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_79506823cf5645bc8ad031339cd93937" } new_table_name: "default.Table_7cbe9b800b63472f9c3edbe98510060c" modify_external_catalogs: true
I20260928 14:50:24.766034 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 75f9359df0ac466c912cd20fc6b94390 (DEFAULT_TABLE table=default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.766327 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8520b28899bc42b08e239502adb8fece. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.776372 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73bbcf31960d478087a0a91337c34ec8 consensus state has no leader
I20260928 14:50:24.778055 9855 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:24.779125 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eb8e41236cc945d8957a137aca04ed41" } modify_external_catalogs: true
I20260928 14:50:24.779309 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eb8e41236cc945d8957a137aca04ed41" } modify_external_catalogs: true
I20260928 14:50:24.782241 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3fb54ea0da09494c99d850793c1cc0ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.783222 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fb54ea0da09494c99d850793c1cc0ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.749470 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50f7410dd549f399449487556f813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.749581 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.789853 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.790318 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 (DEFAULT_TABLE table=default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.750016 9220 leader_election.cc:302] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:24.752198 9219 leader_election.cc:341] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 894af8262a004e41a6ccc2641f8f7605
W20260928 14:50:24.790738 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 49994.5us
I20260928 14:50:24.791014 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f9359df0ac466c912cd20fc6b94390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.791486 10070 raft_consensus.cc:2726] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:24.791440 9497 leader_election.cc:341] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:24.791857 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 74773.6us
I20260928 14:50:24.789644 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cbd9f9cb48a945d19420a8bdb9bb9576
W20260928 14:50:24.794605 9497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 61462.8us
I20260928 14:50:24.795501 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_53869c9eac514b32b785b8131fa5561f" } new_table_name: "default.Table_d7af89d7c1d5498394ab0e7a0a78a953" modify_external_catalogs: true
I20260928 14:50:24.796809 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be232889594147bdbe2d4825c3e8c7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.781720 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9d5d38ec9f8d453fb62f7f5c81287075"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.798153 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_30bb2a03ceff45e0b56a5fd71a36a327" } modify_external_catalogs: true
I20260928 14:50:24.798308 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_30bb2a03ceff45e0b56a5fd71a36a327" } modify_external_catalogs: true
I20260928 14:50:24.802178 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.802448 9540 tablet_service.cc:1467] Processing CreateTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 (DEFAULT_TABLE table=default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.804178 10095 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:24.801168 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d5d38ec9f8d453fb62f7f5c81287075 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.805830 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:24.810595 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1e945f1c54281856bfabe08fba42e (DEFAULT_TABLE table=default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.812623 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 75f9359df0ac466c912cd20fc6b94390 (DEFAULT_TABLE table=default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.814430 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0489aea8bb0a45daaaec6a48db756c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.814481 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 8520b28899bc42b08e239502adb8fece (DEFAULT_TABLE table=default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.815075 9497 consensus_peers.cc:487] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:24.818550 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 5 got 4
I20260928 14:50:24.820228 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b4b4c775fe4eacaaa557d4daa2a600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.820251 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73bbcf31960d478087a0a91337c34ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.820837 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1e945f1c54281856bfabe08fba42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.821416 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 46fe647c6d80431bbb76899126d01c3b (DEFAULT_TABLE table=default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.823128 9220 leader_election.cc:341] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 894af8262a004e41a6ccc2641f8f7605
I20260928 14:50:24.823484 9220 leader_election.cc:302] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:24.752526 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e865f14ddc4b0c8ce0877cd99f5972" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.823952 10071 raft_consensus.cc:2726] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.823848 9286 raft_consensus.cc:2454] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
W20260928 14:50:24.824263 9498 consensus_peers.cc:487] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9aeda483866146f89198e6f14456f0f2. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:24.752671 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 82b9dad76ac94a03811e4793e0234aad (DEFAULT_TABLE table=default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.824751 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b9dad76ac94a03811e4793e0234aad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.825088 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8048f3de070f48f4ab8d08a35c727c8e consensus state has no leader
I20260928 14:50:24.752820 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c8624f9349a4608a48943487f01c7c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.759016 9287 raft_consensus.cc:3037] T 0795ca09ecfe433195e016d5d1f0dbc0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:24.760829 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:24.826368 9255 tablet_service.cc:1467] Processing CreateTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 (DEFAULT_TABLE table=default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6 [id=720e4385ef6d42cbbaa26b3fc3cb5521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.771607 10096 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:46824 (request call id 194) took 1121 ms. Trace:
I20260928 14:50:24.826846 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30d06c910fa4142a6248e8bfd00f4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.826735 10096 rpcz_store.cc:276] 0928 14:50:23.650352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.650397 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:24.771453 (+1121056us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 14:50:23.812291 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 14:50:23.812452 (+ 161us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 14:50:23.812460 (+ 8us) alter_schema_op.cc:65] Acquired schema lock
0928 14:50:23.812466 (+ 6us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 14:50:23.812498 (+ 32us) alter_schema_op.cc:126] START. Timestamp: 1790607023812443
0928 14:50:23.812500 (+ 2us) op_driver.cc:331] REPLICATION: starting
0928 14:50:23.812683 (+ 183us) log.cc:842] Serialized 173 byte log entry
0928 14:50:24.155884 (+343201us) op_driver.cc:444] REPLICATION: finished
0928 14:50:24.565801 (+409917us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0928 14:50:24.623636 (+ 57835us) log.cc:842] Serialized 5 byte log entry
0928 14:50:24.770516 (+146880us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.771218 (+ 702us) log.cc:842] Serialized 14 byte log entry
0928 14:50:24.771417 (+ 199us) alter_schema_op.cc:71] Released schema lock
0928 14:50:24.771420 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":409846,"mutex_wait_us":26743,"prepare.queue_time_us":145374,"prepare.run_cpu_time_us":491,"prepare.run_wall_time_us":2907,"raft.queue_time_us":597,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":621,"replication_time_us":343340,"thread_start_us":510356,"threads_started":2}]]}
I20260928 14:50:24.828033 10096 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:24.832283 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.833572 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f9359df0ac466c912cd20fc6b94390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.752318 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 42f7fb96f92a4e35b8561832e1d812d8 (DEFAULT_TABLE table=default.Table_95fcbbaa43154ab58db0787656b14c17 [id=82ac2d539ff5441d90b267e47f95ce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.834381 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 5127a4bb7e114ec09235c9e29f614156 (DEFAULT_TABLE table=default.Table_0e6b85eeae4048bf8a6adc4ac9a93174 [id=3f884201d03c4681a15f1fa2be74ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.834627 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42f7fb96f92a4e35b8561832e1d812d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.835350 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5127a4bb7e114ec09235c9e29f614156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.837327 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc" } modify_external_catalogs: true
I20260928 14:50:24.837795 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc" } modify_external_catalogs: true
I20260928 14:50:24.842089 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:24.842542 9851 tablet_bootstrap.cc:492] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:24.842717 9851 ts_tablet_manager.cc:1397] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.336s user 0.006s sys 0.002s
I20260928 14:50:24.842777 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46fe647c6d80431bbb76899126d01c3b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.842849 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.843549 9851 raft_consensus.cc:348] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.843848 9851 raft_consensus.cc:374] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.843941 9851 raft_consensus.cc:729] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.844259 9851 consensus_queue.cc:260] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.844944 9851 ts_tablet_manager.cc:1428] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:24.844877 10058 consensus_queue.cc:1035] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260928 14:50:24.845261 9851 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:24.845395 9360 leader_election.cc:302] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:24.846784 10062 raft_consensus.cc:2781] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:24.846886 10062 raft_consensus.cc:482] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:24.846901 9851 tablet_bootstrap.cc:654] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:24.847447 10062 raft_consensus.cc:3037] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:24.848270 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.848554 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.849078 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 (DEFAULT_TABLE table=default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.849560 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6feba01e78004e50a71c610c9a63aeb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.852111 9360 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.852243 9360 leader_election.cc:302] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:24.852310 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a9f8c885eb7b4b0eba64e0c2c0f7e1bf" } new_table_name: "default.Table_c05d25ef4674447eb0e6ddb533492f20" modify_external_catalogs: true
I20260928 14:50:24.854041 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.854413 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c10738b4aa7a42c2a6eef90a1999483a" } modify_external_catalogs: true
I20260928 14:50:24.854684 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c10738b4aa7a42c2a6eef90a1999483a" } modify_external_catalogs: true
I20260928 14:50:24.855849 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.856052 9855 ts_tablet_manager.cc:1397] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.626s user 0.006s sys 0.012s
I20260928 14:50:24.861419 9813 ts_tablet_manager.cc:1918] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.863336 10062 raft_consensus.cc:504] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.863952 10058 raft_consensus.cc:2726] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:24.864812 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e865f14ddc4b0c8ce0877cd99f5972" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:24.865029 9283 raft_consensus.cc:3037] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:24.865792 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:24.864758 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.869037 9848 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:24.868251 10078 tablet.cc:1722] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.871763 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8520b28899bc42b08e239502adb8fece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.868573 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_72430aa5ab3f43e980725bfa019f0da6" } new_table_name: "default.Table_c0348630a5014a34baa6f91ce3af6db8" modify_external_catalogs: true
I20260928 14:50:24.872546 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f88389a6ed06462ca9081dc83b5ca5c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.873123 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f88389a6ed06462ca9081dc83b5ca5c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.876907 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.878248 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e865f14ddc4b0c8ce0877cd99f5972" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:24.879914 9814 ts_tablet_manager.cc:1918] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.880095 9814 log.cc:1196] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:24.880590 9814 ts_tablet_manager.cc:1939] T cd8131f32f1a4153abf2967ca0a11619 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:24.880453 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5fc978ea3a194282aacc6ede22076c21
I20260928 14:50:24.881950 9848 ts_tablet_manager.cc:1397] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.383s user 0.012s sys 0.020s
I20260928 14:50:24.882339 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.882838 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:24.881182 10066 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s user 0.000s sys 0.015s
I20260928 14:50:24.884366 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 75f9359df0ac466c912cd20fc6b94390 (DEFAULT_TABLE table=default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.884770 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f9359df0ac466c912cd20fc6b94390. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:24.885237 10066 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s user 0.000s sys 0.015s
I20260928 14:50:24.886458 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.886875 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 46fe647c6d80431bbb76899126d01c3b (DEFAULT_TABLE table=default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.887238 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46fe647c6d80431bbb76899126d01c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.891883 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 8520b28899bc42b08e239502adb8fece (DEFAULT_TABLE table=default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.892189 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8520b28899bc42b08e239502adb8fece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.892297 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_831f7fae5027486199eec1b90890aa35" } new_table_name: "default.Table_f3f0e0c6daa54fecb0db72ae6e070f77" modify_external_catalogs: true
I20260928 14:50:24.898042 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1e945f1c54281856bfabe08fba42e (DEFAULT_TABLE table=default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:24.898180 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:24.898355 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1e945f1c54281856bfabe08fba42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:24.897571 10109 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:24.857342 9855 raft_consensus.cc:348] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.902464 9855 raft_consensus.cc:374] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.902549 9855 raft_consensus.cc:729] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.902801 9855 consensus_queue.cc:260] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.903343 9855 ts_tablet_manager.cc:1428] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260928 14:50:24.903606 9855 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:24.906417 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a8c275ee78b74930976e658a73224180"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.906909 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8c275ee78b74930976e658a73224180 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.906916 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.907141 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:24.913962 9815 ts_tablet_manager.cc:1918] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.914239 9815 log.cc:1196] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8d26550613aa4988910ec66eeb8b2f07
I20260928 14:50:24.914675 9815 ts_tablet_manager.cc:1939] T 8d26550613aa4988910ec66eeb8b2f07 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:24.897414 9254 tablet_service.cc:1467] Processing CreateTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 (DEFAULT_TABLE table=default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:24.915735 9815 tablet_replica.cc:330] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:24.915776 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 126) took 2628 ms. Trace:
I20260928 14:50:24.915915 9815 raft_consensus.cc:2229] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:24.916500 9815 raft_consensus.cc:2258] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:24.917083 9815 ts_tablet_manager.cc:1905] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:24.917375 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c32a09c9daa14648bc55f4c122874b5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.917865 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c32a09c9daa14648bc55f4c122874b5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.919582 10062 leader_election.cc:288] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:24.920013 9360 leader_election.cc:341] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:24.922114 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.923406 9813 log.cc:1196] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/964985f048114f53ba1e685c7f1dbd6d
I20260928 14:50:24.924533 9813 ts_tablet_manager.cc:1939] T 964985f048114f53ba1e685c7f1dbd6d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:24.923612 9848 raft_consensus.cc:348] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:24.926237 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_13f0b42ecf494238af4b6d0b8e5c865e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.927368 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13f0b42ecf494238af4b6d0b8e5c865e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.928290 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 207) took 1018 ms. Trace:
I20260928 14:50:24.928413 9813 rpcz_store.cc:276] 0928 14:50:23.906408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.907290 (+ 882us) service_pool.cc:227] Handling call
0928 14:50:24.617844 (+710554us) ts_tablet_manager.cc:1145] Deleting tablet 964985f048114f53ba1e685c7f1dbd6d
0928 14:50:24.617852 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.732859 (+115007us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.861317 (+128458us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.925329 (+ 64012us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":710414}
I20260928 14:50:24.928884 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 964985f048114f53ba1e685c7f1dbd6d (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:24.929764 9813 tablet_replica.cc:330] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:24.929937 9813 raft_consensus.cc:2229] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:24.930188 9813 pending_rounds.cc:62] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:24.930258 9813 pending_rounds.cc:68] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326368808538112 op_type: NO_OP noop_request { }
I20260928 14:50:24.930500 9813 raft_consensus.cc:2866] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:24.930696 9813 raft_consensus.cc:2258] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:24.937414 9848 raft_consensus.cc:374] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.939819 9428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.8.181.1:60133 (request call id 44) took 1023 ms. Trace:
I20260928 14:50:24.942324 9813 ts_tablet_manager.cc:1905] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:24.939939 9428 rpcz_store.cc:276] 0928 14:50:23.908124 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.938764 (+ 30640us) service_pool.cc:227] Handling call
0928 14:50:23.963850 (+ 25086us) raft_consensus.cc:1457] Updating replica for 2 ops
0928 14:50:24.081439 (+117589us) raft_consensus.cc:1520] Early marking committed up to index 0
0928 14:50:24.081444 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0928 14:50:24.149561 (+ 68117us) alter_schema_op.cc:126] START. Timestamp: 1790607023812443
0928 14:50:24.573875 (+424314us) log.cc:842] Serialized 199 byte log entry
0928 14:50:24.927445 (+353570us) raft_consensus.cc:1631] Marking committed up to 0
0928 14:50:24.927457 (+ 12us) raft_consensus.cc:1683] Filling consensus response to leader.
0928 14:50:24.927497 (+ 40us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0928 14:50:24.931733 (+ 4236us) raft_consensus.cc:1671] finished
0928 14:50:24.931737 (+ 4us) raft_consensus.cc:1677] UpdateReplicas() finished
0928 14:50:24.931785 (+ 48us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 14:50:24.154398 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 14:50:24.154439 (+ 41us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 14:50:24.154445 (+ 6us) alter_schema_op.cc:65] Acquired schema lock
0928 14:50:24.154448 (+ 3us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
Metrics: {"mutex_wait_us":116520,"raft.queue_time_us":116585,"raft.run_cpu_time_us":37,"raft.run_wall_time_us":32,"spinlock_wait_cycles":33536,"thread_start_us":353468,"threads_started":1,"wal-append.queue_time_us":353652,"child_traces":[["op",{"prepare.queue_time_us":4775,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":59,"thread_start_us":385800,"threads_started":1}]]}
I20260928 14:50:24.951557 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:24.953510 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:24.955893 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91262a2cf39e4e5bb4854998332ca1f1 has no consensus state
I20260928 14:50:24.957178 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:24.957218 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 5 got 0
I20260928 14:50:24.957705 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_c05d25ef4674447eb0e6ddb533492f20 [id=763f6cc484294611b96035248c14066d]). Expected version 2 got 0
I20260928 14:50:24.963621 9855 tablet_bootstrap.cc:654] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:24.934664 10114 tablet.cc:1722] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:24.969862 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8d26550613aa4988910ec66eeb8b2f07 (table default.Table_7099d869d61949ccb9dd2a76af643004 [id=5d91f31e405844c3b3516f09656da855]) successfully deleted
I20260928 14:50:24.972782 9815 ts_tablet_manager.cc:1918] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:24.974332 10078 tablet.cc:1717] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Skipping requested alter to schema version 5, tablet already version 5
I20260928 14:50:24.975266 9815 log.cc:1196] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/315c446d87c84ae4bc9cb3243dca5538
I20260928 14:50:24.975602 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cce29ecaa696477da8fdfa101b74b05a" } modify_external_catalogs: true
I20260928 14:50:24.975869 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cce29ecaa696477da8fdfa101b74b05a" } modify_external_catalogs: true
I20260928 14:50:24.975788 9813 ts_tablet_manager.cc:1918] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:24.977926 9813 log.cc:1196] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:24.978523 9815 ts_tablet_manager.cc:1939] T 315c446d87c84ae4bc9cb3243dca5538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:24.978633 9813 ts_tablet_manager.cc:1939] T 9b998502f90a4df08b4078f833ad8c05 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:24.979305 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 203) took 1013 ms. Trace:
I20260928 14:50:24.982780 9815 rpcz_store.cc:276] 0928 14:50:23.965616 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.965731 (+ 115us) service_pool.cc:227] Handling call
0928 14:50:24.915470 (+949739us) ts_tablet_manager.cc:1145] Deleting tablet 315c446d87c84ae4bc9cb3243dca5538
0928 14:50:24.915480 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.949374 (+ 33894us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.972065 (+ 22691us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.979275 (+ 7210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":948240}
I20260928 14:50:24.984180 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 201) took 1018 ms. Trace:
I20260928 14:50:24.964160 10113 tablet.cc:1722] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.984843 9815 rpcz_store.cc:276] 0928 14:50:23.965383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.965866 (+ 483us) service_pool.cc:227] Handling call
0928 14:50:24.983961 (+1018095us) ts_tablet_manager.cc:1145] Deleting tablet 63792bb2d5b54463a701c9e4e5f095e0
0928 14:50:24.983971 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.984076 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1012905}
I20260928 14:50:24.985113 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d2f4dbbc71b9434bb2a869ed05653fda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:24.985998 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2f4dbbc71b9434bb2a869ed05653fda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:24.986184 9855 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:24.986385 9855 ts_tablet_manager.cc:1397] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.002s
I20260928 14:50:24.987649 9855 raft_consensus.cc:348] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.964082 10107 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:24.987951 9855 raft_consensus.cc:374] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:24.988142 9855 raft_consensus.cc:729] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.988502 9855 consensus_queue.cc:260] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:24.989184 9855 ts_tablet_manager.cc:1428] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:24.989833 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 207) took 1021 ms. Trace:
I20260928 14:50:24.990551 9848 raft_consensus.cc:729] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:24.990823 9848 consensus_queue.cc:260] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:24.991501 9815 rpcz_store.cc:276] 0928 14:50:23.967905 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.968312 (+ 407us) service_pool.cc:227] Handling call
0928 14:50:24.989408 (+1021096us) ts_tablet_manager.cc:1145] Deleting tablet 1738a95895914cc4936a38e1d189d538
0928 14:50:24.989416 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.989732 (+ 316us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992444}
I20260928 14:50:24.991906 9848 ts_tablet_manager.cc:1428] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.110s user 0.001s sys 0.002s
I20260928 14:50:24.991293 9855 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:24.993512 9855 tablet_bootstrap.cc:654] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.002396 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 01c1e945f1c54281856bfabe08fba42e
I20260928 14:50:25.002425 9815 tablet_replica.cc:330] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.002586 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.002635 9815 raft_consensus.cc:2229] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.002802 9815 raft_consensus.cc:2258] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.002893 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.003502 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.003648 9815 ts_tablet_manager.cc:1905] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.008919 9855 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.009152 9855 ts_tablet_manager.cc:1397] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260928 14:50:25.009696 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 5 got 0
I20260928 14:50:25.010023 9855 raft_consensus.cc:348] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.010279 9855 raft_consensus.cc:374] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.010357 9855 raft_consensus.cc:729] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.010614 9855 consensus_queue.cc:260] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.012185 9855 ts_tablet_manager.cc:1428] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:25.012480 9855 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.014243 9855 tablet_bootstrap.cc:654] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.017624 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 315c446d87c84ae4bc9cb3243dca5538 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:25.017731 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_039a4d4fbb964bdb995a4b30b21ef7bf [id=5ac524ecad68439eb40c058be3ee262a] alter complete (version 2)
I20260928 14:50:25.018546 9815 ts_tablet_manager.cc:1918] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260928 14:50:25.019299 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 63792bb2d5b54463a701c9e4e5f095e0 because the tablet was not found. No further retry: Not found: Tablet not found: 63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:25.020416 9848 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:25.021289 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1738a95895914cc4936a38e1d189d538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1738a95895914cc4936a38e1d189d538 already in progress: creating tablet
W20260928 14:50:25.022938 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 already in progress: creating tablet
I20260928 14:50:25.024027 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 (DEFAULT_TABLE table=default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.024240 9815 log.cc:1196] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8c8624f9349a4608a48943487f01c7c8
I20260928 14:50:25.024544 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5f68b570e4fff8f8748e4c762ad78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.025249 10109 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:25.026448 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 205) took 1120 ms. Trace:
I20260928 14:50:25.026613 9813 rpcz_store.cc:276] 0928 14:50:23.906232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.906960 (+ 728us) service_pool.cc:227] Handling call
0928 14:50:24.929678 (+1022718us) ts_tablet_manager.cc:1145] Deleting tablet 9b998502f90a4df08b4078f833ad8c05
0928 14:50:24.929690 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.968446 (+ 38756us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.975702 (+ 7256us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.026402 (+ 50700us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014641}
I20260928 14:50:25.027173 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9b998502f90a4df08b4078f833ad8c05 (table default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]) successfully deleted
I20260928 14:50:25.027516 9813 tablet_replica.cc:330] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.027750 9813 raft_consensus.cc:2229] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.027994 9813 raft_consensus.cc:2258] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:25.027941 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ca7fa45e25b0455e92412b844cd78cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca7fa45e25b0455e92412b844cd78cdc already in progress: creating tablet
I20260928 14:50:25.028556 9813 ts_tablet_manager.cc:1905] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:25.029841 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8b914e3c8243490d92378a8765d6390f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b914e3c8243490d92378a8765d6390f already in progress: creating tablet
I20260928 14:50:25.032552 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 0868e5ce22874134a2f50e2404970bb8 (DEFAULT_TABLE table=default.Table_ccdf4724e4eb4c6aac11f06d9d673a92 [id=066bd906e956423ea4fb9370314cfbd2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.032179 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet dfacaf069e3746aeb8ca11d95e65c5ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfacaf069e3746aeb8ca11d95e65c5ea already in progress: creating tablet
I20260928 14:50:25.033075 9815 ts_tablet_manager.cc:1939] T 8c8624f9349a4608a48943487f01c7c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.034294 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0868e5ce22874134a2f50e2404970bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.035094 9855 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.035305 9855 ts_tablet_manager.cc:1397] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
W20260928 14:50:25.035444 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 57e56077833e41dbacf54c1757ba6a38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e56077833e41dbacf54c1757ba6a38 already in progress: creating tablet
I20260928 14:50:25.036154 9855 raft_consensus.cc:348] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.036495 9855 raft_consensus.cc:374] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.036598 9855 raft_consensus.cc:729] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.036825 9855 consensus_queue.cc:260] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.037475 9855 ts_tablet_manager.cc:1428] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:25.037796 9855 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:25.037694 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 852b70b1f7444ad2ab92d66d580a0db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852b70b1f7444ad2ab92d66d580a0db7 already in progress: creating tablet
I20260928 14:50:25.040453 9405 tablet_service.cc:1467] Processing CreateTablet for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (DEFAULT_TABLE table=default.Table_3b535897db044370b2eb23087fb0fb85 [id=53a8fdb3cf364603a1acdf162636cd80]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.039757 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 11714d0ca321429c95de223320794a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11714d0ca321429c95de223320794a0e already in progress: creating tablet
W20260928 14:50:25.042236 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c85735981779438197f2c0f489681b96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c85735981779438197f2c0f489681b96 already in progress: creating tablet
W20260928 14:50:25.043805 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet afe58ef9809540cb942e3ec44296e36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afe58ef9809540cb942e3ec44296e36f already in progress: creating tablet
I20260928 14:50:25.045852 9855 tablet_bootstrap.cc:654] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.045643 9393 tablet_service.cc:1467] Processing CreateTablet for tablet e760d7e556a54fda9dc91300b9968c68 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.045840 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8c8624f9349a4608a48943487f01c7c8 (table default.Table_1d54df7671a0472193f255cb56c15768 [id=b8333e21752c4aabb04a7caeeb0515a3]) successfully deleted
W20260928 14:50:25.048046 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
W20260928 14:50:25.050155 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
I20260928 14:50:25.050637 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 91262a2cf39e4e5bb4854998332ca1f1 (DEFAULT_TABLE table=default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.051172 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ba281355b2f44b77a4ff99d49c084162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba281355b2f44b77a4ff99d49c084162 already in progress: creating tablet
W20260928 14:50:25.052407 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ca5c040fa6ba4e2785959874a3346bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5c040fa6ba4e2785959874a3346bf7 already in progress: creating tablet
W20260928 14:50:25.053767 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6891077c78ef4f3d84e33283096ddf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6891077c78ef4f3d84e33283096ddf7a already in progress: creating tablet
W20260928 14:50:25.055076 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cbd9f9cb48a945d19420a8bdb9bb9576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd9f9cb48a945d19420a8bdb9bb9576 already in progress: creating tablet
I20260928 14:50:25.053895 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.056281 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 already in progress: creating tablet
W20260928 14:50:25.057626 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5fc978ea3a194282aacc6ede22076c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc978ea3a194282aacc6ede22076c21 already in progress: creating tablet
W20260928 14:50:25.058611 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fd24e60a0e944f6086ff9c9fbe2e8180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd24e60a0e944f6086ff9c9fbe2e8180 already in progress: creating tablet
I20260928 14:50:25.059440 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91262a2cf39e4e5bb4854998332ca1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.060433 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f17ae9239f804baeb39a1a48f4dd7cd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.060987 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.063108 9384 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 57) took 1027 ms. Trace:
I20260928 14:50:25.063287 9384 rpcz_store.cc:276] 0928 14:50:24.035152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.035357 (+ 205us) service_pool.cc:227] Handling call
0928 14:50:24.927689 (+892332us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x6150000c24a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.043978 (+116289us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x6150001d1124. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.063060 (+ 19082us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2270376704}
I20260928 14:50:25.065321 9386 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 56) took 1076 ms. Trace:
I20260928 14:50:25.069653 9855 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.070462 9855 ts_tablet_manager.cc:1397] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.005s
I20260928 14:50:25.071344 9855 raft_consensus.cc:348] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.071656 9855 raft_consensus.cc:374] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.071779 9855 raft_consensus.cc:729] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.072172 9855 consensus_queue.cc:260] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.072849 9855 ts_tablet_manager.cc:1428] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:25.073292 9855 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.074730 9383 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 55) took 1089 ms. Trace:
I20260928 14:50:25.074673 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a1cd272b31e1467a86c2b1b03892c003" } new_table_name: "default.Table_63aadbcdd6154e2c9a14c72dbf61a86a" modify_external_catalogs: true
I20260928 14:50:25.074839 9383 rpcz_store.cc:276] 0928 14:50:23.985163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.985251 (+ 88us) service_pool.cc:227] Handling call
0928 14:50:24.928071 (+942820us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x6150000c24a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.044160 (+116089us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x6150001d1124. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.074696 (+ 30536us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2385750144}
I20260928 14:50:25.076151 9855 tablet_bootstrap.cc:654] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:25.081023 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdadb919c4554e5c89f8bb19cf3ddd75 consensus state has no leader
I20260928 14:50:25.087975 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_83ba9311fbec4366bffd4b7e122896b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.065449 9386 rpcz_store.cc:276] 0928 14:50:23.989126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.989312 (+ 186us) service_pool.cc:227] Handling call
0928 14:50:24.936243 (+946931us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x6150000c24a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.043929 (+107686us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x6150001d1124. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:25.065287 (+ 21358us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2351147136}
W20260928 14:50:25.089164 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83ba9311fbec4366bffd4b7e122896b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.090251 9855 tablet_bootstrap.cc:492] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.090378 9855 ts_tablet_manager.cc:1397] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260928 14:50:25.091013 9855 raft_consensus.cc:348] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.091145 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab3473736270443b95023ad0ed180aa3" } modify_external_catalogs: true
I20260928 14:50:25.091246 9855 raft_consensus.cc:374] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.091323 9855 raft_consensus.cc:729] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.091339 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab3473736270443b95023ad0ed180aa3" } modify_external_catalogs: true
I20260928 14:50:25.091521 9855 consensus_queue.cc:260] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.092018 9855 ts_tablet_manager.cc:1428] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:25.092259 9855 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.093734 9855 tablet_bootstrap.cc:654] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.095295 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e760d7e556a54fda9dc91300b9968c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.096961 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 46fe647c6d80431bbb76899126d01c3b
I20260928 14:50:25.099412 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.100276 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c05d25ef4674447eb0e6ddb533492f20" } modify_external_catalogs: true
I20260928 14:50:25.100452 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c05d25ef4674447eb0e6ddb533492f20" } modify_external_catalogs: true
I20260928 14:50:25.105943 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 605ccf9ad9ca4eb985374e065c48601a
I20260928 14:50:25.110751 9855 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.110904 9855 ts_tablet_manager.cc:1397] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260928 14:50:25.111259 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9d5d38ec9f8d453fb62f7f5c81287075" } new_table_name: "default.Table_97cf0529850e4562a081c0bffbef22af" modify_external_catalogs: true
I20260928 14:50:25.113430 9855 raft_consensus.cc:348] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.113698 9855 raft_consensus.cc:374] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.113767 9855 raft_consensus.cc:729] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.113994 9855 consensus_queue.cc:260] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.114668 9855 ts_tablet_manager.cc:1428] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:25.114957 9855 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.116389 9855 tablet_bootstrap.cc:654] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:25.118086 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eff9afcc868244aeb830fae2735da28d has no consensus state
I20260928 14:50:25.119028 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ce487be9bc85404e964691db4be47df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.119707 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce487be9bc85404e964691db4be47df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.125682 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 03245f72e0aa496d895968d8e5715b56 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.135087 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 4c101b1f03bb411f963f2348397c03e2 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.136627 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.137449 10054 raft_consensus.cc:482] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.137657 10054 raft_consensus.cc:504] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.138244 10054 leader_election.cc:288] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.142279 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 605ccf9ad9ca4eb985374e065c48601a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.142537 10094 raft_consensus.cc:482] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.141891 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:25.143006 9427 raft_consensus.cc:2454] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:25.143494 9498 leader_election.cc:302] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:25.143709 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a
I20260928 14:50:25.143862 10054 raft_consensus.cc:2781] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:25.143967 10054 raft_consensus.cc:482] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:25.144062 10054 raft_consensus.cc:3037] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.144234 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 82b042c6ffc148939dcba9b710f198d3 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.145448 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet f095e4cbf95147d9afb83434ae1fd29f from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:25.146229 9498 consensus_peers.cc:487] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 964985f048114f53ba1e685c7f1dbd6d. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:25.146699 10054 raft_consensus.cc:504] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.147610 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:25.147768 8956 catalog_manager.cc:6565] ReplaceTablet: tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a deleted and replaced by tablet a0d94bf844904306b84695e452d62ebd
W20260928 14:50:25.148245 9497 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.148656 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.149791 10054 leader_election.cc:288] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.150907 10107 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:25.151774 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 (DEFAULT_TABLE table=default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.152155 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5f68b570e4fff8f8748e4c762ad78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.152202 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet ce25abb4559241f58054f27435fd6078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.153401 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet cd8131f32f1a4153abf2967ca0a11619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.154392 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 0868e5ce22874134a2f50e2404970bb8 (DEFAULT_TABLE table=default.Table_ccdf4724e4eb4c6aac11f06d9d673a92 [id=066bd906e956423ea4fb9370314cfbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.154809 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.155850 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 0868e5ce22874134a2f50e2404970bb8 (DEFAULT_TABLE table=default.Table_ccdf4724e4eb4c6aac11f06d9d673a92 [id=066bd906e956423ea4fb9370314cfbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.156255 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0868e5ce22874134a2f50e2404970bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.157811 9815 tablet_replica.cc:330] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.158004 9815 raft_consensus.cc:2229] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.158187 9815 raft_consensus.cc:2258] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.158703 9815 ts_tablet_manager.cc:1905] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.162751 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.164885 9815 ts_tablet_manager.cc:1918] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.165059 9815 log.cc:1196] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ce25abb4559241f58054f27435fd6078
I20260928 14:50:25.165697 9815 ts_tablet_manager.cc:1939] T ce25abb4559241f58054f27435fd6078 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.166765 9815 tablet_replica.cc:330] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.167024 9815 raft_consensus.cc:2229] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:25.167339 9815 pending_rounds.cc:62] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:25.167536 9815 pending_rounds.cc:68] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326369592320000 op_type: NO_OP noop_request { }
I20260928 14:50:25.167768 9815 raft_consensus.cc:2866] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:25.167963 9815 raft_consensus.cc:2258] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.168274 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 4025017d30034ea3adc6b5fd55d18617 with delete_type TABLET_DATA_DELETED (replaced by tablet dfacaf069e3746aeb8ca11d95e65c5ea) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.169548 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:25.170089 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.170406 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.170586 9250 tablet_service.cc:1467] Processing CreateTablet for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (DEFAULT_TABLE table=default.Table_3b535897db044370b2eb23087fb0fb85 [id=53a8fdb3cf364603a1acdf162636cd80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.169726 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 82b042c6ffc148939dcba9b710f198d3
I20260928 14:50:25.170959 9426 raft_consensus.cc:3037] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.172201 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.174687 9532 tablet_service.cc:1467] Processing CreateTablet for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (DEFAULT_TABLE table=default.Table_3b535897db044370b2eb23087fb0fb85 [id=53a8fdb3cf364603a1acdf162636cd80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.175495 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.176928 9815 ts_tablet_manager.cc:1905] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.181777 8916 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu with pid 9741
I20260928 14:50:25.184163 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.169942 10094 raft_consensus.cc:504] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.181584 9546 tablet_service.cc:1467] Processing CreateTablet for tablet e760d7e556a54fda9dc91300b9968c68 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.187754 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e760d7e556a54fda9dc91300b9968c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.194690 9814 rpcz_store.cc:276] 0928 14:50:22.287681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.287811 (+ 130us) service_pool.cc:227] Handling call
0928 14:50:24.597577 (+2309766us) ts_tablet_manager.cc:1145] Deleting tablet cd8131f32f1a4153abf2967ca0a11619
0928 14:50:24.597585 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:24.762072 (+164487us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.879795 (+117723us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:24.915733 (+ 35938us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309545}
I20260928 14:50:25.195245 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 113) took 2998 ms. Trace:
I20260928 14:50:25.195858 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b4b4c775fe4eacaaa557d4daa2a600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.196975 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:25.198187 10094 leader_election.cc:288] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:25.198377 9360 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.199388 9848 tablet_bootstrap.cc:654] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.200240 9286 raft_consensus.cc:3037] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.189499 10121 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:25.205385 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051b7f0b1d0f4f638f3e7a69a027196e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.206274 10054 consensus_queue.cc:1035] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 14:50:25.208612 9497 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.210043 9263 tablet_service.cc:1467] Processing CreateTablet for tablet e760d7e556a54fda9dc91300b9968c68 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.211957 9360 consensus_peers.cc:487] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c8624f9349a4608a48943487f01c7c8. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:25.209651 9426 raft_consensus.cc:2454] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:25.198943 10116 tablet.cc:1722] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:25.215267 9498 leader_election.cc:302] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:25.216249 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 91262a2cf39e4e5bb4854998332ca1f1 (DEFAULT_TABLE table=default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.216663 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91262a2cf39e4e5bb4854998332ca1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.209702 9814 rpcz_store.cc:276] 0928 14:50:22.196336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.345303 (+148967us) service_pool.cc:227] Handling call
0928 14:50:25.195063 (+2849760us) ts_tablet_manager.cc:1145] Deleting tablet f05131db52e94d7c9f4856b0455246d2
0928 14:50:25.195076 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.195211 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2691702}
I20260928 14:50:25.219283 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.219395 9851 tablet_bootstrap.cc:492] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:25.219563 9851 ts_tablet_manager.cc:1397] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.374s user 0.003s sys 0.000s
I20260928 14:50:25.219564 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 605ccf9ad9ca4eb985374e065c48601a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.219866 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.221086 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 143) took 2697 ms. Trace:
I20260928 14:50:25.221874 9814 rpcz_store.cc:276] 0928 14:50:22.520771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.520842 (+ 71us) service_pool.cc:227] Handling call
0928 14:50:25.216969 (+2696127us) ts_tablet_manager.cc:1145] Deleting tablet 8193754d28d34c18bfc38ae0abd05f4c
0928 14:50:25.216981 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.217852 (+ 871us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2680582}
I20260928 14:50:25.222288 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 145) took 2690 ms. Trace:
I20260928 14:50:25.217247 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.224112 9814 rpcz_store.cc:276] 0928 14:50:22.531652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.531758 (+ 106us) service_pool.cc:227] Handling call
0928 14:50:25.222152 (+2690394us) ts_tablet_manager.cc:1145] Deleting tablet 8948e45987b94ca69004c42e224ce93f
0928 14:50:25.222164 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.222255 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2685680}
I20260928 14:50:25.224437 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 82b042c6ffc148939dcba9b710f198d3 deleted and replaced by tablet 82a58b7387564863a2141a722003c5d1
I20260928 14:50:25.224551 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 144) took 2693 ms. Trace:
I20260928 14:50:25.225133 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.225275 9814 rpcz_store.cc:276] 0928 14:50:22.530772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.530874 (+ 102us) service_pool.cc:227] Handling call
0928 14:50:25.224384 (+2693510us) ts_tablet_manager.cc:1145] Deleting tablet 89959226fd6247d4b89c54cc6ef4ede6
0928 14:50:25.224396 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.224517 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682223}
I20260928 14:50:25.225754 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 149) took 2645 ms. Trace:
W20260928 14:50:25.227110 9360 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.227591 9855 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.227845 9855 ts_tablet_manager.cc:1397] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.113s user 0.027s sys 0.022s
I20260928 14:50:25.228353 9360 leader_election.cc:302] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:25.229236 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_52f4944fc5ff419f9d917d898fd3ab51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.230280 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52f4944fc5ff419f9d917d898fd3ab51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.230696 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.232177 10117 raft_consensus.cc:2726] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:25.233223 9813 ts_tablet_manager.cc:1918] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.233412 9813 log.cc:1196] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5a64ffa786f045b480efe51eb69d7074
I20260928 14:50:25.233742 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.234375 9814 rpcz_store.cc:276] 0928 14:50:22.580526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.580645 (+ 119us) service_pool.cc:227] Handling call
0928 14:50:25.225592 (+2644947us) ts_tablet_manager.cc:1145] Deleting tablet 2a30439ac5a8485a9b6ebbe1371087b1
0928 14:50:25.225604 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.225708 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2606332}
I20260928 14:50:25.238742 10054 raft_consensus.cc:2781] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:25.238893 10054 raft_consensus.cc:686] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:25.239295 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ac61e6a117344388a152319868485978" } modify_external_catalogs: true
I20260928 14:50:25.239477 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ac61e6a117344388a152319868485978" } modify_external_catalogs: true
I20260928 14:50:25.240291 10054 consensus_queue.cc:237] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.240960 10096 tablet.cc:1717] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Skipping requested alter to schema version 5, tablet already version 5
I20260928 14:50:25.241918 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0868e5ce22874134a2f50e2404970bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.242182 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8555813545314aaebb0761b7f5dc260c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.242689 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8555813545314aaebb0761b7f5dc260c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.243629 9815 ts_tablet_manager.cc:1918] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:25.243736 9815 log.cc:1196] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cd8131f32f1a4153abf2967ca0a11619
I20260928 14:50:25.244261 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.245878 9851 raft_consensus.cc:348] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.247511 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b81e986eb6cf4b74bec8daef77d9395c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.248054 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b81e986eb6cf4b74bec8daef77d9395c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.248895 9815 ts_tablet_manager.cc:1939] T cd8131f32f1a4153abf2967ca0a11619 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.250155 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7e7048dd3ec54844a2182f31361f62e3" } new_table_name: "default.Table_7d607b7787a24d45ab4b4132688daf5f" modify_external_catalogs: true
I20260928 14:50:25.252486 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_85d4cf3440e84a1b831bbfa9df8c0233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.253054 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85d4cf3440e84a1b831bbfa9df8c0233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.253927 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cea2234b82444fc3ae83f35a7812668b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.254835 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 88015bcd867e40e5b9263930e820074a (table default.Table_f3f0e0c6daa54fecb0db72ae6e070f77 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:25.255496 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8de99502a21e4bd898e0642bd72a7aaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.256595 10068 raft_consensus.cc:482] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.257486 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.258049 9855 raft_consensus.cc:348] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.258425 9855 raft_consensus.cc:374] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.258524 9855 raft_consensus.cc:729] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.258661 9815 tablet_replica.cc:330] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.258849 9815 raft_consensus.cc:2229] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.258987 9815 raft_consensus.cc:2258] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.260295 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 91262a2cf39e4e5bb4854998332ca1f1 (DEFAULT_TABLE table=default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.260847 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 150) took 2626 ms. Trace:
I20260928 14:50:25.261358 9815 ts_tablet_manager.cc:1905] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:25.261466 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bdb6a6cea334521b13b5ebd47fbab98 consensus state has no leader
I20260928 14:50:25.258441 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 (DEFAULT_TABLE table=default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.262046 9851 raft_consensus.cc:374] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.262359 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e760d7e556a54fda9dc91300b9968c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.263722 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 605ccf9ad9ca4eb985374e065c48601a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.257776 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:25.264591 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8de99502a21e4bd898e0642bd72a7aaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.259178 9855 consensus_queue.cc:260] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.266001 9855 ts_tablet_manager.cc:1428] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260928 14:50:25.266250 9855 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:25.266253 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cea2234b82444fc3ae83f35a7812668b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.267728 9855 tablet_bootstrap.cc:654] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.268945 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aec40460d7f342a2985b89fc3e947fae" } modify_external_catalogs: true
I20260928 14:50:25.269181 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aec40460d7f342a2985b89fc3e947fae" } modify_external_catalogs: true
I20260928 14:50:25.262840 10068 raft_consensus.cc:504] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.271543 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_17561d3b320f424e9824ecfff9d5d407" } new_table_name: "default.Table_964ad582e5a24995b2497d7f1d90068d" modify_external_catalogs: true
I20260928 14:50:25.273638 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ef5bbf342a72427a9418d8f04f3e387f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.274514 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 01c1e945f1c54281856bfabe08fba42e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01c1e945f1c54281856bfabe08fba42e already in progress: creating tablet
I20260928 14:50:25.275461 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ce25abb4559241f58054f27435fd6078 (table default.Table_ab8b665217b04cf7a742ad3a5bda5573 [id=a95034bdd2ac4f5e9a36e1e16b407355]) successfully deleted
W20260928 14:50:25.276268 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef5bbf342a72427a9418d8f04f3e387f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.278198 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:25.278443 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94ac5cd43c05479f8516fdc0c30cbf22 consensus state has no leader
I20260928 14:50:25.260030 10117 consensus_queue.cc:1035] T 0795ca09ecfe433195e016d5d1f0dbc0 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260928 14:50:25.279294 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d42f6a8066b448a9aeb0d1c9ec0d9795" } new_table_name: "default.Table_2101de57a5b547ada12b8fc77a1452c7" modify_external_catalogs: true
I20260928 14:50:25.279372 9814 rpcz_store.cc:276] 0928 14:50:22.613281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:22.619398 (+ 6117us) service_pool.cc:227] Handling call
0928 14:50:25.234630 (+2615232us) ts_tablet_manager.cc:1145] Deleting tablet bad2124268994f04ae7153ea5aaeeab0
0928 14:50:25.234641 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.239271 (+ 4630us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2610793}
I20260928 14:50:25.280649 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91262a2cf39e4e5bb4854998332ca1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.280848 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 152) took 2226 ms. Trace:
I20260928 14:50:25.280965 9814 rpcz_store.cc:276] 0928 14:50:23.054008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.058079 (+ 4071us) service_pool.cc:227] Handling call
0928 14:50:25.280700 (+2222621us) ts_tablet_manager.cc:1145] Deleting tablet c9a7573c751d412aa8394d6277c28b7f
0928 14:50:25.280710 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.280805 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2222425}
I20260928 14:50:25.281322 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 154) took 2227 ms. Trace:
I20260928 14:50:25.281822 9815 ts_tablet_manager.cc:1918] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.281839 9851 raft_consensus.cc:729] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.282138 9851 consensus_queue.cc:260] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:25.284091 9256 consensus_meta.cc:287] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Time spent flushing consensus metadata: real 0.516s user 0.002s sys 0.001s
I20260928 14:50:25.287930 9815 log.cc:1196] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:25.288654 9815 ts_tablet_manager.cc:1939] T 0e661ac0a85949a280d837ee0357eea7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.281440 9814 rpcz_store.cc:276] 0928 14:50:23.054254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.082554 (+ 28300us) service_pool.cc:227] Handling call
0928 14:50:25.281186 (+2198632us) ts_tablet_manager.cc:1145] Deleting tablet 4c101b1f03bb411f963f2348397c03e2
0928 14:50:25.281194 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.281290 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198267}
I20260928 14:50:25.289891 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5f68b570e4fff8f8748e4c762ad78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.289829 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964985f048114f53ba1e685c7f1dbd6d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:25.295110 9815 tablet_replica.cc:330] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.295770 9815 raft_consensus.cc:2229] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:25.296104 9813 ts_tablet_manager.cc:1939] T 5a64ffa786f045b480efe51eb69d7074 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:25.296293 9815 pending_rounds.cc:62] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:25.296365 9815 pending_rounds.cc:68] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326370274013184 op_type: NO_OP noop_request { }
I20260928 14:50:25.296523 9815 raft_consensus.cc:2866] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:25.296634 9815 raft_consensus.cc:2258] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.296238 10107 tablet.cc:1722] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:25.298516 9815 ts_tablet_manager.cc:1905] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.298820 9848 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.299013 9848 ts_tablet_manager.cc:1397] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.279s user 0.007s sys 0.012s
I20260928 14:50:25.299597 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.299878 9848 raft_consensus.cc:348] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.300176 9848 raft_consensus.cc:374] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.300307 9848 raft_consensus.cc:729] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.300457 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 155) took 2236 ms. Trace:
I20260928 14:50:25.300724 9851 ts_tablet_manager.cc:1428] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.074s user 0.002s sys 0.001s
I20260928 14:50:25.301013 9851 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:25.301397 9848 consensus_queue.cc:260] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:25.301730 9247 consensus_meta.cc:287] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Time spent flushing consensus metadata: real 0.515s user 0.005s sys 0.000s
I20260928 14:50:25.302233 9848 ts_tablet_manager.cc:1428] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:25.302611 9814 rpcz_store.cc:276] 0928 14:50:23.054340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.091684 (+ 37344us) service_pool.cc:227] Handling call
0928 14:50:25.289702 (+2198018us) ts_tablet_manager.cc:1145] Deleting tablet ee16f4482a424538812f6356655acf77
0928 14:50:25.289713 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.290922 (+ 1209us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197768}
I20260928 14:50:25.303000 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 153) took 2248 ms. Trace:
I20260928 14:50:25.303177 10068 leader_election.cc:288] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.306619 9283 raft_consensus.cc:2454] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:25.307109 9360 leader_election.cc:302] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:25.307361 10094 raft_consensus.cc:2781] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:25.307515 10094 raft_consensus.cc:686] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:25.307765 10094 consensus_queue.cc:237] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.310658 9815 ts_tablet_manager.cc:1918] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:25.310789 9815 log.cc:1196] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/964985f048114f53ba1e685c7f1dbd6d
I20260928 14:50:25.311225 9815 ts_tablet_manager.cc:1939] T 964985f048114f53ba1e685c7f1dbd6d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.311856 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 208) took 1405 ms. Trace:
I20260928 14:50:25.312422 9814 rpcz_store.cc:276] 0928 14:50:23.054145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.092278 (+ 38133us) service_pool.cc:227] Handling call
0928 14:50:25.302862 (+2210584us) ts_tablet_manager.cc:1145] Deleting tablet 999aa56f1683464d9612a2ddbfbebbda
0928 14:50:25.302873 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.302959 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210376}
I20260928 14:50:25.315106 9815 tablet_replica.cc:330] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.315670 9815 raft_consensus.cc:2229] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:25.316141 9815 pending_rounds.cc:62] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:25.316522 9815 pending_rounds.cc:68] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326369301417984 op_type: NO_OP noop_request { }
I20260928 14:50:25.316998 9815 raft_consensus.cc:2866] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260928 14:50:25.317085 9220 leader_election.cc:341] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 964985f048114f53ba1e685c7f1dbd6d
I20260928 14:50:25.317517 9815 raft_consensus.cc:2258] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.317652 9813 rpcz_store.cc:276] 0928 14:50:23.906513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.907452 (+ 939us) service_pool.cc:227] Handling call
0928 14:50:25.027432 (+1119980us) ts_tablet_manager.cc:1145] Deleting tablet 5a64ffa786f045b480efe51eb69d7074
0928 14:50:25.027443 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.176021 (+148578us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.232867 (+ 56846us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.311813 (+ 78946us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112188}
I20260928 14:50:25.318300 9815 ts_tablet_manager.cc:1905] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.318490 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5a64ffa786f045b480efe51eb69d7074 (table default.Table_381accf700114544b20a817ee30e9fff [id=d1cbf4f020a44f349d4de94aa0a2f725]) successfully deleted
I20260928 14:50:25.312887 9848 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.320308 9848 tablet_bootstrap.cc:654] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.324944 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 209) took 1418 ms. Trace:
I20260928 14:50:25.325690 9815 ts_tablet_manager.cc:1918] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:25.325701 9813 rpcz_store.cc:276] 0928 14:50:23.906605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.907544 (+ 939us) service_pool.cc:227] Handling call
0928 14:50:25.324817 (+1417273us) ts_tablet_manager.cc:1145] Deleting tablet 4025017d30034ea3adc6b5fd55d18617
0928 14:50:25.324828 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.324914 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409344}
I20260928 14:50:25.323946 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 156) took 2261 ms. Trace:
I20260928 14:50:25.326990 9814 rpcz_store.cc:276] 0928 14:50:23.054454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.117847 (+ 63393us) service_pool.cc:227] Handling call
0928 14:50:25.312686 (+2194839us) ts_tablet_manager.cc:1145] Deleting tablet 6ffd9bc260ae4373a946ce82ba5f0d48
0928 14:50:25.312696 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.315751 (+ 3055us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2194639}
I20260928 14:50:25.327333 9814 tablet_replica.cc:330] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:25.327557 9814 raft_consensus.cc:2229] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.327759 9814 raft_consensus.cc:2258] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.327638 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 213) took 1363 ms. Trace:
I20260928 14:50:25.328332 9814 ts_tablet_manager.cc:1905] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.324101 9851 tablet_bootstrap.cc:654] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.328517 9813 rpcz_store.cc:276] 0928 14:50:23.964209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.964436 (+ 227us) service_pool.cc:227] Handling call
0928 14:50:25.327483 (+1363047us) ts_tablet_manager.cc:1145] Deleting tablet 1738a95895914cc4936a38e1d189d538
0928 14:50:25.327494 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.327603 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1340036}
W20260928 14:50:25.329748 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1738a95895914cc4936a38e1d189d538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1738a95895914cc4936a38e1d189d538 already in progress: creating tablet
I20260928 14:50:25.328763 10054 raft_consensus.cc:482] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.331126 9815 log.cc:1196] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9aeda483866146f89198e6f14456f0f2
I20260928 14:50:25.331012 9813 tablet_replica.cc:330] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.331153 10054 raft_consensus.cc:504] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.331513 9815 ts_tablet_manager.cc:1939] T 9aeda483866146f89198e6f14456f0f2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.331799 10054 leader_election.cc:288] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.332567 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:25.332772 9426 raft_consensus.cc:2454] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:25.333153 9498 leader_election.cc:302] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:25.333271 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.333590 10054 raft_consensus.cc:2781] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:25.333683 10054 raft_consensus.cc:482] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:25.333752 9497 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.333809 10054 raft_consensus.cc:3037] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.333163 9813 raft_consensus.cc:2229] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.334162 9815 tablet_replica.cc:330] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.334302 10121 tablet.cc:1717] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Skipping requested alter to schema version 5, tablet already version 5
I20260928 14:50:25.334355 9815 raft_consensus.cc:2229] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.334525 9815 pending_rounds.cc:62] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:25.334590 9815 pending_rounds.cc:68] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326368808538112 op_type: NO_OP noop_request { }
I20260928 14:50:25.334738 9815 raft_consensus.cc:2866] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:25.334856 9815 raft_consensus.cc:2258] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.336338 10054 raft_consensus.cc:504] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.336669 9815 ts_tablet_manager.cc:1905] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.336669 9813 raft_consensus.cc:2258] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.337163 9813 ts_tablet_manager.cc:1905] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.337448 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:25.334278 9220 leader_election.cc:302] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:25.337649 9426 raft_consensus.cc:3037] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.340317 9426 raft_consensus.cc:2454] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:25.340764 9498 leader_election.cc:302] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:25.340865 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 727cb249723946578bc5bb086d6e6c40 consensus state has no leader
I20260928 14:50:25.341040 10066 raft_consensus.cc:2781] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:25.341161 10066 raft_consensus.cc:686] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:25.341388 10066 consensus_queue.cc:237] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:25.342808 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 66808.1us
I20260928 14:50:25.342885 10054 leader_election.cc:288] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.343305 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cd8131f32f1a4153abf2967ca0a11619 (table default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]) successfully deleted
I20260928 14:50:25.346096 9815 ts_tablet_manager.cc:1918] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:25.346292 9815 log.cc:1196] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:25.346518 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3e689e2ffa4edb8ef1004287e40c99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:25.346865 9815 ts_tablet_manager.cc:1939] T 9b998502f90a4df08b4078f833ad8c05 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:25.346987 9497 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.348202 9815 tablet_replica.cc:330] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.348472 9815 raft_consensus.cc:2229] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.348734 9815 raft_consensus.cc:2258] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.349792 9815 ts_tablet_manager.cc:1905] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.351686 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 0e661ac0a85949a280d837ee0357eea7 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
I20260928 14:50:25.351917 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 964985f048114f53ba1e685c7f1dbd6d (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
W20260928 14:50:25.352886 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4025017d30034ea3adc6b5fd55d18617 because the tablet was not found. No further retry: Not found: Tablet not found: 4025017d30034ea3adc6b5fd55d18617
I20260928 14:50:25.354666 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9aeda483866146f89198e6f14456f0f2 (table default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]) successfully deleted
I20260928 14:50:25.356617 9855 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.356797 9855 ts_tablet_manager.cc:1397] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.015s
I20260928 14:50:25.358157 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9b998502f90a4df08b4078f833ad8c05 (table default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]) successfully deleted
W20260928 14:50:25.358935 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 46fe647c6d80431bbb76899126d01c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46fe647c6d80431bbb76899126d01c3b already in progress: creating tablet
I20260928 14:50:25.362344 9848 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.363076 9855 raft_consensus.cc:348] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.364717 9848 ts_tablet_manager.cc:1397] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.002s
I20260928 14:50:25.366164 9848 raft_consensus.cc:348] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.366513 9855 raft_consensus.cc:374] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.367154 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 767958659f4f450497eb5f2a3902993e
I20260928 14:50:25.369174 9855 raft_consensus.cc:729] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.369472 9815 ts_tablet_manager.cc:1918] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:25.369724 9815 log.cc:1196] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/605ccf9ad9ca4eb985374e065c48601a
I20260928 14:50:25.369777 9855 consensus_queue.cc:260] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.372293 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:25.372551 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8700d651fd7144bd9ecc15cfedcfb434 (table default.Table_b455ca1869df43c4a331171a93e88351 [id=0219eb70be1e4602b9b5542bafc4ddf0]). Expected version 4 got 0
I20260928 14:50:25.372957 8954 catalog_manager.cc:5495] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:25.373606 8949 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca] alter complete (version 5)
I20260928 14:50:25.374146 9855 ts_tablet_manager.cc:1428] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 14:50:25.375238 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c5c6b0867466459ca14413559800ff64
I20260928 14:50:25.370266 9815 ts_tablet_manager.cc:1939] T 605ccf9ad9ca4eb985374e065c48601a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.380669 9406 tablet_service.cc:1467] Processing CreateTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 (DEFAULT_TABLE table=default.Table_a8c275ee78b74930976e658a73224180 [id=c7a56fd7639749f79590b127587f602e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.381072 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea7b363d546c45ceb3efb9352cf184f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.368950 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.381649 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cd8131f32f1a4153abf2967ca0a11619 (table default.Table_09eb5c8c92d3443998fe2436f7097e34 [id=5d8ea8a471ec4cdaabceda4aa8a94312]) successfully deleted
I20260928 14:50:25.381743 9848 raft_consensus.cc:374] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.381870 9848 raft_consensus.cc:729] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.382088 9848 consensus_queue.cc:260] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.382879 9848 ts_tablet_manager.cc:1428] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 14:50:25.383248 9848 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.384801 9848 tablet_bootstrap.cc:654] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.387192 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa (DEFAULT_TABLE table=default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.387578 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56151b288b634d6bb0bc7113afa5fbaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.381964 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f05131db52e94d7c9f4856b0455246d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f05131db52e94d7c9f4856b0455246d2 already in progress: creating tablet
W20260928 14:50:25.388090 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8193754d28d34c18bfc38ae0abd05f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8193754d28d34c18bfc38ae0abd05f4c already in progress: creating tablet
W20260928 14:50:25.388880 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8948e45987b94ca69004c42e224ce93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8948e45987b94ca69004c42e224ce93f already in progress: creating tablet
W20260928 14:50:25.389464 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 89959226fd6247d4b89c54cc6ef4ede6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89959226fd6247d4b89c54cc6ef4ede6 already in progress: creating tablet
W20260928 14:50:25.390163 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2a30439ac5a8485a9b6ebbe1371087b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a30439ac5a8485a9b6ebbe1371087b1 already in progress: creating tablet
I20260928 14:50:25.375932 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:25.391506 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet bad2124268994f04ae7153ea5aaeeab0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bad2124268994f04ae7153ea5aaeeab0 already in progress: creating tablet
I20260928 14:50:25.392884 9404 tablet_service.cc:1467] Processing CreateTablet for tablet eff9afcc868244aeb830fae2735da28d (DEFAULT_TABLE table=default.Table_97cf0529850e4562a081c0bffbef22af [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.393217 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9afcc868244aeb830fae2735da28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.393702 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (DEFAULT_TABLE table=default.Table_f88389a6ed06462ca9081dc83b5ca5c8 [id=b59cd90b4cc5420fbf378dc148eb2278]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.394057 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e325cbe459440cfa0f3cf9fd026cbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.399073 9397 tablet_service.cc:1467] Processing CreateTablet for tablet ab71087d034c4bedb06df9e5ccefad45 (DEFAULT_TABLE table=default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d [id=c21ae162198d4e5393efc4d962fd68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.399421 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab71087d034c4bedb06df9e5ccefad45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.402381 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4c101b1f03bb411f963f2348397c03e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c101b1f03bb411f963f2348397c03e2 already in progress: creating tablet
W20260928 14:50:25.403445 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ee16f4482a424538812f6356655acf77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee16f4482a424538812f6356655acf77 already in progress: creating tablet
I20260928 14:50:25.403426 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (DEFAULT_TABLE table=default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.403789 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.404706 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 01dd30e15c31498299ca5f5a3b2770e9 (DEFAULT_TABLE table=default.Table_e17941e9c752452db972f396574c6bb8 [id=b58aea2205304defa62befcee84dfa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.405035 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dd30e15c31498299ca5f5a3b2770e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.405817 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 59ced67c921e43e48bcb5195da212582 (DEFAULT_TABLE table=default.Table_c32a09c9daa14648bc55f4c122874b5e [id=ca5392bf870e48a5bfd32b024c85a0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.406147 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ced67c921e43e48bcb5195da212582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.410279 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (DEFAULT_TABLE table=default.Table_13f0b42ecf494238af4b6d0b8e5c865e [id=f894dbddace24e628c6a53906c5c51ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.410612 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f54c1b1f9054e1c9adfda720784e5a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.410858 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 999aa56f1683464d9612a2ddbfbebbda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 999aa56f1683464d9612a2ddbfbebbda already in progress: creating tablet
W20260928 14:50:25.411144 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ffd9bc260ae4373a946ce82ba5f0d48 already in progress: creating tablet
I20260928 14:50:25.413759 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 36613153c867446f9255d2290cfd9d06 (DEFAULT_TABLE table=default.Table_8ab3c482b7f2466091a9c8741dc3a1c5 [id=d213f661362a45358bbc71ba5fcd8986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.414129 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36613153c867446f9255d2290cfd9d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.414247 9848 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.414397 9848 ts_tablet_manager.cc:1397] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.005s
I20260928 14:50:25.414685 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]). Expected version 5 got 4
I20260928 14:50:25.415196 9848 raft_consensus.cc:348] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.415562 9848 raft_consensus.cc:374] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.415643 9848 raft_consensus.cc:729] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.415858 9848 consensus_queue.cc:260] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.416415 9848 ts_tablet_manager.cc:1428] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:25.417591 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.417892 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8234670cb2604ba7b405ad7f70e03a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.417804 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6" } modify_external_catalogs: true
I20260928 14:50:25.418006 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6" } modify_external_catalogs: true
I20260928 14:50:25.420756 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa (DEFAULT_TABLE table=default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.421128 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56151b288b634d6bb0bc7113afa5fbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.422847 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.423398 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.423671 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.423877 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 964985f048114f53ba1e685c7f1dbd6d with delete_type TABLET_DATA_DELETED (replaced by tablet 03245f72e0aa496d895968d8e5715b56) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.424023 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.424361 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa (DEFAULT_TABLE table=default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.424732 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56151b288b634d6bb0bc7113afa5fbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.427414 9848 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.428920 9848 tablet_bootstrap.cc:654] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.430320 9536 tablet_service.cc:1467] Processing CreateTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 (DEFAULT_TABLE table=default.Table_a8c275ee78b74930976e658a73224180 [id=c7a56fd7639749f79590b127587f602e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.430646 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea7b363d546c45ceb3efb9352cf184f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.431850 9855 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.435398 9813 ts_tablet_manager.cc:1918] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.435531 9813 log.cc:1196] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:25.436610 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.436796 9855 tablet_bootstrap.cc:654] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.437147 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e865f14ddc4b0c8ce0877cd99f5972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.437623 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.438078 9815 tablet_replica.cc:330] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.438275 9815 raft_consensus.cc:2229] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.438426 9815 raft_consensus.cc:2258] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.439196 9815 ts_tablet_manager.cc:1905] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.439177 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_c05d25ef4674447eb0e6ddb533492f20 [id=763f6cc484294611b96035248c14066d]) successfully deleted
W20260928 14:50:25.439409 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a already in progress: creating tablet
W20260928 14:50:25.439615 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 82b042c6ffc148939dcba9b710f198d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82b042c6ffc148939dcba9b710f198d3 already in progress: creating tablet
I20260928 14:50:25.440187 9546 tablet_service.cc:1467] Processing CreateTablet for tablet ab71087d034c4bedb06df9e5ccefad45 (DEFAULT_TABLE table=default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d [id=c21ae162198d4e5393efc4d962fd68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.440636 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab71087d034c4bedb06df9e5ccefad45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.441831 10066 raft_consensus.cc:482] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.441992 10066 raft_consensus.cc:504] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.442577 10066 leader_election.cc:288] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.443279 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_85d4cf3440e84a1b831bbfa9df8c0233" } new_table_name: "default.Table_4a42fd88515046c7a669b993ffd4bb23" modify_external_catalogs: true
I20260928 14:50:25.444417 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:25.444617 9426 raft_consensus.cc:2454] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:25.445430 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_55ee447211854085bcb9b589d08b9f0a" } modify_external_catalogs: true
I20260928 14:50:25.446471 9815 ts_tablet_manager.cc:1918] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.446625 9815 log.cc:1196] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/29e865f14ddc4b0c8ce0877cd99f5972
I20260928 14:50:25.447005 9815 ts_tablet_manager.cc:1939] T 29e865f14ddc4b0c8ce0877cd99f5972 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.447661 10058 raft_consensus.cc:482] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.447793 10058 raft_consensus.cc:504] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.445494 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a70aa2d62a9c4fb29ba8ebdd82d8743d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.448323 10058 leader_election.cc:288] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:25.448385 9815 tablet_replica.cc:330] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.448315 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_76b48abaef274af990732cd99117b001" } new_table_name: "default.Table_ea1a9bd38c2c49e382251934deb941a6" modify_external_catalogs: true
W20260928 14:50:25.448566 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70aa2d62a9c4fb29ba8ebdd82d8743d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.448545 9815 raft_consensus.cc:2229] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.448786 9815 raft_consensus.cc:2258] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.448843 9498 leader_election.cc:302] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:25.449155 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.445618 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_55ee447211854085bcb9b589d08b9f0a" } modify_external_catalogs: true
I20260928 14:50:25.449926 9815 ts_tablet_manager.cc:1905] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.446381 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_910b553832a74282801d23da9050185b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.450484 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_910b553832a74282801d23da9050185b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.447547 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_354f08bdef784c8ab09d3cabf60e928b" } modify_external_catalogs: true
I20260928 14:50:25.451675 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_354f08bdef784c8ab09d3cabf60e928b" } modify_external_catalogs: true
I20260928 14:50:25.447592 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6aecd9c9eb214e7b8ee8656d158656d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.452433 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6aecd9c9eb214e7b8ee8656d158656d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.454484 8946 catalog_manager.cc:5495] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:25.454937 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:25.457943 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:25.459996 9855 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.460285 9813 ts_tablet_manager.cc:1939] T e0ee1e19142b402f96056c387140b5ca P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:25.460661 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 has no consensus state
W20260928 14:50:25.461819 9360 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:25.462541 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 767958659f4f450497eb5f2a3902993e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 767958659f4f450497eb5f2a3902993e already in progress: creating tablet
I20260928 14:50:25.462767 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.463676 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (DEFAULT_TABLE table=default.Table_f88389a6ed06462ca9081dc83b5ca5c8 [id=b59cd90b4cc5420fbf378dc148eb2278]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.463992 9855 ts_tablet_manager.cc:1397] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.001s
I20260928 14:50:25.464092 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e325cbe459440cfa0f3cf9fd026cbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.464262 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 59ced67c921e43e48bcb5195da212582 (DEFAULT_TABLE table=default.Table_c32a09c9daa14648bc55f4c122874b5e [id=ca5392bf870e48a5bfd32b024c85a0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.464594 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ced67c921e43e48bcb5195da212582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.464828 9855 raft_consensus.cc:348] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.465060 9855 raft_consensus.cc:374] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.465166 9855 raft_consensus.cc:729] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.465378 9855 consensus_queue.cc:260] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.465848 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 220) took 1448 ms. Trace:
I20260928 14:50:25.465862 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (DEFAULT_TABLE table=default.Table_13f0b42ecf494238af4b6d0b8e5c865e [id=f894dbddace24e628c6a53906c5c51ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.465947 9813 rpcz_store.cc:276] 0928 14:50:24.012438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.012520 (+ 82us) service_pool.cc:227] Handling call
0928 14:50:25.330617 (+1318097us) ts_tablet_manager.cc:1145] Deleting tablet e0ee1e19142b402f96056c387140b5ca
0928 14:50:25.330630 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.370310 (+ 39680us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.435305 (+ 64995us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.460678 (+ 25373us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1315301}
I20260928 14:50:25.466182 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f54c1b1f9054e1c9adfda720784e5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.466379 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet e0ee1e19142b402f96056c387140b5ca (table default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]) successfully deleted
I20260928 14:50:25.466995 9813 tablet_replica.cc:330] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.467162 9813 raft_consensus.cc:2229] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:25.467384 9813 pending_rounds.cc:62] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:25.467435 9813 pending_rounds.cc:68] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326375662575616 op_type: NO_OP noop_request { }
I20260928 14:50:25.467561 9813 raft_consensus.cc:2866] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:25.467661 9813 raft_consensus.cc:2258] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.468307 9540 tablet_service.cc:1467] Processing CreateTablet for tablet eff9afcc868244aeb830fae2735da28d (DEFAULT_TABLE table=default.Table_97cf0529850e4562a081c0bffbef22af [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.468685 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9afcc868244aeb830fae2735da28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.469172 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.464006 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 01dd30e15c31498299ca5f5a3b2770e9 (DEFAULT_TABLE table=default.Table_e17941e9c752452db972f396574c6bb8 [id=b58aea2205304defa62befcee84dfa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.469691 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dd30e15c31498299ca5f5a3b2770e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.470134 9362 connection.cc:535] client connection to 127.8.181.60:39777 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 14:50:25.463630 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (DEFAULT_TABLE table=default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.468677 9815 ts_tablet_manager.cc:1918] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.471611 9815 log.cc:1196] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5a64ffa786f045b480efe51eb69d7074
W20260928 14:50:25.472455 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c5c6b0867466459ca14413559800ff64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c6b0867466459ca14413559800ff64 already in progress: creating tablet
W20260928 14:50:25.472705 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9b998502f90a4df08b4078f833ad8c05 because the tablet was not found. No further retry: Not found: Tablet not found: 9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:25.472990 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 29e865f14ddc4b0c8ce0877cd99f5972 (table default.Table_d47d9dc144824b13a05a1a8ed9fc5382 [id=4431be8698914255814800147776a1bd]) successfully deleted
I20260928 14:50:25.473764 10054 raft_consensus.cc:2781] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 14:50:25.473780 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 962a5dee53514f7ab5a63242f7d70446 consensus state has no leader
I20260928 14:50:25.473811 9821 raft_consensus.cc:482] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.474442 9821 raft_consensus.cc:504] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.474463 10054 raft_consensus.cc:482] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:25.475028 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.475732 10054 raft_consensus.cc:3037] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.475764 9821 leader_election.cc:288] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.509222 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 89959226fd6247d4b89c54cc6ef4ede6 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.511427 9848 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.511790 9848 ts_tablet_manager.cc:1397] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.093s user 0.013s sys 0.013s
I20260928 14:50:25.515126 9848 raft_consensus.cc:348] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.516017 9848 raft_consensus.cc:374] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.516383 9848 raft_consensus.cc:729] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.516963 9848 consensus_queue.cc:260] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.518476 9855 ts_tablet_manager.cc:1428] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260928 14:50:25.519712 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 36613153c867446f9255d2290cfd9d06 (DEFAULT_TABLE table=default.Table_8ab3c482b7f2466091a9c8741dc3a1c5 [id=d213f661362a45358bbc71ba5fcd8986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.519860 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.520117 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36613153c867446f9255d2290cfd9d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.521317 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8234670cb2604ba7b405ad7f70e03a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.522543 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet ed0d79a39b2543049506422432990617 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.527257 9815 ts_tablet_manager.cc:1939] T 5a64ffa786f045b480efe51eb69d7074 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.527693 9855 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.529665 9848 ts_tablet_manager.cc:1428] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260928 14:50:25.529678 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 852b70b1f7444ad2ab92d66d580a0db7 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.530332 9848 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.531937 9848 tablet_bootstrap.cc:654] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.534077 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:25.534353 9426 raft_consensus.cc:2454] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:25.537108 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.537432 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:25.541421 10144 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 14:50:25.471050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.181.60:39777 (local address 127.8.181.2:58983)
0928 14:50:25.525503 (+ 54453us) negotiation.cc:107] Waiting for socket to connect
0928 14:50:25.541150 (+ 15647us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54314,"thread_start_us":59135,"threads_started":1}
I20260928 14:50:25.541791 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.542450 9262 tablet_service.cc:1467] Processing CreateTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 (DEFAULT_TABLE table=default.Table_a8c275ee78b74930976e658a73224180 [id=c7a56fd7639749f79590b127587f602e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.542836 9283 raft_consensus.cc:2454] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:25.544128 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:25.545171 9360 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.545325 9360 leader_election.cc:302] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:25.545706 10058 raft_consensus.cc:2726] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:25.546025 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.546296 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (DEFAULT_TABLE table=default.Table_f88389a6ed06462ca9081dc83b5ca5c8 [id=b59cd90b4cc5420fbf378dc148eb2278]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.547214 9261 tablet_service.cc:1467] Processing CreateTablet for tablet eff9afcc868244aeb830fae2735da28d (DEFAULT_TABLE table=default.Table_97cf0529850e4562a081c0bffbef22af [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.547379 10068 raft_consensus.cc:2726] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 14:50:25.547564 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (DEFAULT_TABLE table=default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.544207 9254 tablet_service.cc:1467] Processing CreateTablet for tablet ab71087d034c4bedb06df9e5ccefad45 (DEFAULT_TABLE table=default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d [id=c21ae162198d4e5393efc4d962fd68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.549832 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 01dd30e15c31498299ca5f5a3b2770e9 (DEFAULT_TABLE table=default.Table_e17941e9c752452db972f396574c6bb8 [id=b58aea2205304defa62befcee84dfa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.549952 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea7b363d546c45ceb3efb9352cf184f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.550207 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dd30e15c31498299ca5f5a3b2770e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.551178 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.551748 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e325cbe459440cfa0f3cf9fd026cbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.552349 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9afcc868244aeb830fae2735da28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.552964 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab71087d034c4bedb06df9e5ccefad45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.554574 9851 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:25.554725 8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.60:39777, user_credentials={real_user=slave}} blocked reactor thread for 122522us
I20260928 14:50:25.560350 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (DEFAULT_TABLE table=default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.560720 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.561977 9851 ts_tablet_manager.cc:1397] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.254s user 0.005s sys 0.037s
I20260928 14:50:25.562701 9851 raft_consensus.cc:348] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.563411 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 78379bd4cfce46fa812374f046d9d329 (DEFAULT_TABLE table=default.Table_cea2234b82444fc3ae83f35a7812668b [id=4808092de350419bba3b7bffa8967276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.563808 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78379bd4cfce46fa812374f046d9d329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.565819 9388 tablet_service.cc:1467] Processing CreateTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (DEFAULT_TABLE table=default.Table_4a42fd88515046c7a669b993ffd4bb23 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.566182 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.567142 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 55c81b682dea493fac8665d8ccff7199 (DEFAULT_TABLE table=default.Table_83ba9311fbec4366bffd4b7e122896b7 [id=e09b7259d9ab4c90942dbf9b72da8a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.567556 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c81b682dea493fac8665d8ccff7199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.568086 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed (DEFAULT_TABLE table=default.Table_ce487be9bc85404e964691db4be47df6 [id=27d3ad1dac4641e2b16e86da4d16ea0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.568400 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d6b4482e7b42fca17e5b917e1c1bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.569829 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.570125 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.573325 9851 raft_consensus.cc:374] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.573472 9851 raft_consensus.cc:729] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.575441 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb (DEFAULT_TABLE table=default.Table_ef5bbf342a72427a9418d8f04f3e387f [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.575802 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f04c05cdad04261a1e2ae7e044ddbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.578658 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:25.581907 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 92d1100b862b4170807be02a39307359 (DEFAULT_TABLE table=default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.582803 9814 ts_tablet_manager.cc:1918] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.583144 9498 leader_election.cc:302] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:25.584511 9394 tablet_service.cc:1467] Processing CreateTablet for tablet a0d94bf844904306b84695e452d62ebd (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.584717 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (DEFAULT_TABLE table=default.Table_13f0b42ecf494238af4b6d0b8e5c865e [id=f894dbddace24e628c6a53906c5c51ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.585747 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 59ced67c921e43e48bcb5195da212582 (DEFAULT_TABLE table=default.Table_c32a09c9daa14648bc55f4c122874b5e [id=ca5392bf870e48a5bfd32b024c85a0b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.586087 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ced67c921e43e48bcb5195da212582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.587085 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_163954843d7844c084b6b7fb63f8c121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.587515 9814 log.cc:1196] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/315c446d87c84ae4bc9cb3243dca5538
I20260928 14:50:25.587649 9815 tablet_replica.cc:330] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:25.587690 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_163954843d7844c084b6b7fb63f8c121 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.587744 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 36613153c867446f9255d2290cfd9d06 (DEFAULT_TABLE table=default.Table_8ab3c482b7f2466091a9c8741dc3a1c5 [id=d213f661362a45358bbc71ba5fcd8986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.587088 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.588337 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 48425us
I20260928 14:50:25.588452 9814 ts_tablet_manager.cc:1939] T 315c446d87c84ae4bc9cb3243dca5538 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:25.588521 10066 raft_consensus.cc:2781] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:25.588603 10066 raft_consensus.cc:482] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:25.588699 10066 raft_consensus.cc:3037] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.588807 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 82a58b7387564863a2141a722003c5d1 (DEFAULT_TABLE table=default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.588884 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c32a09c9daa14648bc55f4c122874b5e" } new_table_name: "default.Table_6459cd3ed4fe42c897a4fbe2d97611eb" modify_external_catalogs: true
I20260928 14:50:25.589761 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d1100b862b4170807be02a39307359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.589967 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 164) took 2451 ms. Trace:
I20260928 14:50:25.590063 9814 rpcz_store.cc:276] 0928 14:50:23.137917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.137984 (+ 67us) service_pool.cc:227] Handling call
0928 14:50:25.327281 (+2189297us) ts_tablet_manager.cc:1145] Deleting tablet 315c446d87c84ae4bc9cb3243dca5538
0928 14:50:25.327291 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.534452 (+207161us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.555144 (+ 20692us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.589170 (+ 34026us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2188932}
I20260928 14:50:25.590098 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3f13997bc23f4c269c14e70a3f8765ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.590562 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f13997bc23f4c269c14e70a3f8765ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.590667 9815 raft_consensus.cc:2229] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.590833 9815 raft_consensus.cc:2258] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.591144 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f54c1b1f9054e1c9adfda720784e5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.591364 9815 ts_tablet_manager.cc:1905] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.591585 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8d74997e24e947b09eae991bafdc55ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.592063 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d74997e24e947b09eae991bafdc55ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.587620 9851 consensus_queue.cc:260] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.592913 9851 ts_tablet_manager.cc:1428] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260928 14:50:25.593076 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2c60594fff144e6fb1bcfacebce32be3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.593406 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 78379bd4cfce46fa812374f046d9d329 (DEFAULT_TABLE table=default.Table_cea2234b82444fc3ae83f35a7812668b [id=4808092de350419bba3b7bffa8967276]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.593497 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c60594fff144e6fb1bcfacebce32be3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.595432 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ed0d79a39b2543049506422432990617
I20260928 14:50:25.595831 8953 catalog_manager.cc:6565] ReplaceTablet: tablet ed0d79a39b2543049506422432990617 deleted and replaced by tablet f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:25.596050 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8234670cb2604ba7b405ad7f70e03a2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.596133 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_520e7cce9fb941bbb5019c3c73d1132f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.596561 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_520e7cce9fb941bbb5019c3c73d1132f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.597383 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (DEFAULT_TABLE table=default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.597580 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 75f9359df0ac466c912cd20fc6b94390
I20260928 14:50:25.597724 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.598392 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cb11d2465a0e4ab3b8c2ec23b1b3d29d" } new_table_name: "default.Table_6e50a29433014e98b687ee424debf6d5" modify_external_catalogs: true
I20260928 14:50:25.599124 9821 raft_consensus.cc:482] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.599489 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a1608818b298453997453a37acde832f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.599943 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1608818b298453997453a37acde832f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.599875 9821 raft_consensus.cc:504] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.600294 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 165) took 2452 ms. Trace:
I20260928 14:50:25.600476 9821 leader_election.cc:288] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:25.601500 9497 leader_election.cc:341] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.604383 9855 tablet_bootstrap.cc:654] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.604691 9404 tablet_service.cc:1467] Processing CreateTablet for tablet eae5af64cea44e7f86358edae40caa99 (DEFAULT_TABLE table=default.Table_b81e986eb6cf4b74bec8daef77d9395c [id=d656efb4270c4f649d1e21a248de2bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.605041 9390 tablet_service.cc:1467] Processing CreateTablet for tablet bef0b52d178f4baeae621da769f6d518 (DEFAULT_TABLE table=default.Table_52f4944fc5ff419f9d917d898fd3ab51 [id=05fde8fccafd446eaec21e4d8de7071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.605227 9814 rpcz_store.cc:276] 0928 14:50:23.138185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.140898 (+ 2713us) service_pool.cc:227] Handling call
0928 14:50:25.590300 (+2449402us) ts_tablet_manager.cc:1145] Deleting tablet 0e53b8b73b37464687d343493d186660
0928 14:50:25.590310 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.590403 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2449116}
I20260928 14:50:25.605363 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 41b8584ba1914c3390aee99baaee289e (DEFAULT_TABLE table=default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.605674 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d94bf844904306b84695e452d62ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.605945 9253 tablet_service.cc:1467] Processing CreateTablet for tablet a0d94bf844904306b84695e452d62ebd (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.608286 9851 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:25.609611 9497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 57707.5us
I20260928 14:50:25.609668 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae5af64cea44e7f86358edae40caa99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.609844 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb (DEFAULT_TABLE table=default.Table_ef5bbf342a72427a9418d8f04f3e387f [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.610198 9264 tablet_service.cc:1467] Processing CreateTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (DEFAULT_TABLE table=default.Table_4a42fd88515046c7a669b993ffd4bb23 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.608074 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 82a58b7387564863a2141a722003c5d1 (DEFAULT_TABLE table=default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.611387 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 92d1100b862b4170807be02a39307359 (DEFAULT_TABLE table=default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.608186 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed (DEFAULT_TABLE table=default.Table_ce487be9bc85404e964691db4be47df6 [id=27d3ad1dac4641e2b16e86da4d16ea0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.613992 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (DEFAULT_TABLE table=default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.614171 9532 tablet_service.cc:1467] Processing CreateTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (DEFAULT_TABLE table=default.Table_4a42fd88515046c7a669b993ffd4bb23 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.614351 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.614609 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b8584ba1914c3390aee99baaee289e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.615167 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.616093 9267 tablet_service.cc:1467] Processing CreateTablet for tablet eae5af64cea44e7f86358edae40caa99 (DEFAULT_TABLE table=default.Table_b81e986eb6cf4b74bec8daef77d9395c [id=d656efb4270c4f649d1e21a248de2bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.617925 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36613153c867446f9255d2290cfd9d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.618113 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bef0b52d178f4baeae621da769f6d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.620746 9537 tablet_service.cc:1467] Processing CreateTablet for tablet a0d94bf844904306b84695e452d62ebd (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.621258 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb (DEFAULT_TABLE table=default.Table_ef5bbf342a72427a9418d8f04f3e387f [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.621683 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed (DEFAULT_TABLE table=default.Table_ce487be9bc85404e964691db4be47df6 [id=27d3ad1dac4641e2b16e86da4d16ea0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.621949 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a58b7387564863a2141a722003c5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.622992 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def872f66b2541b9af6084e93d991ec2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.623286 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 55c81b682dea493fac8665d8ccff7199 (DEFAULT_TABLE table=default.Table_83ba9311fbec4366bffd4b7e122896b7 [id=e09b7259d9ab4c90942dbf9b72da8a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.624787 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d6b4482e7b42fca17e5b917e1c1bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.625876 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 92d1100b862b4170807be02a39307359 (DEFAULT_TABLE table=default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.626894 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8700d651fd7144bd9ecc15cfedcfb434 (table default.Table_b455ca1869df43c4a331171a93e88351 [id=0219eb70be1e4602b9b5542bafc4ddf0]). Expected version 4 got 0
I20260928 14:50:25.627776 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c81b682dea493fac8665d8ccff7199. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.627899 8941 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Couldn't send request to peer c6b99976d8024a79a0603523b9d32f29. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:25.629346 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.629305 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 78379bd4cfce46fa812374f046d9d329 (DEFAULT_TABLE table=default.Table_cea2234b82444fc3ae83f35a7812668b [id=4808092de350419bba3b7bffa8967276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.631089 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 55c81b682dea493fac8665d8ccff7199 (DEFAULT_TABLE table=default.Table_83ba9311fbec4366bffd4b7e122896b7 [id=e09b7259d9ab4c90942dbf9b72da8a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.632984 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a58b7387564863a2141a722003c5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.633627 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae5af64cea44e7f86358edae40caa99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.634419 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d1100b862b4170807be02a39307359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.634660 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.635907 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f04c05cdad04261a1e2ae7e044ddbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.635430 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0d79a39b2543049506422432990617 with delete_type TABLET_DATA_DELETED (replaced by tablet f28a74dc0afe4f20b47139a703550ef6) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.639914 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d94bf844904306b84695e452d62ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.640048 9813 ts_tablet_manager.cc:1905] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.640631 10098 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:25.640923 10098 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:25.641840 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2f0b97883acb4adfa4091653545e894b
I20260928 14:50:25.644177 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78379bd4cfce46fa812374f046d9d329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.646644 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59ced67c921e43e48bcb5195da212582 consensus state has no leader
I20260928 14:50:25.648082 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.649055 9851 tablet_bootstrap.cc:654] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.649992 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 166) took 2484 ms. Trace:
I20260928 14:50:25.650122 9814 rpcz_store.cc:276] 0928 14:50:23.138343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.138394 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:25.605552 (+2467158us) ts_tablet_manager.cc:1145] Deleting tablet 311e4286b2a943ee924ac1c25dc9ca46
0928 14:50:25.605561 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.622557 (+ 16996us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2456380}
I20260928 14:50:25.650638 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 168) took 2464 ms. Trace:
I20260928 14:50:25.650746 9814 rpcz_store.cc:276] 0928 14:50:23.186651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.186713 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:25.650430 (+2463717us) ts_tablet_manager.cc:1145] Deleting tablet 6a50b4fe8d86464f933baec07478db25
0928 14:50:25.650443 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.650581 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463463}
I20260928 14:50:25.651146 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 167) took 2512 ms. Trace:
I20260928 14:50:25.651249 9814 rpcz_store.cc:276] 0928 14:50:23.138489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.138615 (+ 126us) service_pool.cc:227] Handling call
0928 14:50:25.650983 (+2512368us) ts_tablet_manager.cc:1145] Deleting tablet 32e7e11092d1475cba53e51a0f61d6f1
0928 14:50:25.650995 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.651093 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2462257}
I20260928 14:50:25.651633 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 176) took 2344 ms. Trace:
I20260928 14:50:25.651737 9814 rpcz_store.cc:276] 0928 14:50:23.306733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.306777 (+ 44us) service_pool.cc:227] Handling call
0928 14:50:25.651476 (+2344699us) ts_tablet_manager.cc:1145] Deleting tablet 066df778654449bda96f68b5035c4d73
0928 14:50:25.651487 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.651580 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344446}
I20260928 14:50:25.652115 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 177) took 2344 ms. Trace:
I20260928 14:50:25.652215 9814 rpcz_store.cc:276] 0928 14:50:23.307162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.307209 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:25.651971 (+2344762us) ts_tablet_manager.cc:1145] Deleting tablet 7cc4c49a4962473699103528b64a1005
0928 14:50:25.651981 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.652063 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344521}
I20260928 14:50:25.652618 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 178) took 2345 ms. Trace:
I20260928 14:50:25.652998 9813 ts_tablet_manager.cc:1918] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:25.653630 9813 log.cc:1196] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/29e865f14ddc4b0c8ce0877cd99f5972
I20260928 14:50:25.654117 9813 ts_tablet_manager.cc:1939] T 29e865f14ddc4b0c8ce0877cd99f5972 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:25.658159 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d94bf844904306b84695e452d62ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.658955 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 221) took 1642 ms. Trace:
I20260928 14:50:25.659106 9813 rpcz_store.cc:276] 0928 14:50:24.016804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.017596 (+ 792us) service_pool.cc:227] Handling call
0928 14:50:25.466924 (+1449328us) ts_tablet_manager.cc:1145] Deleting tablet 29e865f14ddc4b0c8ce0877cd99f5972
0928 14:50:25.466934 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.646053 (+179119us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.652893 (+ 6840us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.658910 (+ 6017us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1427978}
I20260928 14:50:25.659536 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 29e865f14ddc4b0c8ce0877cd99f5972 (table default.Table_d47d9dc144824b13a05a1a8ed9fc5382 [id=4431be8698914255814800147776a1bd]) successfully deleted
I20260928 14:50:25.659000 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.659905 9813 tablet_replica.cc:330] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.660097 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d1100b862b4170807be02a39307359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.660120 9813 raft_consensus.cc:2229] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.660364 9813 raft_consensus.cc:2258] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.660385 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c81b682dea493fac8665d8ccff7199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.660876 9813 ts_tablet_manager.cc:1905] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.662534 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.662802 10054 raft_consensus.cc:504] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.663498 10054 leader_election.cc:288] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.667280 9813 ts_tablet_manager.cc:1918] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.667734 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f04c05cdad04261a1e2ae7e044ddbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.669585 10066 raft_consensus.cc:504] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.664669 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 41b8584ba1914c3390aee99baaee289e (DEFAULT_TABLE table=default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.670811 10066 leader_election.cc:288] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.672994 9813 log.cc:1196] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/def872f66b2541b9af6084e93d991ec2
I20260928 14:50:25.673353 9813 ts_tablet_manager.cc:1939] T def872f66b2541b9af6084e93d991ec2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:25.674046 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 223) took 1657 ms. Trace:
I20260928 14:50:25.674154 9813 rpcz_store.cc:276] 0928 14:50:24.017009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.017441 (+ 432us) service_pool.cc:227] Handling call
0928 14:50:25.659835 (+1642394us) ts_tablet_manager.cc:1145] Deleting tablet def872f66b2541b9af6084e93d991ec2
0928 14:50:25.659845 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.664471 (+ 4626us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.667188 (+ 2717us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.674016 (+ 6828us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1619728}
I20260928 14:50:25.674552 9813 tablet_replica.cc:330] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.674518 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet def872f66b2541b9af6084e93d991ec2 (table default.Table_636fad71edff41c6a084cd4b40b2a02e [id=944b7f0777354b8d96d264eb858cfc93]) successfully deleted
I20260928 14:50:25.674736 9813 raft_consensus.cc:2229] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.674885 9813 raft_consensus.cc:2258] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.675359 9813 ts_tablet_manager.cc:1905] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.675848 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.675884 9530 tablet_service.cc:1467] Processing CreateTablet for tablet eae5af64cea44e7f86358edae40caa99 (DEFAULT_TABLE table=default.Table_b81e986eb6cf4b74bec8daef77d9395c [id=d656efb4270c4f649d1e21a248de2bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.676646 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 82a58b7387564863a2141a722003c5d1 (DEFAULT_TABLE table=default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.678337 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d6b4482e7b42fca17e5b917e1c1bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.680603 9813 ts_tablet_manager.cc:1918] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.680747 9813 log.cc:1196] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:25.681074 9813 ts_tablet_manager.cc:1939] T 4c101b1f03bb411f963f2348397c03e2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:25.681411 9497 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.681751 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 224) took 1664 ms. Trace:
I20260928 14:50:25.681849 9813 rpcz_store.cc:276] 0928 14:50:24.017085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.017464 (+ 379us) service_pool.cc:227] Handling call
0928 14:50:25.674499 (+1657035us) ts_tablet_manager.cc:1145] Deleting tablet 4c101b1f03bb411f963f2348397c03e2
0928 14:50:25.674509 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.677873 (+ 3364us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.680521 (+ 2648us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.681703 (+ 1182us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1631707}
I20260928 14:50:25.682230 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4c101b1f03bb411f963f2348397c03e2 (table default.Table_12b926cfeead4b05a434279fb8a0df41 [id=30cfc95166db4e5fab7aac9d7721ec26]) successfully deleted
I20260928 14:50:25.684216 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae5af64cea44e7f86358edae40caa99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.685412 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:25.685560 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:25.685640 9282 raft_consensus.cc:3037] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.685986 9814 rpcz_store.cc:276] 0928 14:50:23.307624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.307671 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:25.652469 (+2344798us) ts_tablet_manager.cc:1145] Deleting tablet ce25abb4559241f58054f27435fd6078
0928 14:50:25.652479 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.652567 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344565}
I20260928 14:50:25.686439 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78379bd4cfce46fa812374f046d9d329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.687599 9497 leader_election.cc:341] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.687170 9529 tablet_service.cc:1467] Processing CreateTablet for tablet bef0b52d178f4baeae621da769f6d518 (DEFAULT_TABLE table=default.Table_52f4944fc5ff419f9d917d898fd3ab51 [id=05fde8fccafd446eaec21e4d8de7071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.691614 9813 tablet_replica.cc:330] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:25.691784 9813 raft_consensus.cc:2229] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.691939 9813 raft_consensus.cc:2258] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.692410 9813 ts_tablet_manager.cc:1905] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.697296 9848 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.697460 9848 ts_tablet_manager.cc:1397] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.167s user 0.002s sys 0.011s
I20260928 14:50:25.698257 9848 raft_consensus.cc:348] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.698527 9848 raft_consensus.cc:374] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.699949 9248 tablet_service.cc:1467] Processing CreateTablet for tablet bef0b52d178f4baeae621da769f6d518 (DEFAULT_TABLE table=default.Table_52f4944fc5ff419f9d917d898fd3ab51 [id=05fde8fccafd446eaec21e4d8de7071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.705400 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b8584ba1914c3390aee99baaee289e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.705657 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a58b7387564863a2141a722003c5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.706271 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bef0b52d178f4baeae621da769f6d518. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.707365 9497 consensus_peers.cc:487] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:25.701184 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 41b8584ba1914c3390aee99baaee289e (DEFAULT_TABLE table=default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.733664 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bef0b52d178f4baeae621da769f6d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.734436 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.734786 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b8584ba1914c3390aee99baaee289e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.741768 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 175) took 2387 ms. Trace:
I20260928 14:50:25.747308 9815 ts_tablet_manager.cc:1918] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.747462 9815 log.cc:1196] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:25.747805 9815 ts_tablet_manager.cc:1939] T 8193754d28d34c18bfc38ae0abd05f4c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.746585 10058 raft_consensus.cc:482] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.760406 10058 raft_consensus.cc:504] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.761090 10058 leader_election.cc:288] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:25.761262 9848 raft_consensus.cc:729] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.761566 9848 consensus_queue.cc:260] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.762326 9848 ts_tablet_manager.cc:1428] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20260928 14:50:25.766785 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet b65fd0746d1b474e9fbebe6f09053743 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.768143 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0d79a39b2543049506422432990617 with delete_type TABLET_DATA_DELETED (replaced by tablet f28a74dc0afe4f20b47139a703550ef6) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.768934 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.769667 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5a64ffa786f045b480efe51eb69d7074 (table default.Table_381accf700114544b20a817ee30e9fff [id=d1cbf4f020a44f349d4de94aa0a2f725]) successfully deleted
I20260928 14:50:25.770753 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.772387 9848 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.774587 9848 tablet_bootstrap.cc:654] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.743300 9282 raft_consensus.cc:2454] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:25.779433 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0d79a39b2543049506422432990617 with delete_type TABLET_DATA_DELETED (replaced by tablet f28a74dc0afe4f20b47139a703550ef6) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.779616 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.780519 9497 leader_election.cc:302] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:25.779734 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.779882 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.780752 9814 rpcz_store.cc:276] 0928 14:50:23.306617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.309587 (+ 2970us) service_pool.cc:227] Handling call
0928 14:50:25.690261 (+2380674us) ts_tablet_manager.cc:1145] Deleting tablet c9cee872de1f4ce8b803cb8e8fb018d2
0928 14:50:25.690272 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.694275 (+ 4003us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380484}
I20260928 14:50:25.780889 10066 raft_consensus.cc:2781] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:25.781028 10066 raft_consensus.cc:686] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:25.781280 10066 consensus_queue.cc:237] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.781566 9814 tablet_replica.cc:330] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:25.781756 9814 raft_consensus.cc:2229] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.781940 9814 raft_consensus.cc:2258] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.782480 9814 ts_tablet_manager.cc:1905] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.790190 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:25.790212 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:25.790411 9425 raft_consensus.cc:3037] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:25.793573 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab71087d034c4bedb06df9e5ccefad45 consensus state has no leader
I20260928 14:50:25.793903 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet cbd9f9cb48a945d19420a8bdb9bb9576 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:25.794271 9360 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.794425 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8700d651fd7144bd9ecc15cfedcfb434" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:25.794610 9427 raft_consensus.cc:3037] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:25.794864 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eb915b10e70840468170d6c85ffae469"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.795459 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb915b10e70840468170d6c85ffae469 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.795562 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a70aa2d62a9c4fb29ba8ebdd82d8743d" } new_table_name: "default.Table_0f58133fc26b412d9986ff78538de0b5" modify_external_catalogs: true
I20260928 14:50:25.796810 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f059d30d44564a2689382ef6ab37e7d5" } modify_external_catalogs: true
I20260928 14:50:25.796975 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0c4af35f51304a7e9d98f7b9f82fe8e6" } new_table_name: "default.Table_4e86b9df2c224f9083cc99ffe56ecbb4" modify_external_catalogs: true
I20260928 14:50:25.797001 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f059d30d44564a2689382ef6ab37e7d5" } modify_external_catalogs: true
I20260928 14:50:25.797781 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_646488b2fae745c7bf73cfff72b67473" } new_table_name: "default.Table_7917435d3b4e4f27ae33c29460308484" modify_external_catalogs: true
I20260928 14:50:25.797971 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5eb84b168008483d9cd4ee38dca692f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.798442 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eb84b168008483d9cd4ee38dca692f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.799700 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e4fdf91d5a91446caa0fb71fa8fbab00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:25.800578 9855 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.800715 9855 ts_tablet_manager.cc:1397] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.282s user 0.008s sys 0.003s
I20260928 14:50:25.801401 9855 raft_consensus.cc:348] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.801666 9855 raft_consensus.cc:374] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.801724 9855 raft_consensus.cc:729] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.802263 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8555813545314aaebb0761b7f5dc260c" } modify_external_catalogs: true
I20260928 14:50:25.802430 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8555813545314aaebb0761b7f5dc260c" } modify_external_catalogs: true
W20260928 14:50:25.803238 9498 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: def872f66b2541b9af6084e93d991ec2
I20260928 14:50:25.803376 9498 leader_election.cc:302] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:25.804445 9848 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.804606 9848 ts_tablet_manager.cc:1397] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.003s
W20260928 14:50:25.805733 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:25.806890 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 315c446d87c84ae4bc9cb3243dca5538 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
W20260928 14:50:25.807201 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0e53b8b73b37464687d343493d186660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e53b8b73b37464687d343493d186660 already in progress: creating tablet
I20260928 14:50:25.807219 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:25.805469 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0442afe9c88044ffa9f10b2e1835144c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:25.807418 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 311e4286b2a943ee924ac1c25dc9ca46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 311e4286b2a943ee924ac1c25dc9ca46 already in progress: creating tablet
W20260928 14:50:25.807643 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0442afe9c88044ffa9f10b2e1835144c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:25.807682 9360 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:25.807757 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 32e7e11092d1475cba53e51a0f61d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e7e11092d1475cba53e51a0f61d6f1 already in progress: creating tablet
I20260928 14:50:25.807799 9360 leader_election.cc:302] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:25.807948 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 066df778654449bda96f68b5035c4d73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 066df778654449bda96f68b5035c4d73 already in progress: creating tablet
I20260928 14:50:25.808175 10058 raft_consensus.cc:2726] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:25.808167 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7cc4c49a4962473699103528b64a1005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc4c49a4962473699103528b64a1005 already in progress: creating tablet
W20260928 14:50:25.808372 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ce25abb4559241f58054f27435fd6078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce25abb4559241f58054f27435fd6078 already in progress: creating tablet
I20260928 14:50:25.809652 9851 tablet_bootstrap.cc:492] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:25.809651 10054 consensus_queue.cc:1035] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:25.809834 9851 ts_tablet_manager.cc:1397] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.217s user 0.032s sys 0.045s
I20260928 14:50:25.810066 10054 raft_consensus.cc:2726] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:25.810624 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24b256211679481eb0e0309c56ff60c6 has no consensus state
I20260928 14:50:25.811133 9855 consensus_queue.cc:260] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.811666 9855 ts_tablet_manager.cc:1428] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260928 14:50:25.813340 9848 raft_consensus.cc:348] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.813593 9848 raft_consensus.cc:374] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.813687 9848 raft_consensus.cc:729] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.813890 9848 consensus_queue.cc:260] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.814651 9851 raft_consensus.cc:348] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.814925 9851 raft_consensus.cc:374] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.815001 9815 tablet_replica.cc:330] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:25.815052 9851 raft_consensus.cc:729] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.815289 9815 raft_consensus.cc:2229] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:25.815267 9851 consensus_queue.cc:260] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.815573 9815 raft_consensus.cc:2258] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:25.816773 9851 ts_tablet_manager.cc:1428] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 14:50:25.817026 9851 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:25.817175 9815 ts_tablet_manager.cc:1905] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:25.818609 9851 tablet_bootstrap.cc:654] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.824086 9855 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.825647 9855 tablet_bootstrap.cc:654] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.826295 9848 ts_tablet_manager.cc:1428] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260928 14:50:25.826675 9848 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.828212 9851 tablet_bootstrap.cc:492] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:25.828341 9851 ts_tablet_manager.cc:1397] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260928 14:50:25.829022 9851 raft_consensus.cc:348] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.829237 9851 raft_consensus.cc:374] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.829313 9851 raft_consensus.cc:729] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.829535 9851 consensus_queue.cc:260] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.829869 9813 ts_tablet_manager.cc:1918] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.830006 9813 log.cc:1196] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:25.830317 9851 ts_tablet_manager.cc:1428] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:25.830382 9813 ts_tablet_manager.cc:1939] T 051b7f0b1d0f4f638f3e7a69a027196e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:25.830636 9425 raft_consensus.cc:2454] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:25.831559 9848 tablet_bootstrap.cc:654] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.833141 9851 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:25.833418 9498 leader_election.cc:302] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:25.833886 10152 raft_consensus.cc:2781] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:25.834066 10152 raft_consensus.cc:686] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:25.834722 9851 tablet_bootstrap.cc:654] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.835583 10152 consensus_queue.cc:237] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:25.832322 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c9cee872de1f4ce8b803cb8e8fb018d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9cee872de1f4ce8b803cb8e8fb018d2 already in progress: creating tablet
W20260928 14:50:25.849192 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b61fa4c4cff54e55b6e640d1b6376236 consensus state has no leader
I20260928 14:50:25.850097 10068 raft_consensus.cc:482] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.850266 10068 raft_consensus.cc:504] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.850878 10068 leader_election.cc:288] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:25.853133 9398 tablet_service.cc:1467] Processing CreateTablet for tablet cbb232c73f014351b796a86180ffb660 (DEFAULT_TABLE table=default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.853550 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbb232c73f014351b796a86180ffb660. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:25.854267 9219 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ce25abb4559241f58054f27435fd6078
W20260928 14:50:25.856680 9220 leader_election.cc:341] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: ce25abb4559241f58054f27435fd6078
I20260928 14:50:25.856797 9220 leader_election.cc:302] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:25.857239 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.857511 10068 raft_consensus.cc:2726] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:25.857707 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 24b256211679481eb0e0309c56ff60c6 (DEFAULT_TABLE table=default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.858165 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b256211679481eb0e0309c56ff60c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.861694 9390 tablet_service.cc:1467] Processing CreateTablet for tablet f28a74dc0afe4f20b47139a703550ef6 (DEFAULT_TABLE table=default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.862020 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f28a74dc0afe4f20b47139a703550ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.866124 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f67958edd6b445693683ebf4f469972" } modify_external_catalogs: true
I20260928 14:50:25.866331 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f67958edd6b445693683ebf4f469972" } modify_external_catalogs: true
I20260928 14:50:25.866833 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet c9a7573c751d412aa8394d6277c28b7f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.866633 8956 catalog_manager.cc:5495] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:25.867128 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8700d651fd7144bd9ecc15cfedcfb434 (table default.Table_b455ca1869df43c4a331171a93e88351 [id=0219eb70be1e4602b9b5542bafc4ddf0]). Expected version 4 got 0
I20260928 14:50:25.867791 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 8234670cb2604ba7b405ad7f70e03a2f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:25.868099 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8193754d28d34c18bfc38ae0abd05f4c (table default.Table_67666bc5e90b44aab3b47c6d130d117f [id=649895f4721d4daf823b5e04843ae3ec]) successfully deleted
I20260928 14:50:25.869113 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet ce25abb4559241f58054f27435fd6078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.864116 9848 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.869803 9848 ts_tablet_manager.cc:1397] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260928 14:50:25.870543 9848 raft_consensus.cc:348] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.871554 9848 raft_consensus.cc:374] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.872004 9848 raft_consensus.cc:729] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.876961 9248 tablet_service.cc:1467] Processing CreateTablet for tablet cbb232c73f014351b796a86180ffb660 (DEFAULT_TABLE table=default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.878180 9544 tablet_service.cc:1467] Processing CreateTablet for tablet cbb232c73f014351b796a86180ffb660 (DEFAULT_TABLE table=default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.879439 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d30d06c910fa4142a6248e8bfd00f4b2 consensus state has no leader
I20260928 14:50:25.880059 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 24b256211679481eb0e0309c56ff60c6 (DEFAULT_TABLE table=default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.880342 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 24b256211679481eb0e0309c56ff60c6 (DEFAULT_TABLE table=default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.873312 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e13976317a32495ab377654b738667ca (DEFAULT_TABLE table=default.Table_6aecd9c9eb214e7b8ee8656d158656d0 [id=9e86de8b573545cf94ae1fb95f2893c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.880791 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a19995a0d8af4d3ca562bade80ce006f
I20260928 14:50:25.880769 9257 tablet_service.cc:1467] Processing CreateTablet for tablet f28a74dc0afe4f20b47139a703550ef6 (DEFAULT_TABLE table=default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.881250 9540 tablet_service.cc:1467] Processing CreateTablet for tablet f28a74dc0afe4f20b47139a703550ef6 (DEFAULT_TABLE table=default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.881455 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 41b8584ba1914c3390aee99baaee289e
I20260928 14:50:25.882795 9264 tablet_service.cc:1467] Processing CreateTablet for tablet e13976317a32495ab377654b738667ca (DEFAULT_TABLE table=default.Table_6aecd9c9eb214e7b8ee8656d158656d0 [id=9e86de8b573545cf94ae1fb95f2893c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.883533 9536 tablet_service.cc:1467] Processing CreateTablet for tablet e13976317a32495ab377654b738667ca (DEFAULT_TABLE table=default.Table_6aecd9c9eb214e7b8ee8656d158656d0 [id=9e86de8b573545cf94ae1fb95f2893c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.885169 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.885754 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.886586 9851 tablet_bootstrap.cc:492] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:25.886612 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.886765 9851 ts_tablet_manager.cc:1397] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.005s
I20260928 14:50:25.887189 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.888727 9855 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.888929 9855 ts_tablet_manager.cc:1397] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.001s
I20260928 14:50:25.888819 9851 raft_consensus.cc:348] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.889050 9851 raft_consensus.cc:374] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.889147 9851 raft_consensus.cc:729] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.890159 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13976317a32495ab377654b738667ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.890555 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.890743 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.890847 9848 consensus_queue.cc:260] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.891613 9848 ts_tablet_manager.cc:1428] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260928 14:50:25.889779 9855 raft_consensus.cc:348] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.891806 9855 raft_consensus.cc:374] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.891894 9855 raft_consensus.cc:729] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.892082 9855 consensus_queue.cc:260] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.893806 9848 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.895342 9848 tablet_bootstrap.cc:654] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.896277 9851 consensus_queue.cc:260] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.896904 9855 ts_tablet_manager.cc:1428] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:25.897641 9851 ts_tablet_manager.cc:1428] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 14:50:25.897799 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:25.898252 8948 catalog_manager.cc:6565] ReplaceTablet: tablet b65fd0746d1b474e9fbebe6f09053743 deleted and replaced by tablet d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:25.898599 9851 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:25.898703 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6a828130854b4e4e8c44b2b45260e50e
I20260928 14:50:25.899680 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.900310 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.900503 9851 tablet_bootstrap.cc:654] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.900594 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.900812 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.901111 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.901623 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.902520 9855 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.904088 9855 tablet_bootstrap.cc:654] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.904134 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.904415 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.904557 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a64ffa786f045b480efe51eb69d7074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.908337 9282 raft_consensus.cc:1261] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Refusing update from remote peer 658e483a10314e8d93c2f6e9084f2a91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:25.909016 10152 consensus_queue.cc:1035] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:25.912557 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.913059 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.913600 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8234670cb2604ba7b405ad7f70e03a2f
I20260928 14:50:25.913990 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 8234670cb2604ba7b405ad7f70e03a2f deleted and replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:25.914578 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.915997 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:25.916548 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:25.923576 9848 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:25.923754 9848 ts_tablet_manager.cc:1397] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260928 14:50:25.924508 9848 raft_consensus.cc:348] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.924759 9848 raft_consensus.cc:374] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.924883 9848 raft_consensus.cc:729] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.925158 9848 consensus_queue.cc:260] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.925940 9848 ts_tablet_manager.cc:1428] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:25.926435 9427 raft_consensus.cc:2454] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:25.926780 9426 raft_consensus.cc:1261] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Refusing update from remote peer 658e483a10314e8d93c2f6e9084f2a91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:25.926772 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_550f202c199b47f098184b3921013074 [id=24b463abfd834c8b9c6f579d967741b2]). Expected version 1 got 0
I20260928 14:50:25.927546 9848 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.929143 9848 tablet_bootstrap.cc:654] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.930400 9814 ts_tablet_manager.cc:1918] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.930533 9814 log.cc:1196] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/894af8262a004e41a6ccc2641f8f7605
I20260928 14:50:25.930889 9814 ts_tablet_manager.cc:1939] T 894af8262a004e41a6ccc2641f8f7605 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:25.931346 9815 ts_tablet_manager.cc:1918] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:25.931469 9815 log.cc:1196] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:25.931545 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (DEFAULT_TABLE table=default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.931806 9815 ts_tablet_manager.cc:1939] T 2a30439ac5a8485a9b6ebbe1371087b1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:25.931926 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.933269 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbb232c73f014351b796a86180ffb660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.933517 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3a9f292618469c8d84da18059419b0 (DEFAULT_TABLE table=default.Table_a1608818b298453997453a37acde832f [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.933775 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b256211679481eb0e0309c56ff60c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.934214 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f28a74dc0afe4f20b47139a703550ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.934587 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13976317a32495ab377654b738667ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.937340 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8700d651fd7144bd9ecc15cfedcfb434 (table default.Table_b455ca1869df43c4a331171a93e88351 [id=0219eb70be1e4602b9b5542bafc4ddf0]). Expected version 4 got 0
I20260928 14:50:25.937680 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbb232c73f014351b796a86180ffb660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.938126 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b256211679481eb0e0309c56ff60c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.938514 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f28a74dc0afe4f20b47139a703550ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.938926 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13976317a32495ab377654b738667ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.939198 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (DEFAULT_TABLE table=default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.939531 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.940817 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:25.941052 10152 consensus_queue.cc:1035] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:25.942850 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3a9f292618469c8d84da18059419b0 (DEFAULT_TABLE table=default.Table_a1608818b298453997453a37acde832f [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.943261 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3a9f292618469c8d84da18059419b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.943470 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (DEFAULT_TABLE table=default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.943804 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.945935 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 222) took 1929 ms. Trace:
I20260928 14:50:25.946063 9813 rpcz_store.cc:276] 0928 14:50:24.016910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.017417 (+ 507us) service_pool.cc:227] Handling call
0928 14:50:25.691544 (+1674127us) ts_tablet_manager.cc:1145] Deleting tablet 051b7f0b1d0f4f638f3e7a69a027196e
0928 14:50:25.691554 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.748518 (+ 56964us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.829727 (+ 81209us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.945883 (+116156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1643922}
I20260928 14:50:25.946485 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 237) took 1740 ms. Trace:
I20260928 14:50:25.946607 9813 rpcz_store.cc:276] 0928 14:50:24.206231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.209181 (+ 2950us) service_pool.cc:227] Handling call
0928 14:50:25.946346 (+1737165us) ts_tablet_manager.cc:1145] Deleting tablet ca7fa45e25b0455e92412b844cd78cdc
0928 14:50:25.946355 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.946443 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1736966}
I20260928 14:50:25.946947 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 239) took 1740 ms. Trace:
I20260928 14:50:25.947062 9813 rpcz_store.cc:276] 0928 14:50:24.206444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.209400 (+ 2956us) service_pool.cc:227] Handling call
0928 14:50:25.946823 (+1737423us) ts_tablet_manager.cc:1145] Deleting tablet 8b914e3c8243490d92378a8765d6390f
0928 14:50:25.946833 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.946910 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1737208}
I20260928 14:50:25.948274 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 238) took 1741 ms. Trace:
I20260928 14:50:25.948403 9813 rpcz_store.cc:276] 0928 14:50:24.206327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.209646 (+ 3319us) service_pool.cc:227] Handling call
0928 14:50:25.947238 (+1737592us) ts_tablet_manager.cc:1145] Deleting tablet dfacaf069e3746aeb8ca11d95e65c5ea
0928 14:50:25.947246 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.948218 (+ 972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1737443}
I20260928 14:50:25.948760 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 236) took 1742 ms. Trace:
I20260928 14:50:25.948869 9813 rpcz_store.cc:276] 0928 14:50:24.206119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.209829 (+ 3710us) service_pool.cc:227] Handling call
0928 14:50:25.948625 (+1738796us) ts_tablet_manager.cc:1145] Deleting tablet 274ab65ebc2d41db9dc5d8a0139f9bc9
0928 14:50:25.948634 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.948729 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738628}
I20260928 14:50:25.949185 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 244) took 1678 ms. Trace:
I20260928 14:50:25.949294 9813 rpcz_store.cc:276] 0928 14:50:24.270379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.270669 (+ 290us) service_pool.cc:227] Handling call
0928 14:50:25.949063 (+1678394us) ts_tablet_manager.cc:1145] Deleting tablet 57e56077833e41dbacf54c1757ba6a38
0928 14:50:25.949072 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.949152 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678187}
I20260928 14:50:25.950824 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 1e3a9f292618469c8d84da18059419b0 (DEFAULT_TABLE table=default.Table_a1608818b298453997453a37acde832f [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.951175 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3a9f292618469c8d84da18059419b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.953712 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e3a9f292618469c8d84da18059419b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.959992 9855 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.960173 9855 ts_tablet_manager.cc:1397] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.000s
I20260928 14:50:25.960953 9855 raft_consensus.cc:348] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.961213 9855 raft_consensus.cc:374] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.961294 9855 raft_consensus.cc:729] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.961556 9855 consensus_queue.cc:260] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:25.962112 9855 ts_tablet_manager.cc:1428] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:25.964195 10058 raft_consensus.cc:482] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:25.964349 10058 raft_consensus.cc:504] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:25.964892 10058 leader_election.cc:288] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:25.965457 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:25.966071 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:25.966612 9360 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:25.966964 9360 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:25.967101 9360 leader_election.cc:302] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:25.967602 10058 raft_consensus.cc:2726] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:25.968406 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (DEFAULT_TABLE table=default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.968822 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.974749 9855 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.976253 9855 tablet_bootstrap.cc:654] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.976703 9541 tablet_service.cc:1467] Processing CreateTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc (DEFAULT_TABLE table=default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.977026 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba0d51f1c2664e0b8c6acb7847eff7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.981220 10179 tablet.cc:1722] T 8700d651fd7144bd9ecc15cfedcfb434 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:25.981921 9855 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:25.982053 9855 ts_tablet_manager.cc:1397] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260928 14:50:25.982380 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (DEFAULT_TABLE table=default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.982815 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.982736 9855 raft_consensus.cc:348] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.982930 9855 raft_consensus.cc:374] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.983017 9855 raft_consensus.cc:729] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.983208 9855 consensus_queue.cc:260] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.983705 9855 ts_tablet_manager.cc:1428] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:25.983965 9855 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:25.985401 9855 tablet_bootstrap.cc:654] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:25.985829 9263 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (DEFAULT_TABLE table=default.Table_2c60594fff144e6fb1bcfacebce32be3 [id=49157f905fed4cf8936325e4fcb30ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.986166 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ae6fbfca4fc0b0b053d0134a49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.989356 9390 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (DEFAULT_TABLE table=default.Table_2c60594fff144e6fb1bcfacebce32be3 [id=49157f905fed4cf8936325e4fcb30ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.989635 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 051b7f0b1d0f4f638f3e7a69a027196e (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
W20260928 14:50:25.989895 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ca7fa45e25b0455e92412b844cd78cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca7fa45e25b0455e92412b844cd78cdc already in progress: creating tablet
I20260928 14:50:25.989885 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 2df12117111548beb5d570436e2d6de2 (DEFAULT_TABLE table=default.Table_3f13997bc23f4c269c14e70a3f8765ed [id=b5e9a91ec4124a81a3410ab71fb084bb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:25.990134 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8b914e3c8243490d92378a8765d6390f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b914e3c8243490d92378a8765d6390f already in progress: creating tablet
I20260928 14:50:25.990321 9848 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:25.990334 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet dfacaf069e3746aeb8ca11d95e65c5ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfacaf069e3746aeb8ca11d95e65c5ea already in progress: creating tablet
I20260928 14:50:25.990453 9848 ts_tablet_manager.cc:1397] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
W20260928 14:50:25.990501 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 already in progress: creating tablet
W20260928 14:50:25.990665 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 57e56077833e41dbacf54c1757ba6a38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e56077833e41dbacf54c1757ba6a38 already in progress: creating tablet
I20260928 14:50:25.991214 9398 tablet_service.cc:1467] Processing CreateTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc (DEFAULT_TABLE table=default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.991183 9848 raft_consensus.cc:348] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.991426 9848 raft_consensus.cc:374] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:25.991503 9848 raft_consensus.cc:729] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:25.991731 9389 tablet_service.cc:1467] Processing CreateTablet for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (DEFAULT_TABLE table=default.Table_163954843d7844c084b6b7fb63f8c121 [id=94283cea61764b3aa25cbf7ec5c3e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.992175 9397 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (DEFAULT_TABLE table=default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.997581 9848 consensus_queue.cc:260] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:25.998211 9848 ts_tablet_manager.cc:1428] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:25.998490 9848 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:25.998834 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 2df12117111548beb5d570436e2d6de2 (DEFAULT_TABLE table=default.Table_3f13997bc23f4c269c14e70a3f8765ed [id=b5e9a91ec4124a81a3410ab71fb084bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:25.999167 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df12117111548beb5d570436e2d6de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:25.999990 9848 tablet_bootstrap.cc:654] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.003428 9532 tablet_service.cc:1467] Processing CreateTablet for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (DEFAULT_TABLE table=default.Table_163954843d7844c084b6b7fb63f8c121 [id=94283cea61764b3aa25cbf7ec5c3e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.003826 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb704c5128a4880ae1b89b4d4d1fcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.005837 9529 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (DEFAULT_TABLE table=default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.006165 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac853c5b6f4f9cb9de91e6aa448c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.010799 9285 raft_consensus.cc:3037] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.015002 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 2df12117111548beb5d570436e2d6de2 (DEFAULT_TABLE table=default.Table_3f13997bc23f4c269c14e70a3f8765ed [id=b5e9a91ec4124a81a3410ab71fb084bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.015357 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df12117111548beb5d570436e2d6de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.017802 9251 tablet_service.cc:1467] Processing CreateTablet for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (DEFAULT_TABLE table=default.Table_163954843d7844c084b6b7fb63f8c121 [id=94283cea61764b3aa25cbf7ec5c3e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.018157 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb704c5128a4880ae1b89b4d4d1fcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.019276 9855 tablet_bootstrap.cc:492] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.019426 9855 ts_tablet_manager.cc:1397] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260928 14:50:26.020098 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 254) took 1677 ms. Trace:
I20260928 14:50:26.020115 9855 raft_consensus.cc:348] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.020239 9813 rpcz_store.cc:276] 0928 14:50:24.342928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.343095 (+ 167us) service_pool.cc:227] Handling call
0928 14:50:26.019889 (+1676794us) ts_tablet_manager.cc:1145] Deleting tablet 852b70b1f7444ad2ab92d66d580a0db7
0928 14:50:26.019904 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.020055 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1606227}
I20260928 14:50:26.020371 9855 raft_consensus.cc:374] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.020433 9855 raft_consensus.cc:729] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.020615 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 255) took 1677 ms. Trace:
I20260928 14:50:26.020625 9855 consensus_queue.cc:260] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.020717 9813 rpcz_store.cc:276] 0928 14:50:24.343020 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.343299 (+ 279us) service_pool.cc:227] Handling call
0928 14:50:26.020492 (+1677193us) ts_tablet_manager.cc:1145] Deleting tablet 11714d0ca321429c95de223320794a0e
0928 14:50:26.020501 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.020586 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1530579}
I20260928 14:50:26.021036 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 253) took 1678 ms. Trace:
I20260928 14:50:26.021153 9855 ts_tablet_manager.cc:1428] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.021129 9813 rpcz_store.cc:276] 0928 14:50:24.342806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.347019 (+ 4213us) service_pool.cc:227] Handling call
0928 14:50:26.020917 (+1673898us) ts_tablet_manager.cc:1145] Deleting tablet afe58ef9809540cb942e3ec44296e36f
0928 14:50:26.020925 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.021010 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1530303}
I20260928 14:50:26.021387 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 256) took 1541 ms. Trace:
I20260928 14:50:26.021423 9855 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.021373 9253 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (DEFAULT_TABLE table=default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.021790 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac853c5b6f4f9cb9de91e6aa448c75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:26.021950 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 852b70b1f7444ad2ab92d66d580a0db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852b70b1f7444ad2ab92d66d580a0db7 already in progress: creating tablet
W20260928 14:50:26.022217 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 11714d0ca321429c95de223320794a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11714d0ca321429c95de223320794a0e already in progress: creating tablet
W20260928 14:50:26.022442 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet afe58ef9809540cb942e3ec44296e36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afe58ef9809540cb942e3ec44296e36f already in progress: creating tablet
I20260928 14:50:26.027456 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 190) took 2387 ms. Trace:
I20260928 14:50:26.028419 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ae6fbfca4fc0b0b053d0134a49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.028335 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_50d42e9768d34d79ad94f455c707b4b1" } modify_external_catalogs: true
I20260928 14:50:26.028558 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_50d42e9768d34d79ad94f455c707b4b1" } modify_external_catalogs: true
I20260928 14:50:26.028883 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df12117111548beb5d570436e2d6de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.029291 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3ae346f4e35f4daf82d04747a821694f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.029819 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ae346f4e35f4daf82d04747a821694f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.031708 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba0d51f1c2664e0b8c6acb7847eff7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.032749 9855 tablet_bootstrap.cc:654] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.032843 9815 tablet_replica.cc:330] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.033062 9815 raft_consensus.cc:2229] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:26.033295 9815 pending_rounds.cc:62] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:26.033380 9815 pending_rounds.cc:68] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326375386988544 op_type: NO_OP noop_request { }
I20260928 14:50:26.033584 9815 raft_consensus.cc:2866] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:26.033706 9815 raft_consensus.cc:2258] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:26.033834 8941 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260928 14:50:26.027601 9814 rpcz_store.cc:276] 0928 14:50:23.640444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.640495 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:25.781466 (+2140971us) ts_tablet_manager.cc:1145] Deleting tablet 894af8262a004e41a6ccc2641f8f7605
0928 14:50:25.781477 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:25.836441 (+ 54964us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:25.930254 (+ 93813us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.027413 (+ 97159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2133481}
I20260928 14:50:26.034392 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 191) took 2386 ms. Trace:
I20260928 14:50:26.034534 9814 rpcz_store.cc:276] 0928 14:50:23.647785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.648146 (+ 361us) service_pool.cc:227] Handling call
0928 14:50:26.034256 (+2386110us) ts_tablet_manager.cc:1145] Deleting tablet f3ac8adb23c5478fadb6cb6765459913
0928 14:50:26.034266 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.034361 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369409}
I20260928 14:50:26.034866 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 195) took 2378 ms. Trace:
I20260928 14:50:26.034965 9814 rpcz_store.cc:276] 0928 14:50:23.656330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.656382 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:26.034747 (+2378365us) ts_tablet_manager.cc:1145] Deleting tablet 4bea51859e0c4bc984288f94c2fcea2e
0928 14:50:26.034756 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.034836 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2366875}
I20260928 14:50:26.035162 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac853c5b6f4f9cb9de91e6aa448c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.035298 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 196) took 2365 ms. Trace:
I20260928 14:50:26.035390 9814 rpcz_store.cc:276] 0928 14:50:23.669788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.680150 (+ 10362us) service_pool.cc:227] Handling call
0928 14:50:26.035163 (+2355013us) ts_tablet_manager.cc:1145] Deleting tablet 3c2b819b194d4373a59a3e94267361c1
0928 14:50:26.035172 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.035271 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2354416}
I20260928 14:50:26.035555 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb704c5128a4880ae1b89b4d4d1fcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.035714 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 199) took 2141 ms. Trace:
I20260928 14:50:26.035806 9814 rpcz_store.cc:276] 0928 14:50:23.893796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.895113 (+ 1317us) service_pool.cc:227] Handling call
0928 14:50:26.035607 (+2140494us) ts_tablet_manager.cc:1145] Deleting tablet 3f8db468ad3c4bba8c701c3d8feba9f4
0928 14:50:26.035616 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.035687 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31192,"tablet-delete.queue_time_us":2140055}
I20260928 14:50:26.036059 9814 tablet_replica.cc:330] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:26.036242 9814 raft_consensus.cc:2229] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.036391 9814 raft_consensus.cc:2258] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.036909 9814 ts_tablet_manager.cc:1905] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.037178 9815 ts_tablet_manager.cc:1905] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.057912 9404 tablet_service.cc:1467] Processing CreateTablet for tablet aaacc1f839914859b23ae755042e02d8 (DEFAULT_TABLE table=default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.058311 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaacc1f839914859b23ae755042e02d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.058665 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e1682c926dbb4ce884db79cdac24b3f9" } new_table_name: "default.Table_ab3bd6d5c946451699ce00e5a839a2d0" modify_external_catalogs: true
I20260928 14:50:26.060853 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f" } modify_external_catalogs: true
I20260928 14:50:26.061061 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f" } modify_external_catalogs: true
I20260928 14:50:26.061898 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d96492abf8cf459a992dd1d7b0226b57 (DEFAULT_TABLE table=default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.062229 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96492abf8cf459a992dd1d7b0226b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.062161 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6b95962f27a14d3f9dea2a54a324eb75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.062676 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b95962f27a14d3f9dea2a54a324eb75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.065775 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b201177c711e44c5b8800158642374e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.066232 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b201177c711e44c5b8800158642374e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.067159 9530 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (DEFAULT_TABLE table=default.Table_2c60594fff144e6fb1bcfacebce32be3 [id=49157f905fed4cf8936325e4fcb30ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.067298 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_73af8a4d32214efba99d9f0665af93a8" } new_table_name: "default.Table_113bd4fb4dfe4daaad54e66560882085" modify_external_catalogs: true
I20260928 14:50:26.068513 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.068708 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (DEFAULT_TABLE table=default.Table_0442afe9c88044ffa9f10b2e1835144c [id=44b6b5a0e8a4438c97dd07f6c86ffef6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:26.068953 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.069090 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb3cc5b42524a4399d0bcf21c851fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.072072 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.072386 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 894af8262a004e41a6ccc2641f8f7605 (table default.Table_ea7ac789c79847c786de8d9c1110c838 [id=49a9522730414df28268afd29c5db552]) successfully deleted
I20260928 14:50:26.072448 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:26.072604 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f3ac8adb23c5478fadb6cb6765459913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3ac8adb23c5478fadb6cb6765459913 already in progress: creating tablet
W20260928 14:50:26.072835 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4bea51859e0c4bc984288f94c2fcea2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bea51859e0c4bc984288f94c2fcea2e already in progress: creating tablet
W20260928 14:50:26.073046 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3c2b819b194d4373a59a3e94267361c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c2b819b194d4373a59a3e94267361c1 already in progress: creating tablet
W20260928 14:50:26.073243 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f8db468ad3c4bba8c701c3d8feba9f4 already in progress: creating tablet
I20260928 14:50:26.083022 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (DEFAULT_TABLE table=default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.088249 10058 raft_consensus.cc:482] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.088397 10058 raft_consensus.cc:504] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.088946 10058 leader_election.cc:288] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.090126 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9cee872de1f4ce8b803cb8e8fb018d2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.090358 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9cee872de1f4ce8b803cb8e8fb018d2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.090617 9567 raft_consensus.cc:2454] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:26.091562 9360 leader_election.cc:302] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:26.091898 9360 leader_election.cc:341] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.092357 10058 raft_consensus.cc:2781] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.092453 10058 raft_consensus.cc:482] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.092581 10058 raft_consensus.cc:3037] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.093670 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:26.097002 9219 consensus_peers.cc:487] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 605ccf9ad9ca4eb985374e065c48601a. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:26.098290 9851 tablet_bootstrap.cc:492] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.098462 9851 ts_tablet_manager.cc:1397] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.200s user 0.037s sys 0.031s
I20260928 14:50:26.095017 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:26.099220 9851 raft_consensus.cc:348] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.099465 9851 raft_consensus.cc:374] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.099558 9851 raft_consensus.cc:729] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.099788 9851 consensus_queue.cc:260] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.100476 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2a30439ac5a8485a9b6ebbe1371087b1 (table default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]) successfully deleted
W20260928 14:50:26.100804 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1dacb0eef514609bcaf503ccc9845e3 consensus state has no leader
I20260928 14:50:26.101487 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.101838 8952 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_b455ca1869df43c4a331171a93e88351 [id=0219eb70be1e4602b9b5542bafc4ddf0] alter complete (version 4)
I20260928 14:50:26.102398 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.104928 9851 ts_tablet_manager.cc:1428] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:26.106231 9851 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.108121 9851 tablet_bootstrap.cc:654] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:26.111677 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c50f7410dd549f399449487556f813d consensus state has no leader
I20260928 14:50:26.112206 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.112897 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.119127 9851 tablet_bootstrap.cc:492] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.119263 9851 ts_tablet_manager.cc:1397] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.007s
I20260928 14:50:26.119616 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d9085bedbe34425b957fa044a6abcb21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.119767 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:26.120138 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9085bedbe34425b957fa044a6abcb21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.120939 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eb64624ba99c4e48ae2d157843c73477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.121345 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_957c4a38d13a41c5b9a9ad27e4c3e38d" } new_table_name: "default.Table_4f27adee7f5546bdacf1cf473d252a5b" modify_external_catalogs: true
W20260928 14:50:26.121451 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb64624ba99c4e48ae2d157843c73477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.122689 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea1a9bd38c2c49e382251934deb941a6" } new_table_name: "default.Table_f38371501cb347d3b36246f9a12070f8" modify_external_catalogs: true
I20260928 14:50:26.123554 9851 raft_consensus.cc:348] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.123835 9851 raft_consensus.cc:374] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.123795 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_aeb307bca9f04e3fba16a493beb31b91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.123922 9851 raft_consensus.cc:729] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:26.124250 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aeb307bca9f04e3fba16a493beb31b91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.124168 9851 consensus_queue.cc:260] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.125916 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f98e79eee4ac4e55b37d2047d1e36684"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.126019 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_50d0ba4738bd4af2b91d2e20e9003556"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.126418 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50d0ba4738bd4af2b91d2e20e9003556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.126691 9851 ts_tablet_manager.cc:1428] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260928 14:50:26.127254 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f98e79eee4ac4e55b37d2047d1e36684 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.127817 9851 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.129321 9851 tablet_bootstrap.cc:654] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.131899 9815 ts_tablet_manager.cc:1918] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:26.132035 9815 log.cc:1196] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:26.132407 9815 ts_tablet_manager.cc:1939] T 051b7f0b1d0f4f638f3e7a69a027196e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.133049 10058 raft_consensus.cc:504] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.134485 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.135120 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.135655 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.135970 10152 raft_consensus.cc:482] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.136133 10152 raft_consensus.cc:504] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.136659 10152 leader_election.cc:288] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.136876 9258 tablet_service.cc:1467] Processing CreateTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc (DEFAULT_TABLE table=default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.137593 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.137898 9263 tablet_service.cc:1467] Processing CreateTablet for tablet d96492abf8cf459a992dd1d7b0226b57 (DEFAULT_TABLE table=default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.138187 10058 leader_election.cc:288] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:26.138198 9497 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.138356 10058 raft_consensus.cc:482] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.138490 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96492abf8cf459a992dd1d7b0226b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.138876 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ae6fbfca4fc0b0b053d0134a49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.021481 9813 rpcz_store.cc:276] 0928 14:50:24.480265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.487428 (+ 7163us) service_pool.cc:227] Handling call
0928 14:50:26.021296 (+1533868us) ts_tablet_manager.cc:1145] Deleting tablet c85735981779438197f2c0f489681b96
0928 14:50:26.021304 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.021362 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1502976}
W20260928 14:50:26.142131 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c85735981779438197f2c0f489681b96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c85735981779438197f2c0f489681b96 already in progress: creating tablet
I20260928 14:50:26.142758 9541 tablet_service.cc:1467] Processing CreateTablet for tablet d96492abf8cf459a992dd1d7b0226b57 (DEFAULT_TABLE table=default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.143167 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96492abf8cf459a992dd1d7b0226b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.145798 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (DEFAULT_TABLE table=default.Table_0442afe9c88044ffa9f10b2e1835144c [id=44b6b5a0e8a4438c97dd07f6c86ffef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.146335 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb3cc5b42524a4399d0bcf21c851fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.149749 9529 tablet_service.cc:1467] Processing CreateTablet for tablet aaacc1f839914859b23ae755042e02d8 (DEFAULT_TABLE table=default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.150142 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaacc1f839914859b23ae755042e02d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.150177 10186 tablet.cc:1722] T 8700d651fd7144bd9ecc15cfedcfb434 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:26.153977 9252 tablet_service.cc:1467] Processing CreateTablet for tablet aaacc1f839914859b23ae755042e02d8 (DEFAULT_TABLE table=default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.154531 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaacc1f839914859b23ae755042e02d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.155732 10178 tablet.cc:1722] T 8700d651fd7144bd9ecc15cfedcfb434 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:26.161895 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (DEFAULT_TABLE table=default.Table_0442afe9c88044ffa9f10b2e1835144c [id=44b6b5a0e8a4438c97dd07f6c86ffef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.162426 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb3cc5b42524a4399d0bcf21c851fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.166393 10191 tablet.cc:1722] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:26.166589 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.167080 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.169688 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba0d51f1c2664e0b8c6acb7847eff7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.170714 9855 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.170856 9855 ts_tablet_manager.cc:1397] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.150s user 0.015s sys 0.015s
I20260928 14:50:26.171623 9855 raft_consensus.cc:348] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.171834 9855 raft_consensus.cc:374] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.171924 9855 raft_consensus.cc:729] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.172116 9855 consensus_queue.cc:260] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.172678 9855 ts_tablet_manager.cc:1428] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.172955 9855 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.179450 10152 raft_consensus.cc:482] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.180039 10152 raft_consensus.cc:504] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.181340 10152 leader_election.cc:288] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.182468 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.183180 9497 leader_election.cc:341] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.188867 9855 tablet_bootstrap.cc:654] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.196290 9855 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.196442 9855 ts_tablet_manager.cc:1397] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.002s
I20260928 14:50:26.196874 9813 tablet_replica.cc:330] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:26.197121 9855 raft_consensus.cc:348] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.197345 9855 raft_consensus.cc:374] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.197227 10058 raft_consensus.cc:504] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.197427 9855 raft_consensus.cc:729] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.197657 9855 consensus_queue.cc:260] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.198283 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.198542 9426 raft_consensus.cc:2454] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.199271 9498 leader_election.cc:302] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.200140 10152 raft_consensus.cc:2781] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.200274 10152 raft_consensus.cc:482] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.200387 10152 raft_consensus.cc:3037] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.203431 9855 ts_tablet_manager.cc:1428] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 14:50:26.205009 9855 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.205228 9813 raft_consensus.cc:2229] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:26.198889 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.209481 9855 tablet_bootstrap.cc:654] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.210983 9427 raft_consensus.cc:2454] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.211519 9498 leader_election.cc:302] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.211812 10054 raft_consensus.cc:2781] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.211899 10054 raft_consensus.cc:482] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.211983 10054 raft_consensus.cc:3037] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.212726 10058 leader_election.cc:288] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.212936 9813 pending_rounds.cc:62] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:26.213089 10058 raft_consensus.cc:482] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.213289 10058 raft_consensus.cc:504] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.214026 10058 leader_election.cc:288] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.214282 9815 tablet_replica.cc:330] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.214507 9815 raft_consensus.cc:2229] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.214236 9813 pending_rounds.cc:68] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7334326375203446784 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "8c8624f9349a4608a48943487f01c7c8" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_1d54df7671a0472193f255cb56c15768" dest_uuid: "ae832871bd1142f7af10c084115ffc12" new_extra_config { } }
I20260928 14:50:26.214699 9815 raft_consensus.cc:2258] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.215231 9815 ts_tablet_manager.cc:1905] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.215620 9855 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.215752 9855 ts_tablet_manager.cc:1397] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
W20260928 14:50:26.214720 9813 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34142: Aborted: Op aborted
I20260928 14:50:26.216027 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 051b7f0b1d0f4f638f3e7a69a027196e (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
I20260928 14:50:26.216500 9855 raft_consensus.cc:348] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.216730 9855 raft_consensus.cc:374] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.216817 9855 raft_consensus.cc:729] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.217033 9855 consensus_queue.cc:260] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.217586 9855 ts_tablet_manager.cc:1428] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.217891 9855 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.221073 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:34142 (request call id 252) took 1885 ms. Trace:
I20260928 14:50:26.221259 9813 rpcz_store.cc:276] 0928 14:50:24.330407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.330647 (+ 240us) service_pool.cc:227] Handling call
0928 14:50:26.215886 (+1885239us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 14:50:24.331017 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 14:50:24.331084 (+ 67us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 14:50:25.196142 (+865058us) alter_schema_op.cc:65] Acquired schema lock
0928 14:50:25.196152 (+ 10us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 14:50:25.196208 (+ 56us) alter_schema_op.cc:126] START. Timestamp: 1790607025196154
0928 14:50:25.196211 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 14:50:25.196365 (+ 154us) log.cc:842] Serialized 173 byte log entry
0928 14:50:26.214613 (+1018248us) op_driver.cc:444] REPLICATION: finished
0928 14:50:26.214652 (+ 39us) op_driver.cc:372] HandleFailure(Aborted: Op aborted)
0928 14:50:26.214660 (+ 8us) alter_schema_op.cc:169] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":67,"prepare.run_cpu_time_us":60584,"prepare.run_wall_time_us":865717,"raft.queue_time_us":189,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":3805,"replication_time_us":1018360}]]}
I20260928 14:50:26.222133 9813 raft_consensus.cc:2258] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.223063 9813 ts_tablet_manager.cc:1905] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.228775 9855 tablet_bootstrap.cc:654] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.230093 9848 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:26.230295 9848 ts_tablet_manager.cc:1397] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.232s user 0.023s sys 0.030s
I20260928 14:50:26.231155 9848 raft_consensus.cc:348] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.231462 9848 raft_consensus.cc:374] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.234512 10152 raft_consensus.cc:504] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.235110 10152 leader_election.cc:288] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.235386 9848 raft_consensus.cc:729] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.235731 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.235931 9427 raft_consensus.cc:3037] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.235666 9848 consensus_queue.cc:260] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.236536 9848 ts_tablet_manager.cc:1428] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:26.236853 9848 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:26.237206 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:26.237887 9497 leader_election.cc:341] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.239646 9848 tablet_bootstrap.cc:654] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.240653 9855 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.240810 9855 ts_tablet_manager.cc:1397] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260928 14:50:26.241647 9855 raft_consensus.cc:348] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.241870 9855 raft_consensus.cc:374] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.241948 9855 raft_consensus.cc:729] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.242035 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9cee872de1f4ce8b803cb8e8fb018d2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.242672 9855 consensus_queue.cc:260] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.243150 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9cee872de1f4ce8b803cb8e8fb018d2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:26.243245 9855 ts_tablet_manager.cc:1428] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:26.243341 9567 raft_consensus.cc:3037] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.243510 9855 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.245504 10068 raft_consensus.cc:482] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.245693 10068 raft_consensus.cc:504] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.246335 10068 leader_election.cc:288] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.246714 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.249178 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 148e81f8add349f2b233862a7049e54c (DEFAULT_TABLE table=default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.251040 9855 tablet_bootstrap.cc:654] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.251314 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 148e81f8add349f2b233862a7049e54c (DEFAULT_TABLE table=default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:26.255434 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f79fcac805b42ba8b66949fbdfeb8f6 consensus state has no leader
W20260928 14:50:26.256664 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 962a5dee53514f7ab5a63242f7d70446 consensus state has no leader
I20260928 14:50:26.257047 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_71ce0c67c5c44812bcd7181bb4b27fe4" } new_table_name: "default.Table_118c187f247340e28ea7760243f97cf0" modify_external_catalogs: true
I20260928 14:50:26.258003 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea9c8d7bd23a4c1997dbdb43ec245185" } modify_external_catalogs: true
I20260928 14:50:26.258299 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ea9c8d7bd23a4c1997dbdb43ec245185" } modify_external_catalogs: true
I20260928 14:50:26.260388 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f00db4ef6925410f9db9f1a923d2bfeb" } modify_external_catalogs: true
I20260928 14:50:26.260574 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f00db4ef6925410f9db9f1a923d2bfeb" } modify_external_catalogs: true
I20260928 14:50:26.262383 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 4bd612753b914a079ccf89249b073018 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:26.263955 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c101b1f03bb411f963f2348397c03e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.266525 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeda483866146f89198e6f14456f0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:20 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:26.266780 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 59ced67c921e43e48bcb5195da212582 (table default.Table_6459cd3ed4fe42c897a4fbe2d97611eb [id=ca5392bf870e48a5bfd32b024c85a0b9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 59ced67c921e43e48bcb5195da212582 consensus state has no leader
I20260928 14:50:26.266805 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a30439ac5a8485a9b6ebbe1371087b1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.269788 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.270653 9851 tablet_bootstrap.cc:492] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.271013 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.271288 9569 raft_consensus.cc:2379] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:26.271584 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d4ef8a945c4e6c899e2bbd6069969c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.272686 9851 ts_tablet_manager.cc:1397] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.145s user 0.006s sys 0.042s
I20260928 14:50:26.272796 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.273123 9220 leader_election.cc:302] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:26.273042 9360 leader_election.cc:341] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.273504 10068 raft_consensus.cc:2726] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.273450 9851 raft_consensus.cc:348] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.273702 9851 raft_consensus.cc:374] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.273772 9851 raft_consensus.cc:729] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.274811 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.276069 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.276973 9851 consensus_queue.cc:260] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.277213 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.277712 9851 ts_tablet_manager.cc:1428] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260928 14:50:26.278041 9851 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.280712 9851 tablet_bootstrap.cc:654] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.286031 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:26.285645 9360 leader_election.cc:341] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.286633 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 148e81f8add349f2b233862a7049e54c (DEFAULT_TABLE table=default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:26.287420 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.293805 9851 tablet_bootstrap.cc:492] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.293962 9851 ts_tablet_manager.cc:1397] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.007s
W20260928 14:50:26.286866 9360 leader_election.cc:341] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.300706 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e661ac0a85949a280d837ee0357eea7 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c20a70834344c7937f96ab5fae2049) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.303562 9851 raft_consensus.cc:348] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.303803 9851 raft_consensus.cc:374] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.303896 9851 raft_consensus.cc:729] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.304111 9851 consensus_queue.cc:260] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.304684 9851 ts_tablet_manager.cc:1428] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20260928 14:50:26.304960 9851 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.308929 9855 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.309475 9855 ts_tablet_manager.cc:1397] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.022s
I20260928 14:50:26.311657 9851 tablet_bootstrap.cc:654] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.314668 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148e81f8add349f2b233862a7049e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.314265 9855 raft_consensus.cc:348] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.315550 9855 raft_consensus.cc:374] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.315927 9855 raft_consensus.cc:729] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.316655 9855 consensus_queue.cc:260] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.317602 9821 raft_consensus.cc:482] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.317730 9821 raft_consensus.cc:504] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.318334 9821 leader_election.cc:288] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.320104 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 28ee844aa3c24336b4acb66dc43186e9
I20260928 14:50:26.320632 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet f3ac8adb23c5478fadb6cb6765459913 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:26.321126 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8218bc963a9941a49e8329d0a04d8252" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.321269 10054 raft_consensus.cc:504] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.322088 10054 leader_election.cc:288] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.324573 9855 ts_tablet_manager.cc:1428] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 14:50:26.326378 9855 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:26.330298 9497 leader_election.cc:341] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.331730 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.332171 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.332878 10152 raft_consensus.cc:482] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.333024 10152 raft_consensus.cc:504] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.333223 9855 tablet_bootstrap.cc:654] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.333637 10152 leader_election.cc:288] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:26.334252 9497 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.334888 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.336539 9497 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.339905 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.340874 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148e81f8add349f2b233862a7049e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.341995 9427 raft_consensus.cc:2454] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
W20260928 14:50:26.342931 9360 leader_election.cc:341] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:26.343068 9360 leader_election.cc:302] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.343384 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_158e9f6008914923b2f3ad53d5817d59" } modify_external_catalogs: true
I20260928 14:50:26.343472 9360 leader_election.cc:302] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.343606 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_158e9f6008914923b2f3ad53d5817d59" } modify_external_catalogs: true
I20260928 14:50:26.344002 10189 raft_consensus.cc:2726] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.344164 10189 raft_consensus.cc:2726] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.345028 9498 leader_election.cc:302] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.345077 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.345315 9425 raft_consensus.cc:2454] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.345516 10152 raft_consensus.cc:2781] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.345707 10152 raft_consensus.cc:686] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:26.345961 10152 consensus_queue.cc:237] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.346879 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a1608818b298453997453a37acde832f" } new_table_name: "default.Table_c4b70ee941964fe2b328f7eaae2cebc1" modify_external_catalogs: true
I20260928 14:50:26.347117 9498 leader_election.cc:302] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.347400 9821 raft_consensus.cc:2781] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.347517 9821 raft_consensus.cc:482] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.347605 9821 raft_consensus.cc:3037] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.350441 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c0fd7600a4cc43e097236ff0f5cd78f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.351068 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.352849 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ba3b03ec5d55498085ffef43b3929852"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.353327 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba3b03ec5d55498085ffef43b3929852 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.355150 9855 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.355392 9855 ts_tablet_manager.cc:1397] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.004s
I20260928 14:50:26.355500 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_af41acca2d874e6b93e62944f1c8311f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.355966 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af41acca2d874e6b93e62944f1c8311f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.356488 9855 raft_consensus.cc:348] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.356832 9855 raft_consensus.cc:374] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.356973 9855 raft_consensus.cc:729] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.357295 9855 consensus_queue.cc:260] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.359241 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_81ca6df5fc2849cab83083e994d3627a" } modify_external_catalogs: true
I20260928 14:50:26.359449 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_81ca6df5fc2849cab83083e994d3627a" } modify_external_catalogs: true
I20260928 14:50:26.359724 9855 ts_tablet_manager.cc:1428] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260928 14:50:26.361001 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.361258 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8218bc963a9941a49e8329d0a04d8252" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.361958 9855 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.363057 9426 raft_consensus.cc:2454] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.363130 9285 raft_consensus.cc:3037] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.363994 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.365022 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.365212 9427 raft_consensus.cc:3037] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.365701 9848 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:26.365744 9498 leader_election.cc:302] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.365865 9848 ts_tablet_manager.cc:1397] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.129s user 0.020s sys 0.028s
I20260928 14:50:26.366081 10054 raft_consensus.cc:2781] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.366180 10054 raft_consensus.cc:482] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.366262 10054 raft_consensus.cc:3037] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.366366 9855 tablet_bootstrap.cc:654] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.366655 9848 raft_consensus.cc:348] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.366906 9848 raft_consensus.cc:374] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.366979 9848 raft_consensus.cc:729] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.367223 9848 consensus_queue.cc:260] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.372105 9848 ts_tablet_manager.cc:1428] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:26.374356 9848 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:26.377933 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9648be4c626e44e0986c196704483955
I20260928 14:50:26.379542 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
W20260928 14:50:26.381778 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 390f10fd4b5f42e182b686cc1ccefb26 consensus state has no leader
I20260928 14:50:26.383248 9855 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.383471 9855 ts_tablet_manager.cc:1397] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.001s
I20260928 14:50:26.384545 9855 raft_consensus.cc:348] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.384886 9855 raft_consensus.cc:374] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.385023 9855 raft_consensus.cc:729] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.385367 9855 consensus_queue.cc:260] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.388027 9855 ts_tablet_manager.cc:1428] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:26.390662 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7df4761c9b5d4ff889efaabd26915a37" } new_table_name: "default.Table_85efe0ba6255470f906b736c34b310f8" modify_external_catalogs: true
I20260928 14:50:26.390743 9855 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.381398 8950 catalog_manager.cc:5495] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:26.393340 9855 tablet_bootstrap.cc:654] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.393386 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.393785 9848 tablet_bootstrap.cc:654] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.394249 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.398218 10068 raft_consensus.cc:482] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.398392 10068 raft_consensus.cc:504] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.399039 10068 leader_election.cc:288] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.400552 10187 raft_consensus.cc:482] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.400745 10187 raft_consensus.cc:504] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.401467 10187 leader_election.cc:288] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.402259 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5166a828e84d46af3112cdc7bb0a2a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.402913 9219 leader_election.cc:341] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:26.403010 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--webserver_interface=127.8.181.60
--webserver_port=33241
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 14:50:26.403291 9220 leader_election.cc:341] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:26.403431 9220 leader_election.cc:302] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.403846 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5166a828e84d46af3112cdc7bb0a2a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.404078 9569 raft_consensus.cc:2454] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:26.406108 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4bd612753b914a079ccf89249b073018
I20260928 14:50:26.406486 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 4bd612753b914a079ccf89249b073018 deleted and replaced by tablet e3236b0fb0944dc0a1f0893eb8d8e3b4
I20260928 14:50:26.406708 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet f3dee7ff6d5544908cdd9dbd45ce521a from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:26.412922 9815 ts_tablet_manager.cc:1918] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:26.413079 9815 log.cc:1196] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/def872f66b2541b9af6084e93d991ec2
I20260928 14:50:26.413434 9815 ts_tablet_manager.cc:1939] T def872f66b2541b9af6084e93d991ec2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.415230 10174 mvcc.cc:205] Tried to move back new op lower bound from 7334326371509981184 to 7334326368892301312. Current Snapshot: MvccSnapshot[applied={T|T < 7334326371509981184}]
I20260928 14:50:26.417778 10152 consensus_queue.cc:1035] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:26.419004 9567 raft_consensus.cc:2454] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:26.419929 10205 raft_consensus.cc:2726] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.421819 10206 raft_consensus.cc:482] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.422603 10206 raft_consensus.cc:504] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.423298 10206 leader_election.cc:288] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:26.425071 9219 leader_election.cc:341] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5a64ffa786f045b480efe51eb69d7074
I20260928 14:50:26.425380 10206 raft_consensus.cc:482] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.425601 10206 raft_consensus.cc:504] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.426157 10206 leader_election.cc:288] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.426792 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c101b1f03bb411f963f2348397c03e2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.427052 9567 raft_consensus.cc:2454] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:26.427552 9219 leader_election.cc:302] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:26.427789 10206 raft_consensus.cc:2781] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.427911 10206 raft_consensus.cc:482] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.429893 10206 raft_consensus.cc:3037] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.431061 9855 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.431289 9855 ts_tablet_manager.cc:1397] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.014s
I20260928 14:50:26.432111 9855 raft_consensus.cc:348] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.432415 9855 raft_consensus.cc:374] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.432528 9855 raft_consensus.cc:729] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.432818 9855 consensus_queue.cc:260] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.434485 9855 ts_tablet_manager.cc:1428] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:26.435557 9855 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.437067 9855 tablet_bootstrap.cc:654] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.440503 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bd612753b914a079ccf89249b073018 with delete_type TABLET_DATA_DELETED (replaced by tablet e3236b0fb0944dc0a1f0893eb8d8e3b4) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.442160 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148e81f8add349f2b233862a7049e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:26.446520 9855 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.446838 9855 ts_tablet_manager.cc:1397] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260928 14:50:26.447616 9855 raft_consensus.cc:348] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.447917 9855 raft_consensus.cc:374] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.448051 9855 raft_consensus.cc:729] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.448302 9855 consensus_queue.cc:260] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.452708 9855 ts_tablet_manager.cc:1428] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:26.453861 9855 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.456272 9285 raft_consensus.cc:3037] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.458446 9855 tablet_bootstrap.cc:654] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.466779 10152 raft_consensus.cc:482] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.466928 10152 raft_consensus.cc:504] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.467484 10152 leader_election.cc:288] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.468348 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.469857 9497 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.470582 9855 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.470775 9855 ts_tablet_manager.cc:1397] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.012s
I20260928 14:50:26.471737 9855 raft_consensus.cc:348] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.472111 9855 raft_consensus.cc:374] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.472252 9855 raft_consensus.cc:729] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.472554 9855 consensus_queue.cc:260] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.475060 9855 ts_tablet_manager.cc:1428] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:26.476222 10152 consensus_queue.cc:1035] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:26.475061 9360 leader_election.cc:341] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:26.476843 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 73432.8us
I20260928 14:50:26.477126 9360 leader_election.cc:302] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.477202 9855 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.477509 9360 leader_election.cc:302] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.477820 10058 raft_consensus.cc:482] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.477957 10058 raft_consensus.cc:504] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.478467 10058 leader_election.cc:288] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.478873 9855 tablet_bootstrap.cc:654] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.478853 10058 raft_consensus.cc:2781] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.478938 10058 raft_consensus.cc:482] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.479036 10058 raft_consensus.cc:3037] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.479099 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bd612753b914a079ccf89249b073018 with delete_type TABLET_DATA_DELETED (replaced by tablet e3236b0fb0944dc0a1f0893eb8d8e3b4) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.481712 10189 raft_consensus.cc:2781] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.481833 10189 raft_consensus.cc:686] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:26.482097 10189 consensus_queue.cc:237] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.483803 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.485268 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.486455 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:26.486728 9425 raft_consensus.cc:2454] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.487717 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.487946 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bd612753b914a079ccf89249b073018 with delete_type TABLET_DATA_DELETED (replaced by tablet e3236b0fb0944dc0a1f0893eb8d8e3b4) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.488133 9855 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.488282 9855 ts_tablet_manager.cc:1397] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
W20260928 14:50:26.488405 9220 leader_election.cc:341] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 5a64ffa786f045b480efe51eb69d7074
I20260928 14:50:26.488564 9220 leader_election.cc:302] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:26.488972 9220 leader_election.cc:341] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:26.489024 9855 raft_consensus.cc:348] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.489212 9855 raft_consensus.cc:374] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.489230 10068 raft_consensus.cc:2726] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.489285 9855 raft_consensus.cc:729] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.489615 9498 leader_election.cc:302] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.489492 9855 consensus_queue.cc:260] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.489862 10152 raft_consensus.cc:2781] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.489955 10152 raft_consensus.cc:482] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.490056 10152 raft_consensus.cc:3037] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.491457 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.492029 9855 ts_tablet_manager.cc:1428] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:26.493978 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.494623 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.495110 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6ed8ff8486eb431fb6b3a9389b206f83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.495683 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ed8ff8486eb431fb6b3a9389b206f83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.497177 9855 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.498790 9855 tablet_bootstrap.cc:654] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.502768 10066 raft_consensus.cc:482] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.502905 10066 raft_consensus.cc:504] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.503489 10066 leader_election.cc:288] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.504132 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ee1e19142b402f96056c387140b5ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.504668 9497 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:26.505651 9498 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:26.505755 9498 leader_election.cc:302] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.506603 10066 raft_consensus.cc:2726] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.506707 9427 raft_consensus.cc:2454] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:26.506786 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:26.508097 9821 raft_consensus.cc:504] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.508612 9821 leader_election.cc:288] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.510114 10058 raft_consensus.cc:504] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.510440 9815 tablet_replica.cc:330] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.510623 9815 raft_consensus.cc:2229] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:26.510716 10058 leader_election.cc:288] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.510839 9815 pending_rounds.cc:62] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:26.510893 9815 pending_rounds.cc:68] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326377825837056 op_type: NO_OP noop_request { }
I20260928 14:50:26.511027 9815 raft_consensus.cc:2866] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:26.511117 9815 raft_consensus.cc:2258] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.516322 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet def872f66b2541b9af6084e93d991ec2 (table default.Table_636fad71edff41c6a084cd4b40b2a02e [id=944b7f0777354b8d96d264eb858cfc93]) successfully deleted
I20260928 14:50:26.517056 9815 ts_tablet_manager.cc:1905] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.517634 9814 ts_tablet_manager.cc:1918] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:26.517766 9814 log.cc:1196] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/63792bb2d5b54463a701c9e4e5f095e0
I20260928 14:50:26.518086 9814 ts_tablet_manager.cc:1939] T 63792bb2d5b54463a701c9e4e5f095e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:26.521274 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.521970 9813 ts_tablet_manager.cc:1918] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:26.522111 9813 log.cc:1196] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8c8624f9349a4608a48943487f01c7c8
I20260928 14:50:26.522495 9813 ts_tablet_manager.cc:1939] T 8c8624f9349a4608a48943487f01c7c8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:26.522881 9497 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.526814 9498 leader_election.cc:302] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.526840 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:26.526979 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89959226fd6247d4b89c54cc6ef4ede6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.527169 9427 raft_consensus.cc:3037] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.527281 9821 raft_consensus.cc:2781] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.527395 9821 raft_consensus.cc:686] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:26.527630 9821 consensus_queue.cc:237] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.527661 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7b0fb0bac48645b68ed77a4a2605c08b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.528283 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0fb0bac48645b68ed77a4a2605c08b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.530514 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:26.531013 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 53544.9us
I20260928 14:50:26.531117 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.531638 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d7539290064c2c9fda29a5f16d375b" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.533154 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5166a828e84d46af3112cdc7bb0a2a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.534194 9855 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.534363 9855 ts_tablet_manager.cc:1397] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260928 14:50:26.535084 9855 raft_consensus.cc:348] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.535333 9855 raft_consensus.cc:374] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.535411 9855 raft_consensus.cc:729] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.535636 9855 consensus_queue.cc:260] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.536147 9855 ts_tablet_manager.cc:1428] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.536085 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d7539290064c2c9fda29a5f16d375b" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.536322 9567 raft_consensus.cc:2454] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
W20260928 14:50:26.536612 9360 leader_election.cc:341] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:26.536867 9360 leader_election.cc:341] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.537055 9360 leader_election.cc:302] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.537118 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5166a828e84d46af3112cdc7bb0a2a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:26.537272 9855 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.537297 10211 raft_consensus.cc:2781] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.537319 9567 raft_consensus.cc:3037] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.537389 10211 raft_consensus.cc:482] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.537489 10211 raft_consensus.cc:3037] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.538827 9855 tablet_bootstrap.cc:654] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.541321 9848 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:26.543180 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e3a9f292618469c8d84da18059419b0 consensus state has no leader
I20260928 14:50:26.543581 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ef5bbf342a72427a9418d8f04f3e387f" } new_table_name: "default.Table_555f59ea18fe4b02b2aa905e0dbf8e53" modify_external_catalogs: true
I20260928 14:50:26.545406 9848 ts_tablet_manager.cc:1397] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.168s user 0.020s sys 0.019s
I20260928 14:50:26.545660 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.546203 9848 raft_consensus.cc:348] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.546425 9848 raft_consensus.cc:374] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.546514 9848 raft_consensus.cc:729] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.546710 9848 consensus_queue.cc:260] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.547320 9848 ts_tablet_manager.cc:1428] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:26.547593 9848 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:26.548475 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4a42fd88515046c7a669b993ffd4bb23" } new_table_name: "default.Table_d4000cdd4f98428e8f059b33cf38b381" modify_external_catalogs: true
I20260928 14:50:26.549083 9848 tablet_bootstrap.cc:654] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.550664 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fef73768d74d4e4e88501663bd431a4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.551191 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fef73768d74d4e4e88501663bd431a4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.552479 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:26.554589 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8e132204dd2e4ea9bcec96f5d7018df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.555074 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e132204dd2e4ea9bcec96f5d7018df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:26.556123 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 091600d56fdc469d8b754acd8933808b consensus state has no leader
I20260928 14:50:26.556430 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_725d6b822a1d4f99a2232890822325ab" } modify_external_catalogs: true
I20260928 14:50:26.556579 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_725d6b822a1d4f99a2232890822325ab" } modify_external_catalogs: true
I20260928 14:50:26.558085 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5b5e5d62d87d4917a33183603d3f1859"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.558527 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b5e5d62d87d4917a33183603d3f1859 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.562071 9855 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.562222 9855 ts_tablet_manager.cc:1397] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20260928 14:50:26.564147 9855 raft_consensus.cc:348] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.564356 9855 raft_consensus.cc:374] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.564451 9855 raft_consensus.cc:729] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.564704 9855 consensus_queue.cc:260] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.565258 9855 ts_tablet_manager.cc:1428] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260928 14:50:26.565191 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cec79b345afa4c25bbd3c96ac88c6b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:26.565539 9855 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:26.565666 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec79b345afa4c25bbd3c96ac88c6b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.567108 9855 tablet_bootstrap.cc:654] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.569876 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.571663 9427 raft_consensus.cc:2454] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:26.572643 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 206) took 2658 ms. Trace:
I20260928 14:50:26.572799 9814 rpcz_store.cc:276] 0928 14:50:23.913805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.913873 (+ 68us) service_pool.cc:227] Handling call
0928 14:50:26.036011 (+2122138us) ts_tablet_manager.cc:1145] Deleting tablet 63792bb2d5b54463a701c9e4e5f095e0
0928 14:50:26.036020 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.240997 (+204977us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.517409 (+276412us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.572572 (+ 55163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12696,"tablet-delete.queue_time_us":2121944}
I20260928 14:50:26.573470 9814 tablet_replica.cc:330] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:26.573726 9814 raft_consensus.cc:2229] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.573969 9814 raft_consensus.cc:2258] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.574544 9814 ts_tablet_manager.cc:1905] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.568171 10054 raft_consensus.cc:504] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.575415 10054 leader_election.cc:288] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.570320 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.572266 9498 leader_election.cc:302] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.575796 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 63792bb2d5b54463a701c9e4e5f095e0 (table default.Table_1fbd2d249f864ee3b39fe0a5d0a6e34a [id=e88df51bfbbd468d8c3109fe2f45dd8d]) successfully deleted
I20260928 14:50:26.576331 10054 raft_consensus.cc:2781] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.576279 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8218bc963a9941a49e8329d0a04d8252" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.576521 9427 raft_consensus.cc:3037] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.575505 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8218bc963a9941a49e8329d0a04d8252" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.577680 10054 raft_consensus.cc:686] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
W20260928 14:50:26.580729 9497 leader_election.cc:341] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.580927 10054 consensus_queue.cc:237] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.580968 10206 raft_consensus.cc:504] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.582089 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c101b1f03bb411f963f2348397c03e2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:26.583302 9569 raft_consensus.cc:3037] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.585669 9855 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:26.586459 9220 leader_election.cc:341] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:26.586685 10206 leader_election.cc:288] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.588193 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.589152 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 264) took 2013 ms. Trace:
I20260928 14:50:26.589409 9855 ts_tablet_manager.cc:1397] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260928 14:50:26.589335 9813 rpcz_store.cc:276] 0928 14:50:24.574990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.589133 (+ 14143us) service_pool.cc:227] Handling call
0928 14:50:26.141820 (+1552687us) ts_tablet_manager.cc:1145] Deleting tablet 8c8624f9349a4608a48943487f01c7c8
0928 14:50:26.141832 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.340240 (+198408us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.521835 (+181595us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.588064 (+ 66229us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2552,"tablet-delete.queue_time_us":1552483}
I20260928 14:50:26.590255 9855 raft_consensus.cc:348] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.590492 9855 raft_consensus.cc:374] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.590564 9855 raft_consensus.cc:729] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.590679 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8c8624f9349a4608a48943487f01c7c8 (table default.Table_1d54df7671a0472193f255cb56c15768 [id=b8333e21752c4aabb04a7caeeb0515a3]) successfully deleted
I20260928 14:50:26.590876 9855 consensus_queue.cc:260] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.591383 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 263) took 2063 ms. Trace:
I20260928 14:50:26.591547 9855 ts_tablet_manager.cc:1428] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:26.591809 9813 rpcz_store.cc:276] 0928 14:50:24.527511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.582107 (+ 54596us) service_pool.cc:227] Handling call
0928 14:50:26.591056 (+2008949us) ts_tablet_manager.cc:1145] Deleting tablet 0489aea8bb0a45daaaec6a48db756c51
0928 14:50:26.591066 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.591343 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992011}
W20260928 14:50:26.593025 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
I20260928 14:50:26.593518 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 265) took 1996 ms. Trace:
I20260928 14:50:26.594129 9813 rpcz_store.cc:276] 0928 14:50:24.596960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.597070 (+ 110us) service_pool.cc:227] Handling call
0928 14:50:26.593372 (+1996302us) ts_tablet_manager.cc:1145] Deleting tablet 0489aea8bb0a45daaaec6a48db756c51
0928 14:50:26.593382 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.593466 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1976253}
W20260928 14:50:26.594813 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
I20260928 14:50:26.595268 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 269) took 1963 ms. Trace:
I20260928 14:50:26.595707 9813 rpcz_store.cc:276] 0928 14:50:24.631597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.631669 (+ 72us) service_pool.cc:227] Handling call
0928 14:50:26.595126 (+1963457us) ts_tablet_manager.cc:1145] Deleting tablet ba281355b2f44b77a4ff99d49c084162
0928 14:50:26.595136 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.595232 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948832}
W20260928 14:50:26.596336 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ba281355b2f44b77a4ff99d49c084162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba281355b2f44b77a4ff99d49c084162 already in progress: creating tablet
I20260928 14:50:26.596654 9855 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.596969 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 270) took 1962 ms. Trace:
I20260928 14:50:26.598495 9855 tablet_bootstrap.cc:654] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.599330 9815 ts_tablet_manager.cc:1918] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:26.599269 10152 raft_consensus.cc:504] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.599476 9815 log.cc:1196] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:26.599893 9815 ts_tablet_manager.cc:1939] T 32e7e11092d1475cba53e51a0f61d6f1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.599936 10152 leader_election.cc:288] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.600780 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 304) took 1063 ms. Trace:
I20260928 14:50:26.600888 9815 rpcz_store.cc:276] 0928 14:50:25.537274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.537323 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:26.510343 (+973020us) ts_tablet_manager.cc:1145] Deleting tablet 32e7e11092d1475cba53e51a0f61d6f1
0928 14:50:26.510352 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.576127 (+ 65775us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.599171 (+ 23044us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.600713 (+ 1542us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":972769}
I20260928 14:50:26.601318 9815 tablet_replica.cc:330] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.601552 9815 raft_consensus.cc:2229] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.602414 9815 raft_consensus.cc:2258] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.602291 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.603123 9426 raft_consensus.cc:3037] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.603277 9815 ts_tablet_manager.cc:1905] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.603758 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 32e7e11092d1475cba53e51a0f61d6f1 (table default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]) successfully deleted
I20260928 14:50:26.606050 9813 rpcz_store.cc:276] 0928 14:50:24.634880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.634935 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:26.596630 (+1961695us) ts_tablet_manager.cc:1145] Deleting tablet ee1eb8a9faf04e3b97db9e0f8e9104f8
0928 14:50:26.596639 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.596931 (+ 292us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939407}
I20260928 14:50:26.614315 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 273) took 1868 ms. Trace:
I20260928 14:50:26.614557 9813 rpcz_store.cc:276] 0928 14:50:24.746010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.746760 (+ 750us) service_pool.cc:227] Handling call
0928 14:50:26.613924 (+1867164us) ts_tablet_manager.cc:1145] Deleting tablet ca5c040fa6ba4e2785959874a3346bf7
0928 14:50:26.613936 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.614186 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1862737}
W20260928 14:50:26.615164 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 already in progress: creating tablet
W20260928 14:50:26.615530 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ca5c040fa6ba4e2785959874a3346bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5c040fa6ba4e2785959874a3346bf7 already in progress: creating tablet
I20260928 14:50:26.616115 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 279) took 1769 ms. Trace:
I20260928 14:50:26.616384 9813 rpcz_store.cc:276] 0928 14:50:24.846399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.846663 (+ 264us) service_pool.cc:227] Handling call
0928 14:50:26.615849 (+1769186us) ts_tablet_manager.cc:1145] Deleting tablet cbd9f9cb48a945d19420a8bdb9bb9576
0928 14:50:26.615860 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.616004 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1760701}
W20260928 14:50:26.617285 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cbd9f9cb48a945d19420a8bdb9bb9576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd9f9cb48a945d19420a8bdb9bb9576 already in progress: creating tablet
I20260928 14:50:26.617412 9855 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.617650 9855 ts_tablet_manager.cc:1397] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20260928 14:50:26.618146 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 280) took 1764 ms. Trace:
I20260928 14:50:26.618917 9813 rpcz_store.cc:276] 0928 14:50:24.853672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.853988 (+ 316us) service_pool.cc:227] Handling call
0928 14:50:26.617666 (+1763678us) ts_tablet_manager.cc:1145] Deleting tablet 6891077c78ef4f3d84e33283096ddf7a
0928 14:50:26.617878 (+ 212us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.618034 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1739864}
I20260928 14:50:26.619020 9855 raft_consensus.cc:348] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.619233 9855 raft_consensus.cc:374] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.619323 9855 raft_consensus.cc:729] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.619577 9855 consensus_queue.cc:260] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:26.619953 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6891077c78ef4f3d84e33283096ddf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6891077c78ef4f3d84e33283096ddf7a already in progress: creating tablet
I20260928 14:50:26.620150 9855 ts_tablet_manager.cc:1428] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:26.620509 9855 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.622181 9855 tablet_bootstrap.cc:654] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.624902 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 281) took 1758 ms. Trace:
I20260928 14:50:26.625358 9813 rpcz_store.cc:276] 0928 14:50:24.866579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.866752 (+ 173us) service_pool.cc:227] Handling call
0928 14:50:26.624771 (+1758019us) ts_tablet_manager.cc:1145] Deleting tablet fd24e60a0e944f6086ff9c9fbe2e8180
0928 14:50:26.624781 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.624863 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1702514}
I20260928 14:50:26.602595 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffd9bc260ae4373a946ce82ba5f0d48" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:26.626446 9497 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:26.629619 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fd24e60a0e944f6086ff9c9fbe2e8180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd24e60a0e944f6086ff9c9fbe2e8180 already in progress: creating tablet
I20260928 14:50:26.631305 9855 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.631456 9855 ts_tablet_manager.cc:1397] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260928 14:50:26.632184 9855 raft_consensus.cc:348] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.632431 9855 raft_consensus.cc:374] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.633391 9855 raft_consensus.cc:729] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.633659 9855 consensus_queue.cc:260] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.634135 9855 ts_tablet_manager.cc:1428] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:26.634555 9855 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.639643 9848 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:26.639842 9855 tablet_bootstrap.cc:654] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.639930 9848 ts_tablet_manager.cc:1397] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.092s user 0.009s sys 0.000s
I20260928 14:50:26.640928 9848 raft_consensus.cc:348] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.641378 9848 raft_consensus.cc:374] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.641487 9848 raft_consensus.cc:729] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.643108 9848 consensus_queue.cc:260] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.643675 9848 ts_tablet_manager.cc:1428] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:26.644908 9848 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:26.647830 9427 raft_consensus.cc:2454] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:26.648689 9855 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.648875 9855 ts_tablet_manager.cc:1397] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20260928 14:50:26.649803 9855 raft_consensus.cc:348] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.650101 9855 raft_consensus.cc:374] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.650243 9855 raft_consensus.cc:729] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.650497 9855 consensus_queue.cc:260] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.651741 9498 leader_election.cc:302] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.651971 9855 ts_tablet_manager.cc:1428] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:26.652225 9855 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.652225 10054 raft_consensus.cc:2781] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.652699 10054 raft_consensus.cc:686] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:26.653167 9567 raft_consensus.cc:2454] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:26.653644 9426 raft_consensus.cc:2454] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:26.653707 9569 raft_consensus.cc:2454] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:26.653720 9360 leader_election.cc:302] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.653769 9855 tablet_bootstrap.cc:654] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.654143 10215 raft_consensus.cc:2781] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.654181 9219 leader_election.cc:302] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.654320 10215 raft_consensus.cc:686] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:26.654728 10215 consensus_queue.cc:237] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.656065 9498 leader_election.cc:302] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:26.656266 9498 raft_consensus.cc:2670] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:26.653018 10054 consensus_queue.cc:237] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.657608 9815 ts_tablet_manager.cc:1918] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:26.659126 9815 log.cc:1196] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:26.659660 9815 ts_tablet_manager.cc:1939] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.660576 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 305) took 1050 ms. Trace:
I20260928 14:50:26.662554 9815 rpcz_store.cc:276] 0928 14:50:25.610244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.611205 (+ 961us) service_pool.cc:227] Handling call
0928 14:50:26.601231 (+990026us) ts_tablet_manager.cc:1145] Deleting tablet 6ffd9bc260ae4373a946ce82ba5f0d48
0928 14:50:26.601241 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.647660 (+ 46419us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.657421 (+ 9761us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.660528 (+ 3107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":941498}
I20260928 14:50:26.663322 9815 tablet_replica.cc:330] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.663287 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (table default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]) successfully deleted
W20260928 14:50:26.663777 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6feba01e78004e50a71c610c9a63aeb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6feba01e78004e50a71c610c9a63aeb5 already in progress: creating tablet
I20260928 14:50:26.663678 10211 raft_consensus.cc:504] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.665196 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d7539290064c2c9fda29a5f16d375b" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:26.665962 9360 leader_election.cc:341] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.666594 9815 raft_consensus.cc:2229] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.667388 10211 leader_election.cc:288] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:26.667490 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d7539290064c2c9fda29a5f16d375b" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:26.667739 9567 raft_consensus.cc:3037] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.667950 9815 raft_consensus.cc:2258] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.669014 9815 ts_tablet_manager.cc:1905] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.672111 9567 raft_consensus.cc:2454] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:26.672704 9360 leader_election.cc:302] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.675084 10211 raft_consensus.cc:2781] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.675410 10211 raft_consensus.cc:686] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:26.675755 10211 consensus_queue.cc:237] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.671613 10206 raft_consensus.cc:2781] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.679668 10206 raft_consensus.cc:686] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:26.680037 10206 consensus_queue.cc:237] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.686273 9815 ts_tablet_manager.cc:1918] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:26.686501 9815 log.cc:1196] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ed0d79a39b2543049506422432990617
I20260928 14:50:26.686950 9815 ts_tablet_manager.cc:1939] T ed0d79a39b2543049506422432990617 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.689065 9815 tablet_replica.cc:330] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:26.689019 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2f0b97883acb4adfa4091653545e894b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0b97883acb4adfa4091653545e894b already in progress: creating tablet
W20260928 14:50:26.689262 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 75f9359df0ac466c912cd20fc6b94390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f9359df0ac466c912cd20fc6b94390 already in progress: creating tablet
I20260928 14:50:26.689347 9815 raft_consensus.cc:2229] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:26.689589 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a19995a0d8af4d3ca562bade80ce006f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19995a0d8af4d3ca562bade80ce006f already in progress: creating tablet
I20260928 14:50:26.689649 9815 raft_consensus.cc:2258] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:26.690097 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 41b8584ba1914c3390aee99baaee289e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b8584ba1914c3390aee99baaee289e already in progress: creating tablet
W20260928 14:50:26.690344 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b65fd0746d1b474e9fbebe6f09053743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65fd0746d1b474e9fbebe6f09053743 already in progress: creating tablet
I20260928 14:50:26.690542 9815 ts_tablet_manager.cc:1905] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:26.690590 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6a828130854b4e4e8c44b2b45260e50e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a828130854b4e4e8c44b2b45260e50e already in progress: creating tablet
I20260928 14:50:26.690846 9855 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.691002 9855 ts_tablet_manager.cc:1397] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.012s
I20260928 14:50:26.691756 9855 raft_consensus.cc:348] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.692000 9855 raft_consensus.cc:374] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.692106 9855 raft_consensus.cc:729] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.692351 9855 consensus_queue.cc:260] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.692888 9855 ts_tablet_manager.cc:1428] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.693186 9855 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.695076 9855 tablet_bootstrap.cc:654] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.704458 9855 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.704594 9855 ts_tablet_manager.cc:1397] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 14:50:26.705353 9855 raft_consensus.cc:348] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.705597 9855 raft_consensus.cc:374] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.705688 9855 raft_consensus.cc:729] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.705906 9855 consensus_queue.cc:260] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.706521 9855 ts_tablet_manager.cc:1428] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:26.706799 9855 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.708736 9855 tablet_bootstrap.cc:654] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.714277 10189 raft_consensus.cc:482] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.714504 10189 raft_consensus.cc:504] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.715175 10189 leader_election.cc:288] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.716068 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd70cf6ee2d343878c90ae4818f1eb8f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:26.716331 9567 raft_consensus.cc:2454] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:26.719298 9360 leader_election.cc:302] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:26.719789 10189 raft_consensus.cc:2781] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.719887 10189 raft_consensus.cc:482] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.719997 10189 raft_consensus.cc:3037] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.721578 9855 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.721742 9855 ts_tablet_manager.cc:1397] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.001s
I20260928 14:50:26.722458 9855 raft_consensus.cc:348] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.722707 9855 raft_consensus.cc:374] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.722787 9855 raft_consensus.cc:729] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.723040 9855 consensus_queue.cc:260] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.723567 9855 ts_tablet_manager.cc:1428] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.723886 9855 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.725561 9855 tablet_bootstrap.cc:654] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.733569 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 282) took 1741 ms. Trace:
I20260928 14:50:26.733767 9813 rpcz_store.cc:276] 0928 14:50:24.945928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.946129 (+ 201us) service_pool.cc:227] Handling call
0928 14:50:26.646761 (+1700632us) ts_tablet_manager.cc:1145] Deleting tablet 5fc978ea3a194282aacc6ede22076c21
0928 14:50:26.646771 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.687278 (+ 40507us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689449}
W20260928 14:50:26.734472 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5fc978ea3a194282aacc6ede22076c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc978ea3a194282aacc6ede22076c21 already in progress: creating tablet
I20260928 14:50:26.734992 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd70cf6ee2d343878c90ae4818f1eb8f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.735697 9360 leader_election.cc:341] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.736472 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 283) took 1733 ms. Trace:
I20260928 14:50:26.736647 9813 rpcz_store.cc:276] 0928 14:50:25.003155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.003361 (+ 206us) service_pool.cc:227] Handling call
0928 14:50:26.736298 (+1732937us) ts_tablet_manager.cc:1145] Deleting tablet 01c1e945f1c54281856bfabe08fba42e
0928 14:50:26.736314 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.736425 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1732560}
W20260928 14:50:26.737174 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 01c1e945f1c54281856bfabe08fba42e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01c1e945f1c54281856bfabe08fba42e already in progress: creating tablet
I20260928 14:50:26.737916 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 289) took 1639 ms. Trace:
I20260928 14:50:26.739035 9813 rpcz_store.cc:276] 0928 14:50:25.098273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.099270 (+ 997us) service_pool.cc:227] Handling call
0928 14:50:26.737731 (+1638461us) ts_tablet_manager.cc:1145] Deleting tablet 46fe647c6d80431bbb76899126d01c3b
0928 14:50:26.737744 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.737882 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638066}
W20260928 14:50:26.740963 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 46fe647c6d80431bbb76899126d01c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46fe647c6d80431bbb76899126d01c3b already in progress: creating tablet
I20260928 14:50:26.741572 9813 tablet_replica.cc:330] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:26.742532 9813 raft_consensus.cc:2229] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:26.743223 10152 raft_consensus.cc:482] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.743393 10152 raft_consensus.cc:504] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.744048 10152 leader_election.cc:288] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.745055 10152 raft_consensus.cc:482] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.745203 10152 raft_consensus.cc:504] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.745738 10152 leader_election.cc:288] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.746361 9855 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.746515 9855 ts_tablet_manager.cc:1397] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
I20260928 14:50:26.746788 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.747715 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee16f4482a424538812f6356655acf77" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.747759 9497 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.747920 9855 raft_consensus.cc:348] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.748159 9855 raft_consensus.cc:374] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.748399 9855 raft_consensus.cc:729] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:26.748412 9497 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.748616 9855 consensus_queue.cc:260] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.749222 9855 ts_tablet_manager.cc:1428] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:26.749511 9855 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.757659 9855 tablet_bootstrap.cc:654] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.769021 10152 raft_consensus.cc:482] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.769186 10152 raft_consensus.cc:504] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.770140 10152 leader_election.cc:288] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.779235 9855 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.779413 9855 ts_tablet_manager.cc:1397] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.004s
I20260928 14:50:26.780249 9855 raft_consensus.cc:348] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.780488 9855 raft_consensus.cc:374] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.780573 9855 raft_consensus.cc:729] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.780836 9855 consensus_queue.cc:260] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.781457 9855 ts_tablet_manager.cc:1428] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:26.781831 9855 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.784857 9855 tablet_bootstrap.cc:654] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.791826 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9a7573c751d412aa8394d6277c28b7f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.792618 9497 leader_election.cc:341] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.744840 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee16f4482a424538812f6356655acf77" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.746444 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.793071 9813 raft_consensus.cc:2258] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.793222 9427 raft_consensus.cc:2454] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.771508 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9a7573c751d412aa8394d6277c28b7f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.779685 10189 raft_consensus.cc:504] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:26.793740 9498 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.793895 9498 leader_election.cc:302] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.794283 9498 leader_election.cc:302] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.794561 9821 raft_consensus.cc:2726] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:26.794709 9498 leader_election.cc:341] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.794747 9821 raft_consensus.cc:2781] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.794838 9498 leader_election.cc:302] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.794862 9821 raft_consensus.cc:482] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.794955 9821 raft_consensus.cc:3037] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.795675 10189 leader_election.cc:288] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.796487 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd70cf6ee2d343878c90ae4818f1eb8f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:26.796701 9567 raft_consensus.cc:3037] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.797147 9855 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.797322 9855 ts_tablet_manager.cc:1397] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260928 14:50:26.797544 10066 raft_consensus.cc:2726] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.798189 9855 raft_consensus.cc:348] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.798437 9855 raft_consensus.cc:374] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.798533 9855 raft_consensus.cc:729] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.798784 9855 consensus_queue.cc:260] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.799396 9855 ts_tablet_manager.cc:1428] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:26.799670 9855 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.801090 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd70cf6ee2d343878c90ae4818f1eb8f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.801584 9855 tablet_bootstrap.cc:654] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:26.801771 9360 leader_election.cc:341] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.804057 9848 tablet_bootstrap.cc:654] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.815102 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:26.815550 8949 catalog_manager.cc:6565] ReplaceTablet: tablet f3dee7ff6d5544908cdd9dbd45ce521a deleted and replaced by tablet f39c1da071164342aea8eab263d4eebb
I20260928 14:50:26.816792 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a with delete_type TABLET_DATA_DELETED (replaced by tablet f39c1da071164342aea8eab263d4eebb) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:26.817628 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a with delete_type TABLET_DATA_DELETED (replaced by tablet f39c1da071164342aea8eab263d4eebb) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.818593 9855 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.818774 9855 ts_tablet_manager.cc:1397] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260928 14:50:26.819087 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a with delete_type TABLET_DATA_DELETED (replaced by tablet f39c1da071164342aea8eab263d4eebb) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.819577 9855 raft_consensus.cc:348] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.819839 9855 raft_consensus.cc:374] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.819907 9855 raft_consensus.cc:729] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.820971 9855 consensus_queue.cc:260] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.821607 9855 ts_tablet_manager.cc:1428] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:26.821928 9855 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.823694 9855 tablet_bootstrap.cc:654] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.823731 9813 ts_tablet_manager.cc:1905] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:26.829753 9851 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.517s user 0.094s sys 0.096s
W20260928 14:50:26.829859 9851 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.517s user 0.094s sys 0.096s
I20260928 14:50:26.830106 10152 raft_consensus.cc:482] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.830274 10152 raft_consensus.cc:504] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.830471 9814 ts_tablet_manager.cc:1918] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:26.830608 9814 log.cc:1196] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4025017d30034ea3adc6b5fd55d18617
I20260928 14:50:26.830734 9851 tablet_bootstrap.cc:492] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.830842 10152 leader_election.cc:288] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.830881 9851 ts_tablet_manager.cc:1397] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.526s user 0.096s sys 0.096s
I20260928 14:50:26.831192 9815 ts_tablet_manager.cc:1918] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:26.831316 9815 log.cc:1196] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c9cee872de1f4ce8b803cb8e8fb018d2
I20260928 14:50:26.831405 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.831707 9815 ts_tablet_manager.cc:1939] T c9cee872de1f4ce8b803cb8e8fb018d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:26.831892 9498 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.832428 9821 raft_consensus.cc:504] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.832415 9851 raft_consensus.cc:348] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.832647 9851 raft_consensus.cc:374] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.832722 9851 raft_consensus.cc:729] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.833079 9821 leader_election.cc:288] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.833210 9821 raft_consensus.cc:482] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.833338 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.833338 9821 raft_consensus.cc:504] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.833547 9425 raft_consensus.cc:3037] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.833945 9855 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.834090 9855 ts_tablet_manager.cc:1397] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260928 14:50:26.835132 9855 raft_consensus.cc:348] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.835439 9855 raft_consensus.cc:374] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.835549 9855 raft_consensus.cc:729] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.835763 9855 consensus_queue.cc:260] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.832988 9851 consensus_queue.cc:260] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.836403 9851 ts_tablet_manager.cc:1428] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:26.836447 9855 ts_tablet_manager.cc:1428] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:26.836699 9851 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.836724 9855 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.838340 9851 tablet_bootstrap.cc:654] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.838596 9855 tablet_bootstrap.cc:654] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.838603 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:26.840499 9497 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.842665 9821 leader_election.cc:288] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.843326 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf10326ec24b99ae2ab1ba8779d1a3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.843951 9497 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.844180 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf10326ec24b99ae2ab1ba8779d1a3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:26.844671 9498 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.844815 9498 leader_election.cc:302] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.845271 9821 raft_consensus.cc:2726] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.845510 9851 tablet_bootstrap.cc:492] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.845669 9851 ts_tablet_manager.cc:1397] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260928 14:50:26.846552 9851 raft_consensus.cc:348] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.846848 9851 raft_consensus.cc:374] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.847020 9851 raft_consensus.cc:729] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.847254 9851 consensus_queue.cc:260] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.849171 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.849828 9851 ts_tablet_manager.cc:1428] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260928 14:50:26.849812 9497 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.849997 9497 leader_election.cc:302] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.850191 9851 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.851953 9821 raft_consensus.cc:2726] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.853046 9855 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.853212 9855 ts_tablet_manager.cc:1397] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20260928 14:50:26.854004 9855 raft_consensus.cc:348] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.854271 9855 raft_consensus.cc:374] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.854341 9855 raft_consensus.cc:729] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.854560 9855 consensus_queue.cc:260] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.855098 9855 ts_tablet_manager.cc:1428] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:26.855510 9855 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.855595 9851 tablet_bootstrap.cc:654] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.857914 9855 tablet_bootstrap.cc:654] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.862318 9851 tablet_bootstrap.cc:492] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.862499 9851 ts_tablet_manager.cc:1397] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260928 14:50:26.863207 9851 raft_consensus.cc:348] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.863451 9851 raft_consensus.cc:374] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.863533 9851 raft_consensus.cc:729] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.863752 9851 consensus_queue.cc:260] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.864440 9851 ts_tablet_manager.cc:1428] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:26.864723 9851 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:26.865275 10206 raft_consensus.cc:482] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.865484 10206 raft_consensus.cc:504] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:26.866837 9219 leader_election.cc:341] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9b998502f90a4df08b4078f833ad8c05
W20260928 14:50:26.867059 9220 leader_election.cc:341] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:26.867215 9220 leader_election.cc:302] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.867552 10068 raft_consensus.cc:2726] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.867563 10206 leader_election.cc:288] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.872516 9851 tablet_bootstrap.cc:654] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.873821 9855 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.874037 9855 ts_tablet_manager.cc:1397] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260928 14:50:26.875684 9855 raft_consensus.cc:348] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.875926 9855 raft_consensus.cc:374] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.876025 9855 raft_consensus.cc:729] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.876277 9855 consensus_queue.cc:260] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.876859 9855 ts_tablet_manager.cc:1428] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:26.877133 9855 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.879551 10152 raft_consensus.cc:482] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.879704 10152 raft_consensus.cc:504] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.880290 10152 leader_election.cc:288] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.880563 10068 raft_consensus.cc:482] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.880853 10068 raft_consensus.cc:504] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.881688 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc4c49a4962473699103528b64a1005" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.881994 9855 tablet_bootstrap.cc:654] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.882162 9425 raft_consensus.cc:2454] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
W20260928 14:50:26.882587 9498 leader_election.cc:341] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.882841 9498 leader_election.cc:302] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.883083 9567 raft_consensus.cc:2454] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:26.883214 10152 raft_consensus.cc:2781] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.883369 10152 raft_consensus.cc:686] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:26.883692 10152 consensus_queue.cc:237] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.884382 9815 tablet_replica.cc:330] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:26.884730 9815 raft_consensus.cc:2229] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:26.885046 9815 pending_rounds.cc:62] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:26.885213 9815 pending_rounds.cc:68] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326380659445760 op_type: NO_OP noop_request { }
I20260928 14:50:26.885398 9815 raft_consensus.cc:2866] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:26.885571 9815 raft_consensus.cc:2258] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:26.886736 9360 leader_election.cc:302] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.887758 9851 tablet_bootstrap.cc:492] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:26.887881 9851 ts_tablet_manager.cc:1397] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260928 14:50:26.888432 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c9cee872de1f4ce8b803cb8e8fb018d2 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
I20260928 14:50:26.888650 9851 raft_consensus.cc:348] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.888862 9851 raft_consensus.cc:374] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.888948 9851 raft_consensus.cc:729] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.889176 9851 consensus_queue.cc:260] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:26.889751 10068 leader_election.cc:288] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:26.889912 9851 ts_tablet_manager.cc:1428] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:26.890165 9851 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:26.890854 9219 leader_election.cc:341] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9aeda483866146f89198e6f14456f0f2
W20260928 14:50:26.891144 9220 leader_election.cc:341] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 9aeda483866146f89198e6f14456f0f2
I20260928 14:50:26.891274 9220 leader_election.cc:302] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.892030 9815 ts_tablet_manager.cc:1905] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:26.892554 9851 tablet_bootstrap.cc:654] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.893848 10068 raft_consensus.cc:2726] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.897895 10215 raft_consensus.cc:2781] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.898329 10215 raft_consensus.cc:686] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:26.898782 10215 consensus_queue.cc:237] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.908548 9821 raft_consensus.cc:482] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.908710 9821 raft_consensus.cc:504] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.909395 9821 leader_election.cc:288] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.910074 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8948e45987b94ca69004c42e224ce93f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.910336 9425 raft_consensus.cc:2454] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:26.910426 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8948e45987b94ca69004c42e224ce93f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.910907 9498 leader_election.cc:302] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:26.911247 9497 leader_election.cc:341] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.911684 9821 raft_consensus.cc:2781] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:26.911856 9821 raft_consensus.cc:482] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:26.912004 9821 raft_consensus.cc:3037] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.915283 9855 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.915481 9821 raft_consensus.cc:504] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.916663 9855 ts_tablet_manager.cc:1397] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.000s
I20260928 14:50:26.917438 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8948e45987b94ca69004c42e224ce93f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:26.917438 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8948e45987b94ca69004c42e224ce93f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:26.917407 9855 raft_consensus.cc:348] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.917668 9855 raft_consensus.cc:374] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.917667 9425 raft_consensus.cc:3037] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:26.917742 9855 raft_consensus.cc:729] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:26.918148 9497 leader_election.cc:341] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.918583 9821 leader_election.cc:288] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.919142 9855 consensus_queue.cc:260] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.919767 9855 ts_tablet_manager.cc:1428] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:26.920051 9855 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.920310 9425 raft_consensus.cc:2454] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:26.921126 9498 leader_election.cc:302] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.921550 10211 raft_consensus.cc:482] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.921844 10152 raft_consensus.cc:2781] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:26.921887 10211 raft_consensus.cc:504] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:26.922044 10152 raft_consensus.cc:686] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:26.922302 10152 consensus_queue.cc:237] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:26.923514 9360 leader_election.cc:341] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:26.924268 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8193754d28d34c18bfc38ae0abd05f4c" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.925118 9360 leader_election.cc:341] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.925271 9360 leader_election.cc:302] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:26.925634 10189 raft_consensus.cc:2726] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.926724 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc4c49a4962473699103528b64a1005" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.927248 9497 leader_election.cc:341] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.927423 9497 leader_election.cc:302] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.928115 10152 raft_consensus.cc:2726] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.929888 10211 leader_election.cc:288] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.930670 9814 ts_tablet_manager.cc:1939] T 4025017d30034ea3adc6b5fd55d18617 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:26.931003 9848 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:26.931218 9848 ts_tablet_manager.cc:1397] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.286s user 0.002s sys 0.002s
I20260928 14:50:26.931561 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 202) took 3035 ms. Trace:
I20260928 14:50:26.931699 9814 rpcz_store.cc:276] 0928 14:50:23.896357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.915086 (+ 18729us) service_pool.cc:227] Handling call
0928 14:50:26.573393 (+2658307us) ts_tablet_manager.cc:1145] Deleting tablet 4025017d30034ea3adc6b5fd55d18617
0928 14:50:26.573404 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.646998 (+ 73594us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.830321 (+183323us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.931516 (+101195us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11555,"tablet-delete.queue_time_us":2658143}
I20260928 14:50:26.932258 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 198) took 3038 ms. Trace:
I20260928 14:50:26.932389 9814 rpcz_store.cc:276] 0928 14:50:23.893726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.895469 (+ 1743us) service_pool.cc:227] Handling call
0928 14:50:26.932084 (+3036615us) ts_tablet_manager.cc:1145] Deleting tablet d199c65d3b4040388360fd8302d7cb8c
0928 14:50:26.932096 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.932215 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2987326}
I20260928 14:50:26.932789 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 200) took 3038 ms. Trace:
W20260928 14:50:26.932898 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d199c65d3b4040388360fd8302d7cb8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d199c65d3b4040388360fd8302d7cb8c already in progress: creating tablet
I20260928 14:50:26.932915 9814 rpcz_store.cc:276] 0928 14:50:23.895885 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.895986 (+ 101us) service_pool.cc:227] Handling call
0928 14:50:26.932649 (+3036663us) ts_tablet_manager.cc:1145] Deleting tablet ebaf10326ec24b99ae2ab1ba8779d1a3
0928 14:50:26.932660 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.932748 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2980164}
W20260928 14:50:26.933459 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebaf10326ec24b99ae2ab1ba8779d1a3 already in progress: creating tablet
I20260928 14:50:26.933895 9848 raft_consensus.cc:348] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.934192 9848 raft_consensus.cc:374] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.934345 9848 raft_consensus.cc:729] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.934635 9848 consensus_queue.cc:260] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.935256 9815 ts_tablet_manager.cc:1918] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:26.935388 9815 log.cc:1196] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9d6dc266ab8248d381e4850179455795
I20260928 14:50:26.935894 9855 tablet_bootstrap.cc:654] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.936149 9848 ts_tablet_manager.cc:1428] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:26.936761 10054 raft_consensus.cc:482] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.937214 9848 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:26.938620 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:26.936940 10054 raft_consensus.cc:504] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.941651 9848 tablet_bootstrap.cc:654] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.942368 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.942718 10054 leader_election.cc:288] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:26.942866 9498 leader_election.cc:341] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.946614 9855 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.946754 9855 ts_tablet_manager.cc:1397] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260928 14:50:26.947383 9855 raft_consensus.cc:348] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.947535 9855 raft_consensus.cc:374] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.947623 9855 raft_consensus.cc:729] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.947809 9855 consensus_queue.cc:260] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.947867 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet c9cee872de1f4ce8b803cb8e8fb018d2 with delete_type TABLET_DATA_DELETED (replaced by tablet c556381a95fa42e284dab68a7f401e63) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.948177 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b998502f90a4df08b4078f833ad8c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:26.948352 9855 ts_tablet_manager.cc:1428] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260928 14:50:26.948666 9855 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.950351 9855 tablet_bootstrap.cc:654] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.950424 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_455b19903e324720a3d1e2d9f4dc9718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:26.951159 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_455b19903e324720a3d1e2d9f4dc9718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:26.952236 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:26.953254 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.954517 9497 leader_election.cc:341] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.954655 9497 leader_election.cc:302] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.957183 10054 raft_consensus.cc:2726] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.958444 9855 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.958590 9855 ts_tablet_manager.cc:1397] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260928 14:50:26.959259 9855 raft_consensus.cc:348] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.959470 9855 raft_consensus.cc:374] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.959543 9855 raft_consensus.cc:729] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.959807 9855 consensus_queue.cc:260] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.960409 9855 ts_tablet_manager.cc:1428] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:26.960793 9855 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:26.963508 9855 tablet_bootstrap.cc:654] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:26.972949 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f04c05cdad04261a1e2ae7e044ddbfb consensus state has no leader
I20260928 14:50:26.974522 9855 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:26.974654 9855 ts_tablet_manager.cc:1397] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20260928 14:50:26.975315 9855 raft_consensus.cc:348] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.975519 9855 raft_consensus.cc:374] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:26.975608 9855 raft_consensus.cc:729] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:26.975811 9855 consensus_queue.cc:260] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.980005 10054 raft_consensus.cc:482] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.980131 10054 raft_consensus.cc:504] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.980652 10054 leader_election.cc:288] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.981418 9855 ts_tablet_manager.cc:1428] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:26.981361 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad2124268994f04ae7153ea5aaeeab0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:26.981921 9498 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.984683 10054 raft_consensus.cc:482] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.984820 10054 raft_consensus.cc:504] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.985343 10054 leader_election.cc:288] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.985662 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a50b4fe8d86464f933baec07478db25" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:26.985898 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a50b4fe8d86464f933baec07478db25" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.986131 9498 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.986284 9855 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:26.986481 9497 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.986749 10054 raft_consensus.cc:482] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:26.986902 9497 leader_election.cc:302] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.986857 10054 raft_consensus.cc:504] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:26.985694 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad2124268994f04ae7153ea5aaeeab0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:26.987447 10054 leader_election.cc:288] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:26.987588 10054 raft_consensus.cc:2726] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.987783 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999aa56f1683464d9612a2ddbfbebbda" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:26.987962 9497 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.988094 9497 leader_election.cc:302] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.988569 10054 raft_consensus.cc:2726] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.990139 9855 tablet_bootstrap.cc:654] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:26.991422 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999aa56f1683464d9612a2ddbfbebbda" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:26.991844 9497 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:26.992681 9498 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:26.992859 9498 leader_election.cc:302] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:26.993655 10054 raft_consensus.cc:2726] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:26.996485 9813 ts_tablet_manager.cc:1918] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:26.996645 9815 ts_tablet_manager.cc:1939] T 9d6dc266ab8248d381e4850179455795 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:26.997484 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 332) took 1084 ms. Trace:
I20260928 14:50:26.997726 9815 rpcz_store.cc:276] 0928 14:50:25.912942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.912987 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:26.884273 (+971286us) ts_tablet_manager.cc:1145] Deleting tablet 9d6dc266ab8248d381e4850179455795
0928 14:50:26.884283 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.902932 (+ 18649us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.935100 (+ 32168us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.997443 (+ 62343us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":971108}
I20260928 14:50:26.998312 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9d6dc266ab8248d381e4850179455795 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:26.998914 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 333) took 1082 ms. Trace:
I20260928 14:50:26.999143 9815 rpcz_store.cc:276] 0928 14:50:25.916408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.916468 (+ 60us) service_pool.cc:227] Handling call
0928 14:50:26.998672 (+1082204us) ts_tablet_manager.cc:1145] Deleting tablet 8234670cb2604ba7b405ad7f70e03a2f
0928 14:50:26.998683 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.998814 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1082002}
W20260928 14:50:27.000037 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8234670cb2604ba7b405ad7f70e03a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8234670cb2604ba7b405ad7f70e03a2f already in progress: creating tablet
W20260928 14:50:27.000866 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 69e3c8ef3e20451dbf91b671655974e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69e3c8ef3e20451dbf91b671655974e5 already in progress: creating tablet
I20260928 14:50:27.001297 9815 tablet_replica.cc:330] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.001688 9815 raft_consensus.cc:2229] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.001909 9815 raft_consensus.cc:2258] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.002272 9855 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.002507 9855 ts_tablet_manager.cc:1397] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260928 14:50:27.002753 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 203) took 3106 ms. Trace:
I20260928 14:50:27.003036 9814 rpcz_store.cc:276] 0928 14:50:23.896438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.938822 (+ 42384us) service_pool.cc:227] Handling call
0928 14:50:27.002511 (+3063689us) ts_tablet_manager.cc:1145] Deleting tablet 8296732efcb349ab9cc87e3ff1e11fd0
0928 14:50:27.002535 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.002670 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2975425}
I20260928 14:50:27.003439 9855 raft_consensus.cc:348] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.003742 9855 raft_consensus.cc:374] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:27.003713 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8296732efcb349ab9cc87e3ff1e11fd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8296732efcb349ab9cc87e3ff1e11fd0 already in progress: creating tablet
I20260928 14:50:27.003880 9855 raft_consensus.cc:729] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.004139 9855 consensus_queue.cc:260] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.004395 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 197) took 3110 ms. Trace:
I20260928 14:50:27.004985 9814 rpcz_store.cc:276] 0928 14:50:23.893635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.962106 (+ 68471us) service_pool.cc:227] Handling call
0928 14:50:27.004113 (+3042007us) ts_tablet_manager.cc:1145] Deleting tablet dd70cf6ee2d343878c90ae4818f1eb8f
0928 14:50:27.004125 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.004258 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3037670}
W20260928 14:50:27.005455 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet dd70cf6ee2d343878c90ae4818f1eb8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd70cf6ee2d343878c90ae4818f1eb8f already in progress: creating tablet
I20260928 14:50:27.005904 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 209) took 3056 ms. Trace:
I20260928 14:50:27.006057 9814 rpcz_store.cc:276] 0928 14:50:23.949833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:23.949879 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:27.005762 (+3055883us) ts_tablet_manager.cc:1145] Deleting tablet 1738a95895914cc4936a38e1d189d538
0928 14:50:27.005773 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.005873 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3029551}
W20260928 14:50:27.006567 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1738a95895914cc4936a38e1d189d538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1738a95895914cc4936a38e1d189d538 already in progress: creating tablet
I20260928 14:50:27.006984 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 229) took 2538 ms. Trace:
I20260928 14:50:27.007320 9814 rpcz_store.cc:276] 0928 14:50:24.468347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.468823 (+ 476us) service_pool.cc:227] Handling call
0928 14:50:27.006854 (+2538031us) ts_tablet_manager.cc:1145] Deleting tablet ca7fa45e25b0455e92412b844cd78cdc
0928 14:50:27.006865 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.006944 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528980}
W20260928 14:50:27.007906 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ca7fa45e25b0455e92412b844cd78cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca7fa45e25b0455e92412b844cd78cdc already in progress: creating tablet
I20260928 14:50:27.008389 10206 raft_consensus.cc:482] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.008781 10206 raft_consensus.cc:504] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.009124 9855 ts_tablet_manager.cc:1428] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:27.010592 10206 leader_election.cc:288] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:27.014000 9219 leader_election.cc:341] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c9cee872de1f4ce8b803cb8e8fb018d2
I20260928 14:50:27.014115 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_24d1275ef415467cb0fd23d519f914f2" } modify_external_catalogs: true
I20260928 14:50:27.014451 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_24d1275ef415467cb0fd23d519f914f2" } modify_external_catalogs: true
I20260928 14:50:27.014786 9855 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.016072 9815 ts_tablet_manager.cc:1905] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.016263 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 71b5f68b570e4fff8f8748e4c762ad78
I20260928 14:50:27.017143 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_95fcbbaa43154ab58db0787656b14c17" } new_table_name: "default.Table_6c6af3e87d464c9092a434bb1e6be6f1" modify_external_catalogs: true
I20260928 14:50:27.019688 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0f58133fc26b412d9986ff78538de0b5" } modify_external_catalogs: true
I20260928 14:50:27.019996 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0f58133fc26b412d9986ff78538de0b5" } modify_external_catalogs: true
I20260928 14:50:27.020119 10054 raft_consensus.cc:482] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.020360 10054 raft_consensus.cc:504] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.021190 10054 leader_election.cc:288] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.022574 9855 tablet_bootstrap.cc:654] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.022619 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.023572 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.024750 10054 raft_consensus.cc:482] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.024806 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.024912 10054 raft_consensus.cc:504] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:27.025640 9497 leader_election.cc:341] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.026122 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "066df778654449bda96f68b5035c4d73" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.026178 9815 ts_tablet_manager.cc:1918] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:27.029022 9497 leader_election.cc:341] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.029249 10054 leader_election.cc:288] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.029438 9815 log.cc:1196] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:27.029996 9815 ts_tablet_manager.cc:1939] T 47ff819255f74f49a1ce0b5588aa03a1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.031592 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 47ff819255f74f49a1ce0b5588aa03a1 (table default.Table_973889bd0a494a95a0a088ba6e85c124 [id=16da29ef576a4730aff2c1e24942cafc]) successfully deleted
I20260928 14:50:27.032629 9855 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.032819 9855 ts_tablet_manager.cc:1397] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260928 14:50:27.033738 9855 raft_consensus.cc:348] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.034080 9855 raft_consensus.cc:374] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.034240 9855 raft_consensus.cc:729] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.034554 9855 consensus_queue.cc:260] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.039700 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7cbe9b800b63472f9c3edbe98510060c" } modify_external_catalogs: true
I20260928 14:50:27.039911 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7cbe9b800b63472f9c3edbe98510060c" } modify_external_catalogs: true
I20260928 14:50:27.040686 9855 ts_tablet_manager.cc:1428] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:27.042469 9851 tablet_bootstrap.cc:492] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.042642 9851 ts_tablet_manager.cc:1397] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.153s user 0.004s sys 0.050s
I20260928 14:50:27.043677 9851 raft_consensus.cc:348] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.043901 9851 raft_consensus.cc:374] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.043974 9851 raft_consensus.cc:729] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.044224 9851 consensus_queue.cc:260] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.044868 9851 ts_tablet_manager.cc:1428] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:27.045188 9851 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.046017 9855 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.046948 9851 tablet_bootstrap.cc:654] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.047219 9815 tablet_replica.cc:330] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.047442 9815 raft_consensus.cc:2229] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.047719 9815 raft_consensus.cc:2258] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.049809 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 consensus state has no leader
I20260928 14:50:27.049475 9815 ts_tablet_manager.cc:1905] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.050268 9855 tablet_bootstrap.cc:654] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.053642 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ccdf4724e4eb4c6aac11f06d9d673a92" } new_table_name: "default.Table_6c12e9856a1445b09905de43397569d0" modify_external_catalogs: true
I20260928 14:50:27.055877 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 230) took 2584 ms. Trace:
I20260928 14:50:27.056061 9814 rpcz_store.cc:276] 0928 14:50:24.471266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.471362 (+ 96us) service_pool.cc:227] Handling call
0928 14:50:27.008167 (+2536805us) ts_tablet_manager.cc:1145] Deleting tablet dfacaf069e3746aeb8ca11d95e65c5ea
0928 14:50:27.008177 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.055830 (+ 47653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2530191}
I20260928 14:50:27.061139 9815 ts_tablet_manager.cc:1918] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.061864 9815 log.cc:1196] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:27.062388 9815 ts_tablet_manager.cc:1939] T 4c101b1f03bb411f963f2348397c03e2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.062631 9855 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.062810 9855 ts_tablet_manager.cc:1397] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260928 14:50:27.063663 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4c101b1f03bb411f963f2348397c03e2 (table default.Table_12b926cfeead4b05a434279fb8a0df41 [id=30cfc95166db4e5fab7aac9d7721ec26]) successfully deleted
I20260928 14:50:27.063630 9855 raft_consensus.cc:348] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.063889 9855 raft_consensus.cc:374] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.063997 9855 raft_consensus.cc:729] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.064246 9815 tablet_replica.cc:330] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.064303 9855 consensus_queue.cc:260] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.064864 9855 ts_tablet_manager.cc:1428] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:27.065165 9855 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.066726 9855 tablet_bootstrap.cc:654] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.064601 9815 raft_consensus.cc:2229] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.068548 9815 raft_consensus.cc:2258] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.064378 9851 tablet_bootstrap.cc:492] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:27.066813 9220 consensus_peers.cc:487] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.068866 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 228) took 2606 ms. Trace:
W20260928 14:50:27.069031 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet dfacaf069e3746aeb8ca11d95e65c5ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfacaf069e3746aeb8ca11d95e65c5ea already in progress: creating tablet
I20260928 14:50:27.069094 9851 ts_tablet_manager.cc:1397] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.007s
I20260928 14:50:27.068984 9814 rpcz_store.cc:276] 0928 14:50:24.461922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.462373 (+ 451us) service_pool.cc:227] Handling call
0928 14:50:27.068727 (+2606354us) ts_tablet_manager.cc:1145] Deleting tablet 274ab65ebc2d41db9dc5d8a0139f9bc9
0928 14:50:27.068737 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.068828 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585532}
W20260928 14:50:27.069422 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 already in progress: creating tablet
I20260928 14:50:27.070091 9851 raft_consensus.cc:348] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.070279 9851 raft_consensus.cc:374] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.070356 9851 raft_consensus.cc:729] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.010213 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9cee872de1f4ce8b803cb8e8fb018d2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.070542 9851 consensus_queue.cc:260] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.021865 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.024430 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.025910 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "066df778654449bda96f68b5035c4d73" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.027714 9848 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:27.071358 9848 ts_tablet_manager.cc:1397] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.135s user 0.007s sys 0.022s
I20260928 14:50:27.072106 9848 raft_consensus.cc:348] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:27.072297 9498 leader_election.cc:341] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.072355 9848 raft_consensus.cc:374] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.072422 9848 raft_consensus.cc:729] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.072409 9498 leader_election.cc:302] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.072621 9848 consensus_queue.cc:260] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:27.072788 9498 leader_election.cc:341] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.072886 9498 leader_election.cc:302] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.073161 9848 ts_tablet_manager.cc:1428] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:27.073282 10152 raft_consensus.cc:482] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.073467 9848 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:27.073400 10152 raft_consensus.cc:504] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.073724 10054 raft_consensus.cc:2726] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.073899 10054 raft_consensus.cc:2726] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.074059 10152 leader_election.cc:288] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.073915 9815 ts_tablet_manager.cc:1905] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.076167 9848 tablet_bootstrap.cc:654] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.076500 10152 raft_consensus.cc:482] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.076715 9220 leader_election.cc:302] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.076890 10152 raft_consensus.cc:504] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.077111 10206 raft_consensus.cc:2726] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.077903 10152 leader_election.cc:288] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.078303 9851 ts_tablet_manager.cc:1428] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:27.078646 9851 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.079461 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0b8288fc9b47ce8c70dec324dfecf0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.080331 9497 leader_election.cc:341] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.081489 9851 tablet_bootstrap.cc:654] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.083488 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0b8288fc9b47ce8c70dec324dfecf0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.083696 9427 raft_consensus.cc:2454] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:27.084123 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311e4286b2a943ee924ac1c25dc9ca46" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.085012 9498 leader_election.cc:302] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:27.085498 9498 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.086359 9821 raft_consensus.cc:2781] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:27.086469 9821 raft_consensus.cc:482] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:27.086599 9821 raft_consensus.cc:3037] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.087771 9855 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.087956 9855 ts_tablet_manager.cc:1397] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.006s
I20260928 14:50:27.088815 9855 raft_consensus.cc:348] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.089073 9855 raft_consensus.cc:374] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.089251 9855 raft_consensus.cc:729] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.089464 9855 consensus_queue.cc:260] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.090354 9855 ts_tablet_manager.cc:1428] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:27.090672 9851 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.090842 9851 ts_tablet_manager.cc:1397] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260928 14:50:27.091542 9851 raft_consensus.cc:348] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.091763 9851 raft_consensus.cc:374] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.091818 9851 raft_consensus.cc:729] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.092002 9851 consensus_queue.cc:260] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.094089 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311e4286b2a943ee924ac1c25dc9ca46" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.094362 9848 tablet_bootstrap.cc:492] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:27.094628 9848 ts_tablet_manager.cc:1397] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.003s
W20260928 14:50:27.094609 9497 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.094786 9497 leader_election.cc:302] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.094880 9855 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.095153 10152 raft_consensus.cc:2726] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.095403 9848 raft_consensus.cc:348] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.095634 9848 raft_consensus.cc:374] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.095779 9848 raft_consensus.cc:729] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.096028 9848 consensus_queue.cc:260] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.096640 9848 ts_tablet_manager.cc:1428] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:27.096947 9848 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:27.097136 9855 tablet_bootstrap.cc:654] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.098539 9848 tablet_bootstrap.cc:654] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.099983 9851 ts_tablet_manager.cc:1428] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:27.100296 9851 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.103422 9851 tablet_bootstrap.cc:654] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.107700 9821 raft_consensus.cc:504] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.108204 9848 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:27.108359 9848 ts_tablet_manager.cc:1397] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260928 14:50:27.108820 9815 ts_tablet_manager.cc:1918] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.108880 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0b8288fc9b47ce8c70dec324dfecf0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:27.109047 9815 log.cc:1196] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:27.109089 9426 raft_consensus.cc:3037] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.109069 9848 raft_consensus.cc:348] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.109314 9848 raft_consensus.cc:374] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.109387 9848 raft_consensus.cc:729] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.109427 9815 ts_tablet_manager.cc:1939] T e0ee1e19142b402f96056c387140b5ca P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.109609 9848 consensus_queue.cc:260] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.110108 9848 ts_tablet_manager.cc:1428] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:27.110316 9815 tablet_replica.cc:330] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.110399 9848 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:27.110520 9815 raft_consensus.cc:2229] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.110759 9815 pending_rounds.cc:62] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:27.110816 9815 pending_rounds.cc:68] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326380878589952 op_type: NO_OP noop_request { }
I20260928 14:50:27.110968 9815 raft_consensus.cc:2866] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:27.111061 9815 raft_consensus.cc:2258] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.111933 9848 tablet_bootstrap.cc:654] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.112012 9426 raft_consensus.cc:2454] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:27.112828 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e0ee1e19142b402f96056c387140b5ca (table default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]) successfully deleted
I20260928 14:50:27.114157 9815 ts_tablet_manager.cc:1905] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.114368 9498 leader_election.cc:302] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:27.114643 10152 raft_consensus.cc:2781] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:27.114799 10152 raft_consensus.cc:686] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:27.115049 10152 consensus_queue.cc:237] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.122517 9285 raft_consensus.cc:3037] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.123322 9815 ts_tablet_manager.cc:1918] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:27.124967 9855 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.125720 9855 ts_tablet_manager.cc:1397] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.014s
I20260928 14:50:27.126417 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0b8288fc9b47ce8c70dec324dfecf0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:27.126442 9855 raft_consensus.cc:348] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.126731 9855 raft_consensus.cc:374] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.126812 9855 raft_consensus.cc:729] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:27.127113 9497 leader_election.cc:341] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.127362 9821 leader_election.cc:288] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.127159 9855 consensus_queue.cc:260] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.128412 10152 consensus_queue.cc:1035] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:27.129205 9855 ts_tablet_manager.cc:1428] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:27.129489 9815 log.cc:1196] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:27.129995 9815 ts_tablet_manager.cc:1939] T 89959226fd6247d4b89c54cc6ef4ede6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.131299 9855 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.133821 9855 tablet_bootstrap.cc:654] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.135838 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 89959226fd6247d4b89c54cc6ef4ede6 (table default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b [id=abe01d8e1ae6470893f4d86a00f7d529]) successfully deleted
I20260928 14:50:27.136309 9815 tablet_replica.cc:330] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.136588 9815 raft_consensus.cc:2229] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.137020 9815 raft_consensus.cc:2258] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.137707 9815 ts_tablet_manager.cc:1905] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.150200 9815 ts_tablet_manager.cc:1918] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.152662 9815 log.cc:1196] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/17d7539290064c2c9fda29a5f16d375b
I20260928 14:50:27.153230 9815 ts_tablet_manager.cc:1939] T 17d7539290064c2c9fda29a5f16d375b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.154448 9815 tablet_replica.cc:330] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.154644 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 17d7539290064c2c9fda29a5f16d375b (table default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]) successfully deleted
I20260928 14:50:27.155509 9815 raft_consensus.cc:2229] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.155988 9815 pending_rounds.cc:62] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:27.156322 9815 pending_rounds.cc:68] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326381187444736 op_type: NO_OP noop_request { }
I20260928 14:50:27.156646 9815 raft_consensus.cc:2866] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:27.156896 9815 raft_consensus.cc:2258] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.158242 9815 ts_tablet_manager.cc:1905] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.159662 10066 consensus_queue.cc:1035] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:27.160164 9855 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.160305 9855 ts_tablet_manager.cc:1397] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.008s
I20260928 14:50:27.160976 9855 raft_consensus.cc:348] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.161180 9855 raft_consensus.cc:374] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.161260 9855 raft_consensus.cc:729] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.161442 9855 consensus_queue.cc:260] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.162246 9813 log.cc:1196] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/605ccf9ad9ca4eb985374e065c48601a
I20260928 14:50:27.161976 9855 ts_tablet_manager.cc:1428] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:27.167789 10066 raft_consensus.cc:482] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.167920 10066 raft_consensus.cc:504] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.168521 10066 leader_election.cc:288] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.169131 9855 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.171191 9855 tablet_bootstrap.cc:654] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.174407 9815 ts_tablet_manager.cc:1918] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:27.175450 9815 log.cc:1196] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8218bc963a9941a49e8329d0a04d8252
I20260928 14:50:27.176411 9815 ts_tablet_manager.cc:1939] T 8218bc963a9941a49e8329d0a04d8252 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.176622 10066 raft_consensus.cc:482] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.177479 10066 raft_consensus.cc:504] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.178169 10066 leader_election.cc:288] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.179606 9815 tablet_replica.cc:330] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.179687 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8218bc963a9941a49e8329d0a04d8252 (table default.Table_52d13edfb61a4b7aa82f6a3997a78f2c [id=77614b71faa3420291481f6e7c502533]) successfully deleted
W20260928 14:50:27.180008 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 28ee844aa3c24336b4acb66dc43186e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ee844aa3c24336b4acb66dc43186e9 already in progress: creating tablet
I20260928 14:50:27.181031 9815 raft_consensus.cc:2229] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.181286 9815 pending_rounds.cc:62] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:27.181408 9815 pending_rounds.cc:68] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326382276198400 op_type: NO_OP noop_request { }
I20260928 14:50:27.181565 9815 raft_consensus.cc:2866] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:27.181702 9815 raft_consensus.cc:2258] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.181955 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095e4cbf95147d9afb83434ae1fd29f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.182586 9497 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.183970 9815 ts_tablet_manager.cc:1905] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.187856 9855 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.188020 9855 ts_tablet_manager.cc:1397] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260928 14:50:27.188815 9855 raft_consensus.cc:348] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.189126 9855 raft_consensus.cc:374] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.189311 9855 raft_consensus.cc:729] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.189682 9855 consensus_queue.cc:260] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.192811 9855 ts_tablet_manager.cc:1428] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260928 14:50:27.193861 9855 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.195520 9855 tablet_bootstrap.cc:654] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.198782 10205 raft_consensus.cc:482] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.198997 10205 raft_consensus.cc:504] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.199667 10205 leader_election.cc:288] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.200441 9815 ts_tablet_manager.cc:1918] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 14:50:27.200688 9219 leader_election.cc:341] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:27.201568 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1eb8a9faf04e3b97db9e0f8e9104f8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.202237 9497 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.204273 9815 log.cc:1196] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8948e45987b94ca69004c42e224ce93f
I20260928 14:50:27.204876 9815 ts_tablet_manager.cc:1939] T 8948e45987b94ca69004c42e224ce93f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.205783 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_21a4bfb6f8964ad5937b0106fa65cc82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.206363 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8948e45987b94ca69004c42e224ce93f (table default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]) successfully deleted
W20260928 14:50:27.206497 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21a4bfb6f8964ad5937b0106fa65cc82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.207839 9855 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.207973 9855 ts_tablet_manager.cc:1397] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260928 14:50:27.208657 9855 raft_consensus.cc:348] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.209146 9855 raft_consensus.cc:374] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.209376 9855 raft_consensus.cc:729] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.209679 9855 consensus_queue.cc:260] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.213135 9855 ts_tablet_manager.cc:1428] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 14:50:27.214432 9855 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.216267 9855 tablet_bootstrap.cc:654] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:27.217566 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9648be4c626e44e0986c196704483955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9648be4c626e44e0986c196704483955 already in progress: creating tablet
I20260928 14:50:27.217905 9815 tablet_replica.cc:330] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.218139 9815 raft_consensus.cc:2229] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.218323 9815 raft_consensus.cc:2258] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.219151 9815 ts_tablet_manager.cc:1905] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.164776 10215 raft_consensus.cc:482] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.221673 10215 raft_consensus.cc:504] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.222319 10215 leader_election.cc:288] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.170754 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095e4cbf95147d9afb83434ae1fd29f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.180689 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1eb8a9faf04e3b97db9e0f8e9104f8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.223376 9360 leader_election.cc:341] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ed0d79a39b2543049506422432990617
I20260928 14:50:27.201174 10211 raft_consensus.cc:482] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.223903 10211 raft_consensus.cc:504] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:27.224181 9498 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.224319 9498 leader_election.cc:302] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.224581 10066 raft_consensus.cc:2726] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.224589 10211 leader_election.cc:288] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.201782 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.224699 9498 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.224797 9428 raft_consensus.cc:2379] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:27.224823 9498 leader_election.cc:302] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.225133 10066 raft_consensus.cc:2726] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.225821 9813 ts_tablet_manager.cc:1939] T 605ccf9ad9ca4eb985374e065c48601a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:27.225756 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:27.225965 9567 raft_consensus.cc:2454] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:27.226223 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 290) took 2087 ms. Trace:
I20260928 14:50:27.226315 9813 rpcz_store.cc:276] 0928 14:50:25.138361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.138424 (+ 63us) service_pool.cc:227] Handling call
0928 14:50:26.741489 (+1603065us) ts_tablet_manager.cc:1145] Deleting tablet 605ccf9ad9ca4eb985374e065c48601a
0928 14:50:26.741501 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:26.992162 (+250661us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:26.996376 (+ 4214us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.226176 (+229800us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1598985}
I20260928 14:50:27.226491 9360 leader_election.cc:302] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:27.226745 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_c05d25ef4674447eb0e6ddb533492f20 [id=763f6cc484294611b96035248c14066d]) successfully deleted
I20260928 14:50:27.226889 10211 raft_consensus.cc:2781] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:27.226974 10211 raft_consensus.cc:482] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:27.227069 10211 raft_consensus.cc:3037] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.227269 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 291) took 2080 ms. Trace:
I20260928 14:50:27.227383 9813 rpcz_store.cc:276] 0928 14:50:25.146880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.147032 (+ 152us) service_pool.cc:227] Handling call
0928 14:50:27.226954 (+2079922us) ts_tablet_manager.cc:1145] Deleting tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a
0928 14:50:27.226969 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.227216 (+ 247us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2056298}
W20260928 14:50:27.227769 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a already in progress: creating tablet
I20260928 14:50:27.228138 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 292) took 2044 ms. Trace:
I20260928 14:50:27.228232 9813 rpcz_store.cc:276] 0928 14:50:25.184030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.184081 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:27.227983 (+2043902us) ts_tablet_manager.cc:1145] Deleting tablet 82b042c6ffc148939dcba9b710f198d3
0928 14:50:27.227993 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.228088 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2043694}
W20260928 14:50:27.228658 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 82b042c6ffc148939dcba9b710f198d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82b042c6ffc148939dcba9b710f198d3 already in progress: creating tablet
I20260928 14:50:27.229107 9813 tablet_replica.cc:330] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:27.229351 9813 raft_consensus.cc:2229] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.229657 9813 raft_consensus.cc:2258] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.229934 9220 leader_election.cc:302] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.230283 9813 ts_tablet_manager.cc:1905] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.230616 10205 raft_consensus.cc:3037] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.234226 9815 ts_tablet_manager.cc:1918] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.234083 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.234470 9855 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.234655 9855 ts_tablet_manager.cc:1397] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.008s
W20260928 14:50:27.234773 9360 leader_election.cc:341] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.235208 10205 raft_consensus.cc:2726] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.235368 9855 raft_consensus.cc:348] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.235747 9855 raft_consensus.cc:374] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.235633 10211 raft_consensus.cc:504] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.235858 9855 raft_consensus.cc:729] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.234470 9815 log.cc:1196] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4bd612753b914a079ccf89249b073018
I20260928 14:50:27.236464 9815 ts_tablet_manager.cc:1939] T 4bd612753b914a079ccf89249b073018 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.236780 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:27.236996 9567 raft_consensus.cc:3037] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.237571 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4bd612753b914a079ccf89249b073018 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]) successfully deleted
W20260928 14:50:27.238256 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b already in progress: creating tablet
W20260928 14:50:27.238868 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f28a74dc0afe4f20b47139a703550ef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f28a74dc0afe4f20b47139a703550ef6 already in progress: creating tablet
W20260928 14:50:27.239462 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e89035a3d41a4af78a8e7afbdb89c7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89035a3d41a4af78a8e7afbdb89c7e0 already in progress: creating tablet
I20260928 14:50:27.239782 9815 tablet_replica.cc:330] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.239739 9567 raft_consensus.cc:2454] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:27.240136 9815 raft_consensus.cc:2229] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.240334 9815 raft_consensus.cc:2258] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.240336 9360 leader_election.cc:302] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:27.240754 10211 leader_election.cc:288] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.241068 9815 ts_tablet_manager.cc:1905] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.241230 10211 raft_consensus.cc:2781] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:27.241744 10211 raft_consensus.cc:686] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:27.241703 9855 consensus_queue.cc:260] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.242101 10211 consensus_queue.cc:237] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.242280 9855 ts_tablet_manager.cc:1428] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 14:50:27.243196 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:27.243685 9360 leader_election.cc:341] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.244102 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0d79a39b2543049506422432990617" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.244658 9360 leader_election.cc:341] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.244695 10066 raft_consensus.cc:482] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.244771 9360 leader_election.cc:302] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:27.244819 10066 raft_consensus.cc:504] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.245380 10066 leader_election.cc:288] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.245674 9855 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.245862 10215 raft_consensus.cc:2726] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.246681 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d004e52539cc49bc8a26f77e0bb182cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.247177 9498 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.235484 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 231) took 2752 ms. Trace:
I20260928 14:50:27.247980 9814 rpcz_store.cc:276] 0928 14:50:24.482615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.482701 (+ 86us) service_pool.cc:227] Handling call
0928 14:50:27.235189 (+2752488us) ts_tablet_manager.cc:1145] Deleting tablet 8b914e3c8243490d92378a8765d6390f
0928 14:50:27.235206 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.235447 (+ 241us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2744568}
W20260928 14:50:27.248917 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8b914e3c8243490d92378a8765d6390f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b914e3c8243490d92378a8765d6390f already in progress: creating tablet
I20260928 14:50:27.249502 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 234) took 2748 ms. Trace:
I20260928 14:50:27.250802 9814 rpcz_store.cc:276] 0928 14:50:24.501540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.502095 (+ 555us) service_pool.cc:227] Handling call
0928 14:50:27.249329 (+2747234us) ts_tablet_manager.cc:1145] Deleting tablet 57e56077833e41dbacf54c1757ba6a38
0928 14:50:27.249339 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.249456 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2705304}
I20260928 14:50:27.251005 9855 tablet_bootstrap.cc:654] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:27.251684 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 57e56077833e41dbacf54c1757ba6a38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e56077833e41dbacf54c1757ba6a38 already in progress: creating tablet
I20260928 14:50:27.252218 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 243) took 2669 ms. Trace:
I20260928 14:50:27.252970 9814 rpcz_store.cc:276] 0928 14:50:24.583100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.649401 (+ 66301us) service_pool.cc:227] Handling call
0928 14:50:27.252083 (+2602682us) ts_tablet_manager.cc:1145] Deleting tablet afe58ef9809540cb942e3ec44296e36f
0928 14:50:27.252093 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.252188 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2572202}
W20260928 14:50:27.253831 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet afe58ef9809540cb942e3ec44296e36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afe58ef9809540cb942e3ec44296e36f already in progress: creating tablet
I20260928 14:50:27.254418 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 244) took 2659 ms. Trace:
I20260928 14:50:27.254653 10066 raft_consensus.cc:482] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.254948 10066 raft_consensus.cc:504] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.255124 9814 rpcz_store.cc:276] 0928 14:50:24.594640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.678903 (+ 84263us) service_pool.cc:227] Handling call
0928 14:50:27.254290 (+2575387us) ts_tablet_manager.cc:1145] Deleting tablet 852b70b1f7444ad2ab92d66d580a0db7
0928 14:50:27.254300 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.254386 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2564576}
W20260928 14:50:27.255527 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 852b70b1f7444ad2ab92d66d580a0db7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852b70b1f7444ad2ab92d66d580a0db7 already in progress: creating tablet
I20260928 14:50:27.255720 10066 leader_election.cc:288] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.256649 9815 ts_tablet_manager.cc:1918] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.256822 9815 log.cc:1196] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:27.256794 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03245f72e0aa496d895968d8e5715b56" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.257282 9815 ts_tablet_manager.cc:1939] T f3dee7ff6d5544908cdd9dbd45ce521a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:27.257443 9498 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.257546 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03245f72e0aa496d895968d8e5715b56" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.258175 9497 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.258291 9497 leader_election.cc:302] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.258682 10066 raft_consensus.cc:2726] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.258780 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f3dee7ff6d5544908cdd9dbd45ce521a (table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]) successfully deleted
I20260928 14:50:27.259138 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 245) took 2658 ms. Trace:
W20260928 14:50:27.260133 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 71b5f68b570e4fff8f8748e4c762ad78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b5f68b570e4fff8f8748e4c762ad78 already in progress: creating tablet
I20260928 14:50:27.260070 9814 rpcz_store.cc:276] 0928 14:50:24.600246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.679902 (+ 79656us) service_pool.cc:227] Handling call
0928 14:50:27.259010 (+2579108us) ts_tablet_manager.cc:1145] Deleting tablet 11714d0ca321429c95de223320794a0e
0928 14:50:27.259020 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.259105 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2557916}
W20260928 14:50:27.260411 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 11714d0ca321429c95de223320794a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11714d0ca321429c95de223320794a0e already in progress: creating tablet
I20260928 14:50:27.261646 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 246) took 2638 ms. Trace:
I20260928 14:50:27.262975 9814 rpcz_store.cc:276] 0928 14:50:24.622914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.689745 (+ 66831us) service_pool.cc:227] Handling call
0928 14:50:27.261493 (+2571748us) ts_tablet_manager.cc:1145] Deleting tablet c85735981779438197f2c0f489681b96
0928 14:50:27.261502 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.261615 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2558815}
I20260928 14:50:27.263082 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1bb9988e056b464d896de7d07c7dcb6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.263861 9855 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:27.263844 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bb9988e056b464d896de7d07c7dcb6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.264000 9855 ts_tablet_manager.cc:1397] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
W20260928 14:50:27.264258 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c85735981779438197f2c0f489681b96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c85735981779438197f2c0f489681b96 already in progress: creating tablet
I20260928 14:50:27.264483 9814 tablet_replica.cc:330] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:27.264711 9855 raft_consensus.cc:348] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.264928 9855 raft_consensus.cc:374] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.265018 9855 raft_consensus.cc:729] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.265254 9855 consensus_queue.cc:260] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.250553 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d004e52539cc49bc8a26f77e0bb182cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.265938 9855 ts_tablet_manager.cc:1428] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260928 14:50:27.265964 9497 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.266077 9497 leader_election.cc:302] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.266413 10066 raft_consensus.cc:2726] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.266474 9855 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.267354 9814 raft_consensus.cc:2229] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.268512 9814 raft_consensus.cc:2258] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.268748 9855 tablet_bootstrap.cc:654] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.270006 9814 ts_tablet_manager.cc:1905] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.275194 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b9f843006a1e43a49f177433c7a3e1ea
I20260928 14:50:27.276399 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.276865 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:27.277535 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b9f843006a1e43a49f177433c7a3e1ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9f843006a1e43a49f177433c7a3e1ea already in progress: creating tablet
I20260928 14:50:27.277817 9855 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.277958 9855 ts_tablet_manager.cc:1397] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260928 14:50:27.278566 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.278574 9855 raft_consensus.cc:348] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.278779 9855 raft_consensus.cc:374] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.278846 9855 raft_consensus.cc:729] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.279059 9855 consensus_queue.cc:260] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.279567 9855 ts_tablet_manager.cc:1428] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:27.280112 9855 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.282261 9855 tablet_bootstrap.cc:654] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.289126 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad76e04bff34480284586d17fd78ba4e" } modify_external_catalogs: true
I20260928 14:50:27.289345 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad76e04bff34480284586d17fd78ba4e" } modify_external_catalogs: true
W20260928 14:50:27.293725 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42f7fb96f92a4e35b8561832e1d812d8 consensus state has no leader
I20260928 14:50:27.298198 9855 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.298329 9855 ts_tablet_manager.cc:1397] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
I20260928 14:50:27.299165 9855 raft_consensus.cc:348] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.299357 9855 raft_consensus.cc:374] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.299495 9855 raft_consensus.cc:729] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.299719 9855 consensus_queue.cc:260] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.300439 9855 ts_tablet_manager.cc:1428] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:27.300729 9855 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.302310 9814 ts_tablet_manager.cc:1918] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.302398 9855 tablet_bootstrap.cc:654] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.303714 9814 log.cc:1196] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/29e865f14ddc4b0c8ce0877cd99f5972
I20260928 14:50:27.304098 9814 ts_tablet_manager.cc:1939] T 29e865f14ddc4b0c8ce0877cd99f5972 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:27.304876 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 254) took 2595 ms. Trace:
I20260928 14:50:27.304992 9814 rpcz_store.cc:276] 0928 14:50:24.709659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.746236 (+ 36577us) service_pool.cc:227] Handling call
0928 14:50:27.264409 (+2518173us) ts_tablet_manager.cc:1145] Deleting tablet 29e865f14ddc4b0c8ce0877cd99f5972
0928 14:50:27.264419 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.287904 (+ 23485us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.302202 (+ 14298us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.304824 (+ 2622us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2474730}
I20260928 14:50:27.305446 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 256) took 2595 ms. Trace:
I20260928 14:50:27.305474 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 29e865f14ddc4b0c8ce0877cd99f5972 (table default.Table_d47d9dc144824b13a05a1a8ed9fc5382 [id=4431be8698914255814800147776a1bd]) successfully deleted
I20260928 14:50:27.309412 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cea2234b82444fc3ae83f35a7812668b" } new_table_name: "default.Table_af4830aab30c4fccb57822e100e21564" modify_external_catalogs: true
W20260928 14:50:27.314850 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0868e5ce22874134a2f50e2404970bb8 consensus state has no leader
I20260928 14:50:27.305562 9814 rpcz_store.cc:276] 0928 14:50:24.709849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.789719 (+ 79870us) service_pool.cc:227] Handling call
0928 14:50:27.305281 (+2515562us) ts_tablet_manager.cc:1145] Deleting tablet 0489aea8bb0a45daaaec6a48db756c51
0928 14:50:27.305291 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.305397 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515241}
I20260928 14:50:27.316179 9814 tablet_replica.cc:330] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:27.316278 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
I20260928 14:50:27.317209 9814 raft_consensus.cc:2229] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.317414 9814 pending_rounds.cc:62] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:27.317471 9814 pending_rounds.cc:68] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7334326375203446784 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "8c8624f9349a4608a48943487f01c7c8" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_1d54df7671a0472193f255cb56c15768" dest_uuid: "ae832871bd1142f7af10c084115ffc12" new_extra_config { } }
I20260928 14:50:27.317972 9821 raft_consensus.cc:482] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.318174 9821 raft_consensus.cc:504] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.318804 9821 leader_election.cc:288] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.320551 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65fd0746d1b474e9fbebe6f09053743" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.320638 9814 raft_consensus.cc:2258] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.321147 9498 leader_election.cc:341] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.320245 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65fd0746d1b474e9fbebe6f09053743" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.322045 9497 leader_election.cc:341] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.322170 9497 leader_election.cc:302] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.322585 9821 raft_consensus.cc:2726] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.322991 9814 ts_tablet_manager.cc:1905] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.326704 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b9f843006a1e43a49f177433c7a3e1ea (table default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b9f843006a1e43a49f177433c7a3e1ea consensus state has no leader
I20260928 14:50:27.328464 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3cda8f50c2ba4f1f82d4a182c7e76119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.329051 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cda8f50c2ba4f1f82d4a182c7e76119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.330525 9821 raft_consensus.cc:482] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.330678 9821 raft_consensus.cc:504] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.331212 9821 leader_election.cc:288] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.336124 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 24b256211679481eb0e0309c56ff60c6 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:27.336416 9814 ts_tablet_manager.cc:1918] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:27.336530 9814 log.cc:1196] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8c8624f9349a4608a48943487f01c7c8
I20260928 14:50:27.338966 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.339561 9497 leader_election.cc:341] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.340415 9821 raft_consensus.cc:482] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.340631 9821 raft_consensus.cc:504] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.341617 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05131db52e94d7c9f4856b0455246d2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.342202 9498 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.342855 9821 leader_election.cc:288] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.343204 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05131db52e94d7c9f4856b0455246d2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.343750 9497 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.343910 9497 leader_election.cc:302] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.344359 9821 raft_consensus.cc:2726] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.345798 9814 ts_tablet_manager.cc:1939] T 8c8624f9349a4608a48943487f01c7c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:27.346179 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.346736 9498 leader_election.cc:341] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.346884 9498 leader_election.cc:302] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.347309 9821 raft_consensus.cc:2726] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.347384 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 255) took 2637 ms. Trace:
I20260928 14:50:27.349303 9814 rpcz_store.cc:276] 0928 14:50:24.709770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.749396 (+ 39626us) service_pool.cc:227] Handling call
0928 14:50:27.316095 (+2566699us) ts_tablet_manager.cc:1145] Deleting tablet 8c8624f9349a4608a48943487f01c7c8
0928 14:50:27.316106 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.333636 (+ 17530us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.336304 (+ 2668us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.347352 (+ 11048us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490090}
I20260928 14:50:27.350282 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8c8624f9349a4608a48943487f01c7c8 (table default.Table_1d54df7671a0472193f255cb56c15768 [id=b8333e21752c4aabb04a7caeeb0515a3]) successfully deleted
I20260928 14:50:27.350761 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 253) took 2648 ms. Trace:
I20260928 14:50:27.351558 9814 rpcz_store.cc:276] 0928 14:50:24.702338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.743798 (+ 41460us) service_pool.cc:227] Handling call
0928 14:50:27.350632 (+2606834us) ts_tablet_manager.cc:1145] Deleting tablet 0489aea8bb0a45daaaec6a48db756c51
0928 14:50:27.350642 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.350730 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2517170}
I20260928 14:50:27.352368 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 24b256211679481eb0e0309c56ff60c6 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:27.352555 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0489aea8bb0a45daaaec6a48db756c51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0489aea8bb0a45daaaec6a48db756c51 already in progress: creating tablet
I20260928 14:50:27.353245 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 260) took 2642 ms. Trace:
I20260928 14:50:27.353916 9814 rpcz_store.cc:276] 0928 14:50:24.710276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.848179 (+137903us) service_pool.cc:227] Handling call
0928 14:50:27.353102 (+2504923us) ts_tablet_manager.cc:1145] Deleting tablet ba281355b2f44b77a4ff99d49c084162
0928 14:50:27.353113 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.353212 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2504643}
W20260928 14:50:27.354811 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ba281355b2f44b77a4ff99d49c084162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba281355b2f44b77a4ff99d49c084162 already in progress: creating tablet
I20260928 14:50:27.355296 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 261) took 2644 ms. Trace:
I20260928 14:50:27.355970 9814 rpcz_store.cc:276] 0928 14:50:24.710380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.848493 (+138113us) service_pool.cc:227] Handling call
0928 14:50:27.355167 (+2506674us) ts_tablet_manager.cc:1145] Deleting tablet ee1eb8a9faf04e3b97db9e0f8e9104f8
0928 14:50:27.355177 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.355266 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506372}
W20260928 14:50:27.361800 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 already in progress: creating tablet
I20260928 14:50:27.362257 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 264) took 2569 ms. Trace:
I20260928 14:50:27.362409 9814 rpcz_store.cc:276] 0928 14:50:24.793269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.886338 (+ 93069us) service_pool.cc:227] Handling call
0928 14:50:27.362098 (+2475760us) ts_tablet_manager.cc:1145] Deleting tablet ca5c040fa6ba4e2785959874a3346bf7
0928 14:50:27.362108 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.362227 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475494}
W20260928 14:50:27.362875 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ca5c040fa6ba4e2785959874a3346bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca5c040fa6ba4e2785959874a3346bf7 already in progress: creating tablet
I20260928 14:50:27.363312 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 269) took 2554 ms. Trace:
I20260928 14:50:27.363476 9814 rpcz_store.cc:276] 0928 14:50:24.814398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.906785 (+ 92387us) service_pool.cc:227] Handling call
0928 14:50:27.363178 (+2456393us) ts_tablet_manager.cc:1145] Deleting tablet cbd9f9cb48a945d19420a8bdb9bb9576
0928 14:50:27.363189 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.363278 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2456084}
I20260928 14:50:27.363813 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:27.363968 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 270) took 2521 ms. Trace:
I20260928 14:50:27.364116 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]). Expected version 2 got 0
I20260928 14:50:27.364080 9814 rpcz_store.cc:276] 0928 14:50:24.842461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:24.907045 (+ 64584us) service_pool.cc:227] Handling call
0928 14:50:27.363854 (+2456809us) ts_tablet_manager.cc:1145] Deleting tablet 6891077c78ef4f3d84e33283096ddf7a
0928 14:50:27.363863 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.363939 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2456610}
I20260928 14:50:27.364306 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_550f202c199b47f098184b3921013074 [id=24b463abfd834c8b9c6f579d967741b2]). Expected version 1 got 0
I20260928 14:50:27.364497 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 273) took 2362 ms. Trace:
I20260928 14:50:27.364600 9814 rpcz_store.cc:276] 0928 14:50:25.002434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.002477 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:27.364383 (+2361906us) ts_tablet_manager.cc:1145] Deleting tablet 5fc978ea3a194282aacc6ede22076c21
0928 14:50:27.364393 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.364468 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2361599}
I20260928 14:50:27.365068 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 271) took 2363 ms. Trace:
I20260928 14:50:27.365175 9814 rpcz_store.cc:276] 0928 14:50:25.001783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.002828 (+ 1045us) service_pool.cc:227] Handling call
0928 14:50:27.364924 (+2362096us) ts_tablet_manager.cc:1145] Deleting tablet fd24e60a0e944f6086ff9c9fbe2e8180
0928 14:50:27.364934 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.365036 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2361843}
I20260928 14:50:27.365221 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 1738a95895914cc4936a38e1d189d538 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:27.365851 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]). Expected version 2 got 0
I20260928 14:50:27.366264 9851 tablet_bootstrap.cc:492] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.366397 9851 ts_tablet_manager.cc:1397] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.266s user 0.038s sys 0.040s
I20260928 14:50:27.366542 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 595dccb9d03b4dd48698262aad630ac2 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:27.366811 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cbd9f9cb48a945d19420a8bdb9bb9576 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbd9f9cb48a945d19420a8bdb9bb9576 already in progress: creating tablet
W20260928 14:50:27.367146 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6891077c78ef4f3d84e33283096ddf7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6891077c78ef4f3d84e33283096ddf7a already in progress: creating tablet
I20260928 14:50:27.367149 9851 raft_consensus.cc:348] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.367360 9851 raft_consensus.cc:374] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:27.367388 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5fc978ea3a194282aacc6ede22076c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc978ea3a194282aacc6ede22076c21 already in progress: creating tablet
I20260928 14:50:27.367453 9851 raft_consensus.cc:729] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:27.367624 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fd24e60a0e944f6086ff9c9fbe2e8180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd24e60a0e944f6086ff9c9fbe2e8180 already in progress: creating tablet
I20260928 14:50:27.367657 9851 consensus_queue.cc:260] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.368964 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 42b9f78ecb674ae691d407615680ca56 (DEFAULT_TABLE table=default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.369201 9851 ts_tablet_manager.cc:1428] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:27.369441 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b9f78ecb674ae691d407615680ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.369503 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 275) took 2223 ms. Trace:
I20260928 14:50:27.370924 9851 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.371137 9814 rpcz_store.cc:276] 0928 14:50:25.146381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.146457 (+ 76us) service_pool.cc:227] Handling call
0928 14:50:27.369369 (+2222912us) ts_tablet_manager.cc:1145] Deleting tablet 01c1e945f1c54281856bfabe08fba42e
0928 14:50:27.369376 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.369458 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2111715}
I20260928 14:50:27.372442 9814 tablet_replica.cc:330] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:27.372879 9814 raft_consensus.cc:2229] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.373569 9814 raft_consensus.cc:2258] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.373831 9258 tablet_service.cc:1467] Processing CreateTablet for tablet edf76b53ded84392a39c73d7e653615d (DEFAULT_TABLE table=default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.374073 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e7e11092d1475cba53e51a0f61d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.375787 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.376109 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 42b9f78ecb674ae691d407615680ca56 (DEFAULT_TABLE table=default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.376250 9815 tablet_replica.cc:330] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.376526 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b9f78ecb674ae691d407615680ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.376119 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0d79a39b2543049506422432990617 with delete_type TABLET_DATA_DELETED (replaced by tablet f28a74dc0afe4f20b47139a703550ef6) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.377714 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 42b9f78ecb674ae691d407615680ca56 (DEFAULT_TABLE table=default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.378196 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b9f78ecb674ae691d407615680ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.381810 9532 tablet_service.cc:1467] Processing CreateTablet for tablet edf76b53ded84392a39c73d7e653615d (DEFAULT_TABLE table=default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.382158 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf76b53ded84392a39c73d7e653615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.382325 9394 tablet_service.cc:1467] Processing CreateTablet for tablet edf76b53ded84392a39c73d7e653615d (DEFAULT_TABLE table=default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.382668 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf76b53ded84392a39c73d7e653615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.385658 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.385872 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.386133 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.386343 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.386538 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.376531 9815 raft_consensus.cc:2229] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.387099 9815 raft_consensus.cc:2258] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.387619 9815 ts_tablet_manager.cc:1905] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.392961 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 01c1e945f1c54281856bfabe08fba42e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01c1e945f1c54281856bfabe08fba42e already in progress: creating tablet
I20260928 14:50:27.393656 9815 ts_tablet_manager.cc:1918] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.393818 9815 log.cc:1196] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/03245f72e0aa496d895968d8e5715b56
I20260928 14:50:27.394184 9815 ts_tablet_manager.cc:1939] T 03245f72e0aa496d895968d8e5715b56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.394378 9814 ts_tablet_manager.cc:1905] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.395207 9815 tablet_replica.cc:330] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.395248 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 03245f72e0aa496d895968d8e5715b56 (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:27.395440 9815 raft_consensus.cc:2229] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.395607 9815 raft_consensus.cc:2258] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.395780 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ed0d79a39b2543049506422432990617 because the tablet was not found. No further retry: Not found: Tablet not found: ed0d79a39b2543049506422432990617
I20260928 14:50:27.396118 9815 ts_tablet_manager.cc:1905] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.400203 9814 ts_tablet_manager.cc:1918] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:27.400635 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf76b53ded84392a39c73d7e653615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.402554 9851 tablet_bootstrap.cc:654] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.410027 9815 ts_tablet_manager.cc:1918] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.410374 9814 log.cc:1196] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/605ccf9ad9ca4eb985374e065c48601a
I20260928 14:50:27.410686 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_2101de57a5b547ada12b8fc77a1452c7 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 2 got 0
I20260928 14:50:27.410931 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 4 got 0
I20260928 14:50:27.411501 9814 ts_tablet_manager.cc:1939] T 605ccf9ad9ca4eb985374e065c48601a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:27.411350 8948 catalog_manager.cc:5495] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:27.411914 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]). Expected version 2 got 0
I20260928 14:50:27.412480 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:27.412624 9815 log.cc:1196] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6a50b4fe8d86464f933baec07478db25
I20260928 14:50:27.412737 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]). Expected version 1 got 0
I20260928 14:50:27.412989 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:27.413143 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d004e52539cc49bc8a26f77e0bb182cc (table default.Table_c3faaac521464670a4b981a20d62e237 [id=d3062c0f64294b23abad7e06715e1fd9]). Expected version 1 got 0
I20260928 14:50:27.413324 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 282) took 2153 ms. Trace:
I20260928 14:50:27.413502 9815 ts_tablet_manager.cc:1939] T 6a50b4fe8d86464f933baec07478db25 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.413882 9814 rpcz_store.cc:276] 0928 14:50:25.259805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.259896 (+ 91us) service_pool.cc:227] Handling call
0928 14:50:27.372377 (+2112481us) ts_tablet_manager.cc:1145] Deleting tablet 605ccf9ad9ca4eb985374e065c48601a
0928 14:50:27.372386 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.397390 (+ 25004us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.400117 (+ 2727us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.413271 (+ 13154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2108529}
I20260928 14:50:27.414837 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 281) took 2179 ms. Trace:
I20260928 14:50:27.415110 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 605ccf9ad9ca4eb985374e065c48601a (table default.Table_c05d25ef4674447eb0e6ddb533492f20 [id=763f6cc484294611b96035248c14066d]) successfully deleted
I20260928 14:50:27.415313 9814 rpcz_store.cc:276] 0928 14:50:25.235547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.257687 (+ 22140us) service_pool.cc:227] Handling call
0928 14:50:27.414681 (+2156994us) ts_tablet_manager.cc:1145] Deleting tablet 46fe647c6d80431bbb76899126d01c3b
0928 14:50:27.414691 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.414787 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2150626}
I20260928 14:50:27.415724 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6a50b4fe8d86464f933baec07478db25 (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
I20260928 14:50:27.416132 9815 tablet_replica.cc:330] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.416138 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 283) took 2153 ms. Trace:
W20260928 14:50:27.416162 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 46fe647c6d80431bbb76899126d01c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46fe647c6d80431bbb76899126d01c3b already in progress: creating tablet
W20260928 14:50:27.416421 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9d6dc266ab8248d381e4850179455795 because the tablet was not found. No further retry: Not found: Tablet not found: 9d6dc266ab8248d381e4850179455795
I20260928 14:50:27.416586 9815 raft_consensus.cc:2229] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.416756 9814 rpcz_store.cc:276] 0928 14:50:25.262782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.263554 (+ 772us) service_pool.cc:227] Handling call
0928 14:50:27.415921 (+2152367us) ts_tablet_manager.cc:1145] Deleting tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a
0928 14:50:27.415931 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.416055 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137575}
I20260928 14:50:27.416826 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_82216fdff1d445ae8f1c198844a9f2a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.417053 9815 raft_consensus.cc:2258] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.417490 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82216fdff1d445ae8f1c198844a9f2a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.417584 9815 ts_tablet_manager.cc:1905] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.417876 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a already in progress: creating tablet
I20260928 14:50:27.418475 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 284) took 2151 ms. Trace:
I20260928 14:50:27.413425 8948 catalog_manager.cc:5495] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:27.419175 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_550f202c199b47f098184b3921013074 [id=24b463abfd834c8b9c6f579d967741b2]). Expected version 1 got 0
I20260928 14:50:27.419322 9814 rpcz_store.cc:276] 0928 14:50:25.266547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.266601 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:27.418299 (+2151698us) ts_tablet_manager.cc:1145] Deleting tablet 82b042c6ffc148939dcba9b710f198d3
0928 14:50:27.418308 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.418407 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2118576}
W20260928 14:50:27.419716 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 82b042c6ffc148939dcba9b710f198d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82b042c6ffc148939dcba9b710f198d3 already in progress: creating tablet
I20260928 14:50:27.420565 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 286) took 1998 ms. Trace:
W20260928 14:50:27.420769 8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.60:39777, user_credentials={real_user=slave}} blocked reactor thread for 114259us
I20260928 14:50:27.421278 9814 rpcz_store.cc:276] 0928 14:50:25.421916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.423587 (+ 1671us) service_pool.cc:227] Handling call
0928 14:50:27.420425 (+1996838us) ts_tablet_manager.cc:1145] Deleting tablet 767958659f4f450497eb5f2a3902993e
0928 14:50:27.420435 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.420513 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1996629}
W20260928 14:50:27.421686 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 767958659f4f450497eb5f2a3902993e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 767958659f4f450497eb5f2a3902993e already in progress: creating tablet
I20260928 14:50:27.422510 9814 tablet_replica.cc:330] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:27.423175 9814 raft_consensus.cc:2229] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.423892 9814 pending_rounds.cc:62] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:27.424193 9815 ts_tablet_manager.cc:1918] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.424343 9814 pending_rounds.cc:68] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326370274013184 op_type: NO_OP noop_request { }
I20260928 14:50:27.425165 9814 raft_consensus.cc:2866] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:27.425632 9814 raft_consensus.cc:2258] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.426498 9814 ts_tablet_manager.cc:1905] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.430632 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78379bd4cfce46fa812374f046d9d329 consensus state has no leader
I20260928 14:50:27.430703 9815 log.cc:1196] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7b47d891c9264a03ac11f50f2b56edad
I20260928 14:50:27.431063 9815 ts_tablet_manager.cc:1939] T 7b47d891c9264a03ac11f50f2b56edad P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.431253 9851 tablet_bootstrap.cc:492] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.431397 9851 ts_tablet_manager.cc:1397] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.003s
I20260928 14:50:27.431910 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7b47d891c9264a03ac11f50f2b56edad (table default.Table_59d6edf8a9424fd99021d923d4bf98fd [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
I20260928 14:50:27.432188 9851 raft_consensus.cc:348] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.432416 9851 raft_consensus.cc:374] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.432504 9851 raft_consensus.cc:729] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.434015 9815 tablet_replica.cc:330] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.434326 9815 raft_consensus.cc:2229] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.434719 9815 raft_consensus.cc:2258] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.435386 9815 ts_tablet_manager.cc:1905] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.441713 9851 consensus_queue.cc:260] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.444631 9851 ts_tablet_manager.cc:1428] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260928 14:50:27.445617 10054 raft_consensus.cc:482] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.445766 10054 raft_consensus.cc:504] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.446460 10054 leader_election.cc:288] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.447163 9821 raft_consensus.cc:482] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.447315 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2dd699271542bd9b9604e746686c53" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.447327 9821 raft_consensus.cc:504] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:27.447834 9497 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.448084 9815 ts_tablet_manager.cc:1918] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.448457 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6891077c78ef4f3d84e33283096ddf7a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.448876 9815 log.cc:1196] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/dd70cf6ee2d343878c90ae4818f1eb8f
W20260928 14:50:27.449098 9497 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.447851 9821 leader_election.cc:288] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.449398 9815 ts_tablet_manager.cc:1939] T dd70cf6ee2d343878c90ae4818f1eb8f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.450296 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet dd70cf6ee2d343878c90ae4818f1eb8f (table default.Table_0628bbb0b50640ff9da42eef50691d9d [id=0c7c9f38c5984b3597ba7b03c38113a4]) successfully deleted
I20260928 14:50:27.451112 9851 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.451193 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 24b256211679481eb0e0309c56ff60c6
I20260928 14:50:27.451745 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.451841 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.452427 9815 tablet_replica.cc:330] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.452862 9815 raft_consensus.cc:2229] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.453284 9815 raft_consensus.cc:2258] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.453794 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6891077c78ef4f3d84e33283096ddf7a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.453958 9815 ts_tablet_manager.cc:1905] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.454510 9498 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.454648 9498 leader_election.cc:302] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.455132 9821 raft_consensus.cc:2726] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.455814 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.457406 9848 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:27.457824 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b7fa9e4709af4148bbcb12a7a50eab39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.458355 9848 ts_tablet_manager.cc:1397] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.348s user 0.027s sys 0.069s
W20260928 14:50:27.458390 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7fa9e4709af4148bbcb12a7a50eab39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.459218 9848 raft_consensus.cc:348] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.459414 9848 raft_consensus.cc:374] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.459498 9848 raft_consensus.cc:729] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.459613 10205 raft_consensus.cc:482] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.459745 10205 raft_consensus.cc:504] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.460357 10205 leader_election.cc:288] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.460813 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a30439ac5a8485a9b6ebbe1371087b1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.461074 9428 raft_consensus.cc:2454] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:27.461093 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2dd699271542bd9b9604e746686c53" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.461598 9219 leader_election.cc:341] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:27.461748 9219 leader_election.cc:302] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:27.462158 9851 tablet_bootstrap.cc:654] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.462603 10205 raft_consensus.cc:2781] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:27.462750 10205 raft_consensus.cc:482] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:27.463201 9498 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.463356 9498 leader_election.cc:302] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.463337 9848 consensus_queue.cc:260] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.463819 9821 raft_consensus.cc:2726] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.464860 9815 ts_tablet_manager.cc:1918] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.467255 9815 log.cc:1196] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9d5166a828e84d46af3112cdc7bb0a2a
I20260928 14:50:27.467809 9815 ts_tablet_manager.cc:1939] T 9d5166a828e84d46af3112cdc7bb0a2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.468669 9848 ts_tablet_manager.cc:1428] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 14:50:27.469254 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 73bbcf31960d478087a0a91337c34ec8
I20260928 14:50:27.469314 9848 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:27.470402 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9d5166a828e84d46af3112cdc7bb0a2a (table default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]) successfully deleted
W20260928 14:50:27.470672 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 24b256211679481eb0e0309c56ff60c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24b256211679481eb0e0309c56ff60c6 already in progress: creating tablet
I20260928 14:50:27.471400 9848 tablet_bootstrap.cc:654] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.471716 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:27.472247 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 73bbcf31960d478087a0a91337c34ec8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73bbcf31960d478087a0a91337c34ec8 already in progress: creating tablet
I20260928 14:50:27.474388 10205 raft_consensus.cc:3037] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.475399 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.477285 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_59d6edf8a9424fd99021d923d4bf98fd" } new_table_name: "default.Table_a4b0b314447f41eb8a531ae408712220" modify_external_catalogs: true
I20260928 14:50:27.478859 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.481304 10205 raft_consensus.cc:504] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:27.482647 9219 leader_election.cc:341] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:27.482806 10205 leader_election.cc:288] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.482862 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a30439ac5a8485a9b6ebbe1371087b1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:27.483106 10068 raft_consensus.cc:482] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.483152 9426 raft_consensus.cc:3037] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.483253 10068 raft_consensus.cc:504] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.483778 10068 leader_election.cc:288] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:27.484549 9220 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: def872f66b2541b9af6084e93d991ec2
I20260928 14:50:27.488327 9426 raft_consensus.cc:2454] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:27.488510 9219 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: def872f66b2541b9af6084e93d991ec2
I20260928 14:50:27.488648 9219 leader_election.cc:302] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.488899 9220 leader_election.cc:302] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:27.489045 10205 raft_consensus.cc:2726] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.489367 10205 raft_consensus.cc:2781] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:27.489544 10205 raft_consensus.cc:686] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:27.489794 10205 consensus_queue.cc:237] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.490976 9814 ts_tablet_manager.cc:1918] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:27.493671 9814 log.cc:1196] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/964985f048114f53ba1e685c7f1dbd6d
I20260928 14:50:27.494256 9814 ts_tablet_manager.cc:1939] T 964985f048114f53ba1e685c7f1dbd6d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:27.495812 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 287) took 2073 ms. Trace:
I20260928 14:50:27.502170 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:27.502796 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.502899 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.502305 9814 rpcz_store.cc:276] 0928 14:50:25.422023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.423813 (+ 1790us) service_pool.cc:227] Handling call
0928 14:50:27.422413 (+1998600us) ts_tablet_manager.cc:1145] Deleting tablet 964985f048114f53ba1e685c7f1dbd6d
0928 14:50:27.422422 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.469917 (+ 47495us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.490858 (+ 20941us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.495746 (+ 4888us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1998453}
W20260928 14:50:27.503542 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cadfdf093ab04b61af441cff6c9c510b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cadfdf093ab04b61af441cff6c9c510b already in progress: creating tablet
I20260928 14:50:27.503751 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 964985f048114f53ba1e685c7f1dbd6d (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:27.504894 9848 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:27.504985 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.505117 9848 ts_tablet_manager.cc:1397] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260928 14:50:27.505861 9848 raft_consensus.cc:348] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.506194 9848 raft_consensus.cc:374] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.506306 9848 raft_consensus.cc:729] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.506772 9848 consensus_queue.cc:260] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.507216 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_98675e7b20e64bf6a67470355c440e97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.507767 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98675e7b20e64bf6a67470355c440e97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.512616 9848 ts_tablet_manager.cc:1428] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 14:50:27.516453 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 288) took 2081 ms. Trace:
I20260928 14:50:27.516695 9848 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:27.516690 10204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 14:50:27.517110 10204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260928 14:50:27.517048 9814 rpcz_store.cc:276] 0928 14:50:25.422133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.423980 (+ 1847us) service_pool.cc:227] Handling call
0928 14:50:27.503758 (+2079778us) ts_tablet_manager.cc:1145] Deleting tablet c5c6b0867466459ca14413559800ff64
0928 14:50:27.503769 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.503889 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2079655}
W20260928 14:50:27.517355 10204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 14:50:27.517515 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c5c6b0867466459ca14413559800ff64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c6b0867466459ca14413559800ff64 already in progress: creating tablet
I20260928 14:50:27.517788 9855 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.517947 9855 ts_tablet_manager.cc:1397] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.217s user 0.046s sys 0.083s
I20260928 14:50:27.518703 9855 raft_consensus.cc:348] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.518950 9855 raft_consensus.cc:374] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.519021 9855 raft_consensus.cc:729] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.519230 9855 consensus_queue.cc:260] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.521641 9855 ts_tablet_manager.cc:1428] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:27.521715 9848 tablet_bootstrap.cc:654] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.521967 9855 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.523554 9855 tablet_bootstrap.cc:654] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.523891 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 313) took 1920 ms. Trace:
I20260928 14:50:27.524168 9814 rpcz_store.cc:276] 0928 14:50:25.602912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.706304 (+103392us) service_pool.cc:227] Handling call
0928 14:50:27.523722 (+1817418us) ts_tablet_manager.cc:1145] Deleting tablet 6feba01e78004e50a71c610c9a63aeb5
0928 14:50:27.523735 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.523840 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1789074}
I20260928 14:50:27.525789 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c3faaac521464670a4b981a20d62e237" } modify_external_catalogs: true
I20260928 14:50:27.525974 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c3faaac521464670a4b981a20d62e237" } modify_external_catalogs: true
W20260928 14:50:27.530253 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6feba01e78004e50a71c610c9a63aeb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6feba01e78004e50a71c610c9a63aeb5 already in progress: creating tablet
W20260928 14:50:27.530553 10204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:27.530694 10204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 14:50:27.530784 10204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:27.530880 10204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 14:50:27.531692 9851 tablet_bootstrap.cc:492] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.531838 9851 ts_tablet_manager.cc:1397] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.002s
I20260928 14:50:27.533159 9851 raft_consensus.cc:348] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.533396 9851 raft_consensus.cc:374] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.533504 9851 raft_consensus.cc:729] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.533798 9851 consensus_queue.cc:260] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.536790 9851 ts_tablet_manager.cc:1428] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260928 14:50:27.537081 9851 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.538645 9851 tablet_bootstrap.cc:654] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.546638 10204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.60:39777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.181.60
--webserver_port=33241
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:27.547760 9851 tablet_bootstrap.cc:492] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.547973 9851 ts_tablet_manager.cc:1397] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 14:50:27.549456 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_26335d95c12a46e9a45f92335c09a089"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.550048 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26335d95c12a46e9a45f92335c09a089 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:27.550904 9219 consensus_peers.cc:487] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c101b1f03bb411f963f2348397c03e2. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.551023 9851 raft_consensus.cc:348] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.551743 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 314) took 1783 ms. Trace:
I20260928 14:50:27.551959 9814 rpcz_store.cc:276] 0928 14:50:25.768077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.779322 (+ 11245us) service_pool.cc:227] Handling call
0928 14:50:27.551410 (+1772088us) ts_tablet_manager.cc:1145] Deleting tablet ed0d79a39b2543049506422432990617
0928 14:50:27.551421 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.551528 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1770872}
I20260928 14:50:27.516866 9813 ts_tablet_manager.cc:1918] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.552520 9813 log.cc:1196] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:27.553066 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 317) took 1783 ms. Trace:
I20260928 14:50:27.553035 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.553440 10204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260928 14:50:27.553678 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.556311 10204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 14:50:27.556559 9814 rpcz_store.cc:276] 0928 14:50:25.769069 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.779544 (+ 10475us) service_pool.cc:227] Handling call
0928 14:50:27.552746 (+1773202us) ts_tablet_manager.cc:1145] Deleting tablet 2f0b97883acb4adfa4091653545e894b
0928 14:50:27.552756 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.552875 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1772108}
I20260928 14:50:27.553205 9851 raft_consensus.cc:374] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.557147 9851 raft_consensus.cc:729] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:27.557251 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2f0b97883acb4adfa4091653545e894b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0b97883acb4adfa4091653545e894b already in progress: creating tablet
I20260928 14:50:27.557438 9851 consensus_queue.cc:260] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.558065 9851 ts_tablet_manager.cc:1428] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:27.558336 9851 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.558344 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 595dccb9d03b4dd48698262aad630ac2
I20260928 14:50:27.558768 8956 catalog_manager.cc:6565] ReplaceTablet: tablet 595dccb9d03b4dd48698262aad630ac2 deleted and replaced by tablet 846a96509f32416087ee4667458c367e
I20260928 14:50:27.559515 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 315) took 1791 ms. Trace:
I20260928 14:50:27.559605 9814 rpcz_store.cc:276] 0928 14:50:25.768238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.779688 (+ 11450us) service_pool.cc:227] Handling call
0928 14:50:27.559116 (+1779428us) ts_tablet_manager.cc:1145] Deleting tablet 75f9359df0ac466c912cd20fc6b94390
0928 14:50:27.559126 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.559461 (+ 335us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1778438}
W20260928 14:50:27.559856 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c88ccde6f7540d4aa7cf9b29aa3718d consensus state has no leader
I20260928 14:50:27.560014 9814 tablet_replica.cc:330] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:27.560114 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f348f9e962748a0992d85b9d3d72aeb from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:27.560192 9814 raft_consensus.cc:2229] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.560467 9814 pending_rounds.cc:62] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:27.560523 9814 pending_rounds.cc:68] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326381312221184 op_type: NO_OP noop_request { }
I20260928 14:50:27.560665 9814 raft_consensus.cc:2866] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:27.560768 9814 raft_consensus.cc:2258] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.561861 9851 tablet_bootstrap.cc:654] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.565807 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.566116 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.567973 9813 ts_tablet_manager.cc:1939] T 89959226fd6247d4b89c54cc6ef4ede6 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:27.568723 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 75f9359df0ac466c912cd20fc6b94390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f9359df0ac466c912cd20fc6b94390 already in progress: creating tablet
I20260928 14:50:27.569404 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffd9bc260ae4373a946ce82ba5f0d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.569691 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 294) took 2342 ms. Trace:
I20260928 14:50:27.568835 9814 ts_tablet_manager.cc:1905] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.570741 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 595dccb9d03b4dd48698262aad630ac2 with delete_type TABLET_DATA_DELETED (replaced by tablet 846a96509f32416087ee4667458c367e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.571058 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ee1e19142b402f96056c387140b5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.571287 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 47ff819255f74f49a1ce0b5588aa03a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.569803 9813 rpcz_store.cc:276] 0928 14:50:25.227292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.227599 (+ 307us) service_pool.cc:227] Handling call
0928 14:50:27.228902 (+2001303us) ts_tablet_manager.cc:1145] Deleting tablet 89959226fd6247d4b89c54cc6ef4ede6
0928 14:50:27.228912 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.443727 (+214815us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.516742 (+ 73015us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.569656 (+ 52914us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1998086}
I20260928 14:50:27.571558 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 595dccb9d03b4dd48698262aad630ac2 with delete_type TABLET_DATA_DELETED (replaced by tablet 846a96509f32416087ee4667458c367e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.571651 9813 tablet_replica.cc:330] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:27.571856 9813 raft_consensus.cc:2229] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.571976 9815 tablet_replica.cc:330] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.571986 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet def872f66b2541b9af6084e93d991ec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.572078 9813 raft_consensus.cc:2258] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.566562 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.572260 9815 raft_consensus.cc:2229] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:27.567159 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 595dccb9d03b4dd48698262aad630ac2 with delete_type TABLET_DATA_DELETED (replaced by tablet 846a96509f32416087ee4667458c367e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.572831 9815 raft_consensus.cc:2258] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.573406 9360 consensus_peers.cc:487] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d5166a828e84d46af3112cdc7bb0a2a. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.573823 9815 ts_tablet_manager.cc:1905] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.574733 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 89959226fd6247d4b89c54cc6ef4ede6 (table default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b [id=abe01d8e1ae6470893f4d86a00f7d529]) successfully deleted
I20260928 14:50:27.575573 9851 tablet_bootstrap.cc:492] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.575742 9851 ts_tablet_manager.cc:1397] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260928 14:50:27.576508 9851 raft_consensus.cc:348] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.576728 9851 raft_consensus.cc:374] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.576809 9851 raft_consensus.cc:729] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.577030 9851 consensus_queue.cc:260] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.577477 9813 ts_tablet_manager.cc:1905] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.578509 9851 ts_tablet_manager.cc:1428] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:27.578959 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ab677e004fee49e4882b664fb17465d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:27.579483 9851 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:27.579555 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab677e004fee49e4882b664fb17465d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.580181 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:27.580981 9851 tablet_bootstrap.cc:654] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.582448 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.582660 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.582813 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.582844 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c" } modify_external_catalogs: true
I20260928 14:50:27.582971 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.583033 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c" } modify_external_catalogs: true
I20260928 14:50:27.583171 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.583345 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.583359 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0f116343cade4ff0950abc852cff317f" } new_table_name: "default.Table_7d735ceca02945adafa0d6e0606ff717" modify_external_catalogs: true
I20260928 14:50:27.583546 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.583727 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.583881 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet d004e52539cc49bc8a26f77e0bb182cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.584523 9821 raft_consensus.cc:482] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.584656 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_16e1563e5eaa4601bc1ab2b6a227f8ef" } new_table_name: "default.Table_7bb67fe09d1544418318121e5efde0a0" modify_external_catalogs: true
I20260928 14:50:27.584663 9821 raft_consensus.cc:504] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.585271 9821 leader_election.cc:288] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.585494 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.585716 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.585821 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.585716 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.586166 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.586396 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.586555 9815 ts_tablet_manager.cc:1918] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:27.586616 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.586688 9815 log.cc:1196] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/595dccb9d03b4dd48698262aad630ac2
I20260928 14:50:27.586813 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.587069 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.587163 9815 ts_tablet_manager.cc:1939] T 595dccb9d03b4dd48698262aad630ac2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.587311 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.587469 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.588110 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 595dccb9d03b4dd48698262aad630ac2 (table default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]) successfully deleted
I20260928 14:50:27.590175 9815 tablet_replica.cc:330] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.590368 9815 raft_consensus.cc:2229] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.590502 9815 raft_consensus.cc:2258] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.591027 9815 ts_tablet_manager.cc:1905] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.591203 9821 raft_consensus.cc:482] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.591390 9821 raft_consensus.cc:504] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.591902 9821 leader_election.cc:288] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.593925 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:27.594714 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd24e60a0e944f6086ff9c9fbe2e8180" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.595099 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.596047 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet d004e52539cc49bc8a26f77e0bb182cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:27.596608 9497 leader_election.cc:341] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.596740 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_102c885d8b48453a84696844fe43f393" } new_table_name: "default.Table_e6b7fbb9aae540268b85c3556e9ed7bd" modify_external_catalogs: true
W20260928 14:50:27.596843 9497 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.597894 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a30439ac5a8485a9b6ebbe1371087b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.598131 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 051b7f0b1d0f4f638f3e7a69a027196e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.598306 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 8193754d28d34c18bfc38ae0abd05f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.598482 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet d004e52539cc49bc8a26f77e0bb182cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.601210 9821 raft_consensus.cc:482] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.601402 9821 raft_consensus.cc:504] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.601433 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_273b9098d67f4d168421a50e8e842fb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.601979 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_273b9098d67f4d168421a50e8e842fb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.602017 9821 leader_election.cc:288] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.602686 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5c040fa6ba4e2785959874a3346bf7" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.603207 9497 leader_election.cc:341] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.604128 9282 raft_consensus.cc:3037] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.605891 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.606197 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca5c040fa6ba4e2785959874a3346bf7" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.606745 9498 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.606871 9498 leader_election.cc:302] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.607220 9821 raft_consensus.cc:2726] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:27.607417 9498 leader_election.cc:341] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.607555 9498 leader_election.cc:302] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.607815 9821 raft_consensus.cc:2726] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.608296 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd24e60a0e944f6086ff9c9fbe2e8180" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.608553 9821 raft_consensus.cc:482] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:27.608819 9498 leader_election.cc:341] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.608781 9821 raft_consensus.cc:504] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.608985 9498 leader_election.cc:302] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.609217 10211 consensus_queue.cc:1035] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:27.609332 10054 raft_consensus.cc:2726] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.609472 9821 leader_election.cc:288] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.610033 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.610270 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.610467 9497 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:27.610733 9498 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.610881 9498 leader_election.cc:302] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.611145 9821 raft_consensus.cc:2726] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.619653 10205 raft_consensus.cc:482] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.619807 10205 raft_consensus.cc:504] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.620442 10205 leader_election.cc:288] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.621074 9815 ts_tablet_manager.cc:1918] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.621409 9815 log.cc:1196] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:27.621956 9815 ts_tablet_manager.cc:1939] T bad2124268994f04ae7153ea5aaeeab0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:27.622509 9219 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:27.622947 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet bad2124268994f04ae7153ea5aaeeab0 (table default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]) successfully deleted
I20260928 14:50:27.623304 9815 tablet_replica.cc:330] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.623492 9815 raft_consensus.cc:2229] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.623648 9815 raft_consensus.cc:2258] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:27.624197 9220 leader_election.cc:341] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:27.624321 9220 leader_election.cc:302] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.624694 10205 raft_consensus.cc:2726] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.624774 9815 ts_tablet_manager.cc:1905] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:27.626294 10302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:27.626794 9360 consensus_peers.cc:487] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17d7539290064c2c9fda29a5f16d375b. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:27.628484 10301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:27.631523 9815 ts_tablet_manager.cc:1918] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.631649 9815 log.cc:1196] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:27.632472 9815 ts_tablet_manager.cc:1939] T f05131db52e94d7c9f4856b0455246d2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.633559 9855 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:27.633709 9855 ts_tablet_manager.cc:1397] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.112s user 0.006s sys 0.001s
I20260928 14:50:27.634536 9855 raft_consensus.cc:348] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.634763 9855 raft_consensus.cc:374] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.634855 9855 raft_consensus.cc:729] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.635084 9855 consensus_queue.cc:260] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.636034 9855 ts_tablet_manager.cc:1428] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:27.636404 9855 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:27.636385 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f05131db52e94d7c9f4856b0455246d2 (table default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]) successfully deleted
I20260928 14:50:27.637419 9815 tablet_replica.cc:330] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.637676 9815 raft_consensus.cc:2229] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.637823 9815 raft_consensus.cc:2258] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.638330 9815 ts_tablet_manager.cc:1905] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.640664 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d7539290064c2c9fda29a5f16d375b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:27.642241 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:27.642609 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fcb75edccb944c8e9c4197334aad550b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.643190 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcb75edccb944c8e9c4197334aad550b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.643334 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:27.645697 9360 consensus_peers.cc:487] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9cee872de1f4ce8b803cb8e8fb018d2. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.647454 9815 ts_tablet_manager.cc:1918] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.647609 9815 log.cc:1196] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:27.647917 9815 ts_tablet_manager.cc:1939] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.651436 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c7687d91f40d47c99ca2f22db2dd127d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.652010 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7687d91f40d47c99ca2f22db2dd127d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.654170 9282 raft_consensus.cc:3037] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.656853 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (table default.Table_b83606ed237744d88ba3ebb26186e236 [id=653bfb0f2b28414e968985203ce7a611]) successfully deleted
W20260928 14:50:27.657361 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be232889594147bdbe2d4825c3e8c7d0 consensus state has no leader
I20260928 14:50:27.657895 10211 consensus_queue.cc:1035] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:27.658141 9815 tablet_replica.cc:330] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.658334 9815 raft_consensus.cc:2229] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.659229 9815 raft_consensus.cc:2258] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.659726 9815 ts_tablet_manager.cc:1905] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.660619 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_550f202c199b47f098184b3921013074" } new_table_name: "default.Table_c90b633274d340ef940d83bcbe55c632" modify_external_catalogs: true
W20260928 14:50:27.666065 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f9b6cbf2d949839216e807130b2eb9 consensus state has no leader
I20260928 14:50:27.671211 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a0970a2d63544b6da80d91d68a45226e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:27.671819 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0970a2d63544b6da80d91d68a45226e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:27.672098 10066 raft_consensus.cc:482] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.672307 10066 raft_consensus.cc:504] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.673087 10211 raft_consensus.cc:482] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.673136 10066 leader_election.cc:288] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.673309 10211 raft_consensus.cc:504] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.673974 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8db468ad3c4bba8c701c3d8feba9f4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.674321 10211 leader_election.cc:288] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:27.674721 9497 leader_election.cc:341] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.675627 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a50b4fe8d86464f933baec07478db25" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.678100 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8db468ad3c4bba8c701c3d8feba9f4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.679931 9360 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.686452 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
W20260928 14:50:27.686446 9498 leader_election.cc:341] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.687021 9498 leader_election.cc:302] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.688719 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 622a7af04be44ddebc1af16fcc6325ae (DEFAULT_TABLE table=default.Table_1bb9988e056b464d896de7d07c7dcb6b [id=f5ad8b4a8b20466ebd2410f788f02694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.689131 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622a7af04be44ddebc1af16fcc6325ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.689214 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 622a7af04be44ddebc1af16fcc6325ae (DEFAULT_TABLE table=default.Table_1bb9988e056b464d896de7d07c7dcb6b [id=f5ad8b4a8b20466ebd2410f788f02694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.689596 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622a7af04be44ddebc1af16fcc6325ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.695001 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 7376f56883dc4032b120cc4494fa8936 (DEFAULT_TABLE table=default.Table_eb64624ba99c4e48ae2d157843c73477 [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.695438 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7376f56883dc4032b120cc4494fa8936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.695578 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 2b92039b9a484a768efa3714b58248ef (DEFAULT_TABLE table=default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.696030 9263 tablet_service.cc:1467] Processing CreateTablet for tablet f4eeb2aa92a24b628156d34129f1381c (DEFAULT_TABLE table=default.Table_aeb307bca9f04e3fba16a493beb31b91 [id=495273db44b54cdea41982cd676b579c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.696518 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 5a6755b697134b8e90e457b554b9599c (DEFAULT_TABLE table=default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.696946 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b92039b9a484a768efa3714b58248ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.698122 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (DEFAULT_TABLE table=default.Table_fef73768d74d4e4e88501663bd431a4e [id=74dcef243b8f4685bef322f403a2ebd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.698494 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d197a8ba8848d98ba0f03b2e83d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.699584 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_455b19903e324720a3d1e2d9f4dc9718" } modify_external_catalogs: true
I20260928 14:50:27.699793 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_455b19903e324720a3d1e2d9f4dc9718" } modify_external_catalogs: true
I20260928 14:50:27.701541 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e50a29433014e98b687ee424debf6d5" } modify_external_catalogs: true
I20260928 14:50:27.701746 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e50a29433014e98b687ee424debf6d5" } modify_external_catalogs: true
I20260928 14:50:27.703910 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb (DEFAULT_TABLE table=default.Table_ba3b03ec5d55498085ffef43b3929852 [id=b9da8f3786084226ae396c4c3a19b20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.704264 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 5a6755b697134b8e90e457b554b9599c (DEFAULT_TABLE table=default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.704514 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 2b92039b9a484a768efa3714b58248ef (DEFAULT_TABLE table=default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.704818 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 7376f56883dc4032b120cc4494fa8936 (DEFAULT_TABLE table=default.Table_eb64624ba99c4e48ae2d157843c73477 [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.705075 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 76ad7685ece44665896f687697bddccf (DEFAULT_TABLE table=default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.703872 9398 tablet_service.cc:1467] Processing CreateTablet for tablet f4eeb2aa92a24b628156d34129f1381c (DEFAULT_TABLE table=default.Table_aeb307bca9f04e3fba16a493beb31b91 [id=495273db44b54cdea41982cd676b579c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.704285 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5afbdeda4ddfb82124031135e6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.705760 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99 (DEFAULT_TABLE table=default.Table_af41acca2d874e6b93e62944f1c8311f [id=47d160ae6edd495fadc4e7736ec04bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.706081 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.709651 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b92039b9a484a768efa3714b58248ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.709834 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a6755b697134b8e90e457b554b9599c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.710147 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 (DEFAULT_TABLE table=default.Table_5b5e5d62d87d4917a33183603d3f1859 [id=d19993a468fd4f7d994003f4977a1c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.710470 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52993ae8b63d4fbaa8cf38720af3dea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.713663 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ad7685ece44665896f687697bddccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.713828 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4eeb2aa92a24b628156d34129f1381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.714265 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (DEFAULT_TABLE table=default.Table_fef73768d74d4e4e88501663bd431a4e [id=74dcef243b8f4685bef322f403a2ebd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.716336 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 66772fac8b3747f0983562195abcc64e (DEFAULT_TABLE table=default.Table_cec79b345afa4c25bbd3c96ac88c6b11 [id=2e13625a246447c094acfbe1f0e6b106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.717746 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7376f56883dc4032b120cc4494fa8936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.726135 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d197a8ba8848d98ba0f03b2e83d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.729777 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66772fac8b3747f0983562195abcc64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.735030 10066 raft_consensus.cc:482] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.735285 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 622a7af04be44ddebc1af16fcc6325ae (DEFAULT_TABLE table=default.Table_1bb9988e056b464d896de7d07c7dcb6b [id=f5ad8b4a8b20466ebd2410f788f02694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.736055 9815 ts_tablet_manager.cc:1918] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:27.739393 9360 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6a50b4fe8d86464f933baec07478db25
I20260928 14:50:27.739603 9360 leader_election.cc:302] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:27.741333 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 66772fac8b3747f0983562195abcc64e (DEFAULT_TABLE table=default.Table_cec79b345afa4c25bbd3c96ac88c6b11 [id=2e13625a246447c094acfbe1f0e6b106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.735954 10066 raft_consensus.cc:504] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.742143 10066 leader_election.cc:288] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.742264 9815 log.cc:1196] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:27.743317 10189 raft_consensus.cc:2726] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.743933 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 (DEFAULT_TABLE table=default.Table_5b5e5d62d87d4917a33183603d3f1859 [id=d19993a468fd4f7d994003f4977a1c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.744513 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 7376f56883dc4032b120cc4494fa8936 (DEFAULT_TABLE table=default.Table_eb64624ba99c4e48ae2d157843c73477 [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:27.745227 9360 consensus_peers.cc:487] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd70cf6ee2d343878c90ae4818f1eb8f. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.746757 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99 (DEFAULT_TABLE table=default.Table_af41acca2d874e6b93e62944f1c8311f [id=47d160ae6edd495fadc4e7736ec04bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.747852 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb (DEFAULT_TABLE table=default.Table_ba3b03ec5d55498085ffef43b3929852 [id=b9da8f3786084226ae396c4c3a19b20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.748265 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622a7af04be44ddebc1af16fcc6325ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.750646 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 2b92039b9a484a768efa3714b58248ef (DEFAULT_TABLE table=default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.751629 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (DEFAULT_TABLE table=default.Table_fef73768d74d4e4e88501663bd431a4e [id=74dcef243b8f4685bef322f403a2ebd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.751973 9815 ts_tablet_manager.cc:1939] T 311e4286b2a943ee924ac1c25dc9ca46 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:27.752934 9815 tablet_replica.cc:330] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:27.753141 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 5a6755b697134b8e90e457b554b9599c (DEFAULT_TABLE table=default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.751507 9542 tablet_service.cc:1467] Processing CreateTablet for tablet f4eeb2aa92a24b628156d34129f1381c (DEFAULT_TABLE table=default.Table_aeb307bca9f04e3fba16a493beb31b91 [id=495273db44b54cdea41982cd676b579c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.754882 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 311e4286b2a943ee924ac1c25dc9ca46 (table default.Table_e6b7fbb9aae540268b85c3556e9ed7bd [id=3d4e8c920b14490fb8d10202db71bb52]) successfully deleted
I20260928 14:50:27.755230 9815 raft_consensus.cc:2229] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:27.755409 9815 raft_consensus.cc:2258] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:27.756011 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:27.756460 10066 raft_consensus.cc:2726] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.756868 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 76ad7685ece44665896f687697bddccf (DEFAULT_TABLE table=default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.757124 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.758924 9813 ts_tablet_manager.cc:1918] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:27.760305 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 76ad7685ece44665896f687697bddccf (DEFAULT_TABLE table=default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.762422 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52993ae8b63d4fbaa8cf38720af3dea5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.764050 9497 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.764197 9851 tablet_bootstrap.cc:492] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:27.765597 9533 tablet_service.cc:1467] Processing CreateTablet for tablet f39c1da071164342aea8eab263d4eebb (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.766453 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 1b22c3f9578a464a96be0bac6127e56d (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.767601 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (DEFAULT_TABLE table=default.Table_50d0ba4738bd4af2b91d2e20e9003556 [id=bedae6fe8fc54b5098b672df96fcfdfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.767882 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 62d6975813b744fb80dcc432cec61cb4 (DEFAULT_TABLE table=default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c [id=63833e63efa7423e9eabe903f17d5996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.768711 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a6755b697134b8e90e457b554b9599c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.769639 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb (DEFAULT_TABLE table=default.Table_ba3b03ec5d55498085ffef43b3929852 [id=b9da8f3786084226ae396c4c3a19b20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.762773 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99 (DEFAULT_TABLE table=default.Table_af41acca2d874e6b93e62944f1c8311f [id=47d160ae6edd495fadc4e7736ec04bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.771123 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 66772fac8b3747f0983562195abcc64e (DEFAULT_TABLE table=default.Table_cec79b345afa4c25bbd3c96ac88c6b11 [id=2e13625a246447c094acfbe1f0e6b106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.771858 9815 ts_tablet_manager.cc:1905] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:27.772205 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a6755b697134b8e90e457b554b9599c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.772106 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 (DEFAULT_TABLE table=default.Table_5b5e5d62d87d4917a33183603d3f1859 [id=d19993a468fd4f7d994003f4977a1c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.774400 9255 tablet_service.cc:1467] Processing CreateTablet for tablet f39c1da071164342aea8eab263d4eebb (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.775172 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcc42af91c247b1b80059e95e3659cf (DEFAULT_TABLE table=default.Table_8e132204dd2e4ea9bcec96f5d7018df6 [id=d941acc245774ff4b5d6f5f73a866e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.775921 9254 tablet_service.cc:1467] Processing CreateTablet for tablet b08bce102125416fbcf446f12243ebe9 (DEFAULT_TABLE table=default.Table_6ed8ff8486eb431fb6b3a9389b206f83 [id=60a3f0e030a14328954dec3e57514b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.776845 9250 tablet_service.cc:1467] Processing CreateTablet for tablet af22f23ff3864620bfefb31b9e899036 (DEFAULT_TABLE table=default.Table_21a4bfb6f8964ad5937b0106fa65cc82 [id=811f5b04b17349319d6f50e6d01edafd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:27.777030 8941 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Couldn't send request to peer c6b99976d8024a79a0603523b9d32f29. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 14:50:27.777346 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 (DEFAULT_TABLE table=default.Table_455b19903e324720a3d1e2d9f4dc9718 [id=cc5e7eb9c7124567aeab82ebc8bf5050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.777770 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39c1da071164342aea8eab263d4eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.777833 9851 ts_tablet_manager.cc:1397] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.185s user 0.031s sys 0.054s
I20260928 14:50:27.771847 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 62d6975813b744fb80dcc432cec61cb4 (DEFAULT_TABLE table=default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c [id=63833e63efa7423e9eabe903f17d5996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.779737 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 1b22c3f9578a464a96be0bac6127e56d (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.781023 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 (DEFAULT_TABLE table=default.Table_455b19903e324720a3d1e2d9f4dc9718 [id=cc5e7eb9c7124567aeab82ebc8bf5050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.781242 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66772fac8b3747f0983562195abcc64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.782188 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 6d193edcfa684b8795b084f3106903c5 (DEFAULT_TABLE table=default.Table_7b0fb0bac48645b68ed77a4a2605c08b [id=02744da757694610abd1cde1b4d28fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.782481 9851 raft_consensus.cc:348] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.786062 9261 tablet_service.cc:1467] Processing CreateTablet for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (DEFAULT_TABLE table=default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.789469 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b22c3f9578a464a96be0bac6127e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.789660 9851 raft_consensus.cc:374] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:27.790364 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (DEFAULT_TABLE table=default.Table_50d0ba4738bd4af2b91d2e20e9003556 [id=bedae6fe8fc54b5098b672df96fcfdfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.791796 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af22f23ff3864620bfefb31b9e899036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.791847 9851 raft_consensus.cc:729] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:27.816449 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.816426 9851 consensus_queue.cc:260] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.818301 9851 ts_tablet_manager.cc:1428] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.040s user 0.000s sys 0.002s
I20260928 14:50:27.826310 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c54cb0e8f2347d9b139c8766fb61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.830569 9851 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:27.832274 10205 raft_consensus.cc:482] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.832461 10205 raft_consensus.cc:504] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.833624 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39c1da071164342aea8eab263d4eebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.833851 10205 leader_election.cc:288] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.838881 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcc42af91c247b1b80059e95e3659cf (DEFAULT_TABLE table=default.Table_8e132204dd2e4ea9bcec96f5d7018df6 [id=d941acc245774ff4b5d6f5f73a866e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.841887 9548 tablet_service.cc:1467] Processing CreateTablet for tablet b08bce102125416fbcf446f12243ebe9 (DEFAULT_TABLE table=default.Table_6ed8ff8486eb431fb6b3a9389b206f83 [id=60a3f0e030a14328954dec3e57514b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.842283 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 6d193edcfa684b8795b084f3106903c5 (DEFAULT_TABLE table=default.Table_7b0fb0bac48645b68ed77a4a2605c08b [id=02744da757694610abd1cde1b4d28fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.844038 9531 tablet_service.cc:1467] Processing CreateTablet for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (DEFAULT_TABLE table=default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.847026 10205 raft_consensus.cc:482] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.847404 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08bce102125416fbcf446f12243ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.848636 9219 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:27.848896 10205 raft_consensus.cc:504] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.849603 10205 leader_election.cc:288] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.850157 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c54cb0e8f2347d9b139c8766fb61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.850266 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d6975813b744fb80dcc432cec61cb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.874183 9360 consensus_peers.cc:487] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:27.876848 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 114425us
I20260928 14:50:27.877318 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcc42af91c247b1b80059e95e3659cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.879347 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.880374 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08bce102125416fbcf446f12243ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.882185 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d193edcfa684b8795b084f3106903c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.883780 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.884562 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8193754d28d34c18bfc38ae0abd05f4c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.884853 10189 raft_consensus.cc:482] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.889010 9427 raft_consensus.cc:2454] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:27.890121 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 62d6975813b744fb80dcc432cec61cb4 (DEFAULT_TABLE table=default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c [id=63833e63efa7423e9eabe903f17d5996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.890601 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d6975813b744fb80dcc432cec61cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.897891 10189 raft_consensus.cc:504] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:27.898126 9406 tablet_service.cc:1467] Processing CreateTablet for tablet f39c1da071164342aea8eab263d4eebb (DEFAULT_TABLE table=default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.899250 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f39c1da071164342aea8eab263d4eebb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.899605 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 59646us
I20260928 14:50:27.900848 9428 raft_consensus.cc:2454] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:27.901614 10066 raft_consensus.cc:482] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.901676 10152 raft_consensus.cc:482] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.906589 10152 raft_consensus.cc:504] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:27.904175 10189 leader_election.cc:288] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.909659 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b22c3f9578a464a96be0bac6127e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.910938 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:27.899056 9360 consensus_peers.cc:487] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:27.912282 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 8fcc42af91c247b1b80059e95e3659cf (DEFAULT_TABLE table=default.Table_8e132204dd2e4ea9bcec96f5d7018df6 [id=d941acc245774ff4b5d6f5f73a866e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.912437 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 1b22c3f9578a464a96be0bac6127e56d (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.912652 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcc42af91c247b1b80059e95e3659cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.913094 10152 leader_election.cc:288] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:27.914106 10066 raft_consensus.cc:504] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.914673 10066 leader_election.cc:288] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.919195 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:27.919607 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 (DEFAULT_TABLE table=default.Table_455b19903e324720a3d1e2d9f4dc9718 [id=cc5e7eb9c7124567aeab82ebc8bf5050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.925568 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d197a8ba8848d98ba0f03b2e83d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.930794 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b22c3f9578a464a96be0bac6127e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.943022 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.947453 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d6975813b744fb80dcc432cec61cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.949165 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.950176 9498 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.950448 9498 leader_election.cc:302] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.951434 9286 raft_consensus.cc:2454] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:27.952728 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dd1e0ebad9143e397ec4cdb9ef6fc99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.953598 9219 leader_election.cc:341] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:27.955427 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.956473 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 97607.7us
I20260928 14:50:27.957041 9220 leader_election.cc:302] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:27.957360 10205 raft_consensus.cc:2781] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:27.956781 9534 tablet_service.cc:1467] Processing CreateTablet for tablet af22f23ff3864620bfefb31b9e899036 (DEFAULT_TABLE table=default.Table_21a4bfb6f8964ad5937b0106fa65cc82 [id=811f5b04b17349319d6f50e6d01edafd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:27.957378 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 67865.8us
I20260928 14:50:27.957484 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:27.959522 9497 leader_election.cc:341] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.959837 9220 leader_election.cc:302] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:27.961508 10068 raft_consensus.cc:2781] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:27.961686 10068 raft_consensus.cc:482] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:27.962539 10205 raft_consensus.cc:482] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:27.962711 10066 raft_consensus.cc:2726] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.962899 9855 tablet_bootstrap.cc:654] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.963490 10068 raft_consensus.cc:3037] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.964751 10205 raft_consensus.cc:3037] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:27.966917 9851 tablet_bootstrap.cc:654] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:27.967263 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66772fac8b3747f0983562195abcc64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.968950 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4eeb2aa92a24b628156d34129f1381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.971029 10152 raft_consensus.cc:482] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:27.971187 10152 raft_consensus.cc:504] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:27.971843 10152 leader_election.cc:288] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:27.972198 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b92039b9a484a768efa3714b58248ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.973196 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c54cb0e8f2347d9b139c8766fb61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.973591 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7376f56883dc4032b120cc4494fa8936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.975060 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5afbdeda4ddfb82124031135e6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.986229 9390 tablet_service.cc:1467] Processing CreateTablet for tablet b08bce102125416fbcf446f12243ebe9 (DEFAULT_TABLE table=default.Table_6ed8ff8486eb431fb6b3a9389b206f83 [id=60a3f0e030a14328954dec3e57514b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.986708 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08bce102125416fbcf446f12243ebe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:27.988106 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ad7685ece44665896f687697bddccf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.994546 9498 leader_election.cc:341] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.995215 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af22f23ff3864620bfefb31b9e899036. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:27.996135 9497 leader_election.cc:341] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:27.996433 9497 leader_election.cc:302] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:27.996731 10152 raft_consensus.cc:2726] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:27.999002 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (DEFAULT_TABLE table=default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:27.999420 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.001679 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.002238 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a828130854b4e4e8c44b2b45260e50e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.011343 10152 raft_consensus.cc:482] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.011566 10152 raft_consensus.cc:504] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.013288 10152 leader_election.cc:288] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.016732 9360 leader_election.cc:302] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:28.015431 9498 leader_election.cc:341] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.022119 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 6d193edcfa684b8795b084f3106903c5 (DEFAULT_TABLE table=default.Table_7b0fb0bac48645b68ed77a4a2605c08b [id=02744da757694610abd1cde1b4d28fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.022785 10189 raft_consensus.cc:2781] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:28.022891 10189 raft_consensus.cc:482] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:28.023232 10189 raft_consensus.cc:3037] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:28.032384 10189 raft_consensus.cc:504] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:28.033315 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 69279.2us
I20260928 14:50:28.040133 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d193edcfa684b8795b084f3106903c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.040829 10189 leader_election.cc:288] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:28.049713 9360 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:28.052120 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (DEFAULT_TABLE table=default.Table_50d0ba4738bd4af2b91d2e20e9003556 [id=bedae6fe8fc54b5098b672df96fcfdfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.052603 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.055967 9402 tablet_service.cc:1467] Processing CreateTablet for tablet af22f23ff3864620bfefb31b9e899036 (DEFAULT_TABLE table=default.Table_21a4bfb6f8964ad5937b0106fa65cc82 [id=811f5b04b17349319d6f50e6d01edafd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.057246 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af22f23ff3864620bfefb31b9e899036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.061874 9813 log.cc:1196] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:28.062523 9813 ts_tablet_manager.cc:1939] T 6ffd9bc260ae4373a946ce82ba5f0d48 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:28.073125 9498 leader_election.cc:302] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:28.073550 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 69147.8us
I20260928 14:50:28.076016 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.076139 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3ac8adb23c5478fadb6cb6765459913" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.089928 10152 raft_consensus.cc:482] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.090449 10066 raft_consensus.cc:482] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.092860 10054 raft_consensus.cc:2726] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.093084 10152 raft_consensus.cc:504] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.093820 10152 leader_election.cc:288] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.094146 10066 raft_consensus.cc:504] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.094820 10066 leader_election.cc:288] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:28.104168 9286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3ac8adb23c5478fadb6cb6765459913" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:28.104580 9498 leader_election.cc:341] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.105024 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e56077833e41dbacf54c1757ba6a38" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.105450 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52993ae8b63d4fbaa8cf38720af3dea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.107379 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.111953 10066 consensus_queue.cc:1035] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 14:50:28.108675 10205 raft_consensus.cc:504] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:28.112577 9498 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:28.120620 9497 consensus_peers.cc:487] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:28.120671 10205 leader_election.cc:288] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:28.120930 9497 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:28.122417 9219 leader_election.cc:341] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:28.122705 9497 leader_election.cc:302] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:28.123178 9497 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:28.126591 9497 leader_election.cc:341] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.127384 10152 raft_consensus.cc:2726] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.129899 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 293) took 2896 ms. Trace:
I20260928 14:50:28.130072 9813 rpcz_store.cc:276] 0928 14:50:25.227031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.227555 (+ 524us) service_pool.cc:227] Handling call
0928 14:50:27.571591 (+2344036us) ts_tablet_manager.cc:1145] Deleting tablet 6ffd9bc260ae4373a946ce82ba5f0d48
0928 14:50:27.571602 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.604634 (+ 33032us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:27.756558 (+151924us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.123349 (+366791us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2337693}
I20260928 14:50:28.130889 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (table default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]) successfully deleted
I20260928 14:50:28.131445 9815 ts_tablet_manager.cc:1918] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.131909 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.132341 9815 log.cc:1196] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:28.133229 8946 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:59172 (request call id 3) took 1520 ms. Trace:
I20260928 14:50:28.133388 8946 rpcz_store.cc:276] 0928 14:50:26.612727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.739374 (+1126647us) service_pool.cc:227] Handling call
0928 14:50:28.133025 (+393651us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x615000033024. stack: 00007f86e63e066e 00007f86e63e0430 00007f86e54675ed 00000000008ea064 00000000008ea02d 00007f86f4af927d 00007f86f4af9373 00007f86f191b361 00007f86f928e66a 00007f86f941e745 00007f86f071a3e7 00007f86f071a115 00007f86ecf1c9be 00007f86ecf1b79e 00007f86ecf21b25 00007f86ecf2254f
0928 14:50:28.133172 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":904516864}
I20260928 14:50:28.134410 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d7d4ef8a945c4e6c899e2bbd6069969c (table default.Table_7d735ceca02945adafa0d6e0606ff717 [id=758c0941b029421d8f865d8600a17049]). Expected version 1 got 0
I20260928 14:50:28.134558 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_04a048509ef24182a5ba414faa2066d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.135167 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04a048509ef24182a5ba414faa2066d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.135492 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_69359a2fb5f541a5a6f13af1a82119b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.135571 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e56077833e41dbacf54c1757ba6a38" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:28.136051 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69359a2fb5f541a5a6f13af1a82119b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:28.136889 9360 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 47ff819255f74f49a1ce0b5588aa03a1
W20260928 14:50:28.138185 9848 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.001s sys 0.002s
I20260928 14:50:28.138058 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0fec5d22085a418188e9d10f1798ebf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.138350 9848 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.570s user 0.001s sys 0.002s
I20260928 14:50:28.138304 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f97651e18ff042809ba35856d05b379b" } modify_external_catalogs: true
I20260928 14:50:28.138582 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f97651e18ff042809ba35856d05b379b" } modify_external_catalogs: true
I20260928 14:50:28.139165 9848 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:28.139295 9848 ts_tablet_manager.cc:1397] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.623s user 0.003s sys 0.004s
I20260928 14:50:28.140025 9848 raft_consensus.cc:348] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.140146 9815 ts_tablet_manager.cc:1939] T 6891077c78ef4f3d84e33283096ddf7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.140432 9848 raft_consensus.cc:374] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.140779 9848 raft_consensus.cc:729] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:28.140949 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fec5d22085a418188e9d10f1798ebf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.141510 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6891077c78ef4f3d84e33283096ddf7a (table default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]) successfully deleted
I20260928 14:50:28.141397 9848 consensus_queue.cc:260] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.143349 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8193754d28d34c18bfc38ae0abd05f4c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:28.143549 9427 raft_consensus.cc:3037] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:28.144929 10152 consensus_queue.cc:1035] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260928 14:50:28.147500 9427 raft_consensus.cc:2454] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:28.147053 9498 leader_election.cc:341] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.148883 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ad7685ece44665896f687697bddccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.149570 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fcc42af91c247b1b80059e95e3659cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.153690 9498 leader_election.cc:302] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:28.154527 9498 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.154655 9498 leader_election.cc:302] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.155426 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d193edcfa684b8795b084f3106903c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.156209 10066 raft_consensus.cc:2726] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.156627 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.156934 10152 raft_consensus.cc:2726] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.161006 9815 tablet_replica.cc:330] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.161374 9815 raft_consensus.cc:2229] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.162015 9815 raft_consensus.cc:2258] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.163383 9815 ts_tablet_manager.cc:1905] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.172252 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4eeb2aa92a24b628156d34129f1381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.174041 9220 leader_election.cc:302] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:28.179145 8924 master_runner.cc:186] Error getting master registration for 127.8.181.60:39777: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111),
I20260928 14:50:28.179361 8924 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 14:50:28.183864 10205 raft_consensus.cc:2781] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:28.184092 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2c5afbdeda4ddfb82124031135e6cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.187888 10313 log.cc:924] Time spent T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260928 14:50:28.205303 9848 ts_tablet_manager.cc:1428] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.063s user 0.003s sys 0.000s
W20260928 14:50:28.205543 9360 consensus_peers.cc:487] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b47d891c9264a03ac11f50f2b56edad. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:28.205914 9848 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:28.206714 10321 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:28.210381 9855 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.211156 9855 ts_tablet_manager.cc:1397] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.574s user 0.023s sys 0.031s
I20260928 14:50:28.213052 10204 server_base.cc:1034] running on GCE node
I20260928 14:50:28.215724 9815 ts_tablet_manager.cc:1918] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.215871 9815 log.cc:1196] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cf2dd699271542bd9b9604e746686c53
I20260928 14:50:28.216279 9815 ts_tablet_manager.cc:1939] T cf2dd699271542bd9b9604e746686c53 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.217265 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cf2dd699271542bd9b9604e746686c53 (table default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]) successfully deleted
I20260928 14:50:28.218230 9855 raft_consensus.cc:348] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:28.229890 10311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:28.229954 9814 ts_tablet_manager.cc:1918] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:28.230602 10205 raft_consensus.cc:686] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:28.230924 9855 raft_consensus.cc:374] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.231022 9855 raft_consensus.cc:729] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.231477 9855 consensus_queue.cc:260] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.232210 9855 ts_tablet_manager.cc:1428] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260928 14:50:28.232640 9855 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.234146 10204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:28.234900 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a828130854b4e4e8c44b2b45260e50e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.236989 9814 log.cc:1196] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4c101b1f03bb411f963f2348397c03e2
I20260928 14:50:28.238619 10205 consensus_queue.cc:237] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.238428 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 295) took 2813 ms. Trace:
I20260928 14:50:28.239210 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_98675e7b20e64bf6a67470355c440e97" } modify_external_catalogs: true
I20260928 14:50:28.239419 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_98675e7b20e64bf6a67470355c440e97" } modify_external_catalogs: true
I20260928 14:50:28.239769 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f88389a6ed06462ca9081dc83b5ca5c8" } new_table_name: "default.Table_30cbca03b6f14748816af646b024220b" modify_external_catalogs: true
I20260928 14:50:28.239265 9813 rpcz_store.cc:276] 0928 14:50:25.367813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.367863 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:28.130713 (+2762850us) ts_tablet_manager.cc:1145] Deleting tablet 767958659f4f450497eb5f2a3902993e
0928 14:50:28.130725 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.180766 (+ 50041us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2748984}
I20260928 14:50:28.246250 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:28.246714 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:28.247236 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 5f348f9e962748a0992d85b9d3d72aeb deleted and replaced by tablet b6fed86d9eda45cab2083fca73825383
I20260928 14:50:28.248875 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1c54cb0e8f2347d9b139c8766fb61ab1
W20260928 14:50:28.251621 9497 leader_election.cc:341] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.251926 9497 leader_election.cc:302] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.252184 10054 raft_consensus.cc:2726] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:28.254165 9497 consensus_peers.cc:487] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:28.254241 9815 tablet_replica.cc:330] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.254722 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.256213 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d6975813b744fb80dcc432cec61cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.256467 9815 raft_consensus.cc:2229] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.258322 10054 raft_consensus.cc:482] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.258869 10054 raft_consensus.cc:504] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.260053 10204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:28.260030 9815 raft_consensus.cc:2258] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.260298 10054 leader_election.cc:288] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.260668 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.263530 9815 ts_tablet_manager.cc:1905] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.264834 9855 tablet_bootstrap.cc:654] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.269345 10204 hybrid_clock.cc:648] HybridClock initialized: now 1790607028269233 us; error 73 us; skew 500 ppm
I20260928 14:50:28.269834 10204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:28.282066 9855 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.282244 9855 ts_tablet_manager.cc:1397] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.003s
I20260928 14:50:28.282805 10316 raft_consensus.cc:482] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.283139 9855 raft_consensus.cc:348] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.283034 10316 raft_consensus.cc:504] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.283416 9855 raft_consensus.cc:374] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.283629 9855 raft_consensus.cc:729] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.283978 10316 leader_election.cc:288] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:28.283948 9855 consensus_queue.cc:260] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:28.285157 9219 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:28.250412 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d6975813b744fb80dcc432cec61cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.250658 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:28.285902 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 767958659f4f450497eb5f2a3902993e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 767958659f4f450497eb5f2a3902993e already in progress: creating tablet
I20260928 14:50:28.251690 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.261617 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b97883acb4adfa4091653545e894b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:28.286791 9498 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.282245 9848 tablet_bootstrap.cc:654] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.287139 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.290180 9855 ts_tablet_manager.cc:1428] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260928 14:50:28.290313 9815 ts_tablet_manager.cc:1918] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.290611 9815 log.cc:1196] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ee16f4482a424538812f6356655acf77
I20260928 14:50:28.291191 9815 ts_tablet_manager.cc:1939] T ee16f4482a424538812f6356655acf77 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.292200 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ee16f4482a424538812f6356655acf77 (table default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:28.293900 9855 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.298439 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:28.298985 9851 tablet_bootstrap.cc:492] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:28.299216 9815 tablet_replica.cc:330] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.299497 9815 raft_consensus.cc:2229] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.299801 9815 raft_consensus.cc:2258] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.299787 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.288278 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d6975813b744fb80dcc432cec61cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.299271 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b97883acb4adfa4091653545e894b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:28.301512 9497 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.301695 9815 ts_tablet_manager.cc:1905] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.301669 9497 leader_election.cc:302] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.301913 10334 raft_consensus.cc:2726] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.302320 10068 raft_consensus.cc:504] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.302064 9814 ts_tablet_manager.cc:1939] T 4c101b1f03bb411f963f2348397c03e2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:28.304618 9855 tablet_bootstrap.cc:654] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.305778 9851 ts_tablet_manager.cc:1397] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.481s user 0.009s sys 0.011s
I20260928 14:50:28.313226 9855 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.313476 9855 ts_tablet_manager.cc:1397] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20260928 14:50:28.314235 10326 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:28.315006 9855 raft_consensus.cc:348] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.315382 9855 raft_consensus.cc:374] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.315549 9855 raft_consensus.cc:729] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.315780 9855 consensus_queue.cc:260] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.319816 9855 ts_tablet_manager.cc:1428] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260928 14:50:28.321837 9219 consensus_peers.cc:487] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a30439ac5a8485a9b6ebbe1371087b1. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:28.321799 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b5fb99de4a8240cdbda5493a5185ba57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.322441 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5fb99de4a8240cdbda5493a5185ba57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.323434 9855 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.327745 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:28.328490 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c7744794790b441483591e21438133b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.328903 9855 tablet_bootstrap.cc:654] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:28.329034 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7744794790b441483591e21438133b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.329630 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.329829 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.330771 9815 ts_tablet_manager.cc:1918] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.330894 9815 log.cc:1196] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:28.331317 9815 ts_tablet_manager.cc:1939] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.332118 9815 tablet_replica.cc:330] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.332273 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (table default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]) successfully deleted
I20260928 14:50:28.332324 9815 raft_consensus.cc:2229] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.332455 9815 raft_consensus.cc:2258] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.332944 9815 ts_tablet_manager.cc:1905] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.342273 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8520b28899bc42b08e239502adb8fece
I20260928 14:50:28.343081 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.343124 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cefdcbcd585f4698a86a85904f5f2793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.343750 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cefdcbcd585f4698a86a85904f5f2793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.345084 9815 ts_tablet_manager.cc:1918] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.345232 9815 log.cc:1196] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:28.345271 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_13f0b42ecf494238af4b6d0b8e5c865e" } new_table_name: "default.Table_dcca53c9f1de4318950f7f3be0ef227f" modify_external_catalogs: true
I20260928 14:50:28.346923 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c93036c59a7a4b62994b6a2761851a1f" } new_table_name: "default.Table_e762fd7ab0074c308dc4407d3c3f70a9" modify_external_catalogs: true
I20260928 14:50:28.348980 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.349582 9855 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.349718 9855 ts_tablet_manager.cc:1397] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260928 14:50:28.350414 9855 raft_consensus.cc:348] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.350620 9855 raft_consensus.cc:374] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.350708 9855 raft_consensus.cc:729] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.350912 9855 consensus_queue.cc:260] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:28.350553 9219 leader_election.cc:341] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:28.354115 9855 ts_tablet_manager.cc:1428] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:28.355870 10317 raft_consensus.cc:482] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.354843 9851 raft_consensus.cc:348] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.356274 9851 raft_consensus.cc:374] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.357167 9855 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.357312 9851 raft_consensus.cc:729] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.359414 8956 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8503614ae96a48eaa5c394a63dadb0f3
W20260928 14:50:28.359979 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e325cbe459440cfa0f3cf9fd026cbb2 consensus state has no leader
I20260928 14:50:28.360008 9855 tablet_bootstrap.cc:654] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.360725 9285 raft_consensus.cc:2379] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:28.363512 10066 raft_consensus.cc:482] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.363716 9815 ts_tablet_manager.cc:1939] T d004e52539cc49bc8a26f77e0bb182cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.363735 10066 raft_consensus.cc:504] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.364403 10066 leader_election.cc:288] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:28.364806 10068 leader_election.cc:288] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:28.365648 9855 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.365778 9855 ts_tablet_manager.cc:1397] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260928 14:50:28.366818 9855 raft_consensus.cc:348] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.367237 9855 raft_consensus.cc:374] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.367404 9855 raft_consensus.cc:729] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.368355 9815 tablet_replica.cc:330] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.368546 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d004e52539cc49bc8a26f77e0bb182cc (table default.Table_c3faaac521464670a4b981a20d62e237 [id=d3062c0f64294b23abad7e06715e1fd9]) successfully deleted
I20260928 14:50:28.368628 9815 raft_consensus.cc:2229] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.368920 9815 raft_consensus.cc:2258] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.371137 9815 ts_tablet_manager.cc:1905] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.372452 9360 leader_election.cc:302] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:28.372866 10215 raft_consensus.cc:2726] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.373330 9855 consensus_queue.cc:260] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.374073 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.374358 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:28.374977 9498 leader_election.cc:341] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.375877 9855 ts_tablet_manager.cc:1428] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260928 14:50:28.377290 9855 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.371948 9851 consensus_queue.cc:260] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.378078 10204 webserver.cc:460] Webserver started at http://127.8.181.60:33241/ using document root <none> and password file <none>
I20260928 14:50:28.379033 9855 tablet_bootstrap.cc:654] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.380740 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 316) took 2596 ms. Trace:
I20260928 14:50:28.382576 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47ff819255f74f49a1ce0b5588aa03a1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:28.382823 9427 raft_consensus.cc:2379] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate ae832871bd1142f7af10c084115ffc12 in this term.
I20260928 14:50:28.384071 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 296) took 3008 ms. Trace:
I20260928 14:50:28.384232 9813 rpcz_store.cc:276] 0928 14:50:25.375817 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.375867 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:28.383866 (+3007999us) ts_tablet_manager.cc:1145] Deleting tablet c5c6b0867466459ca14413559800ff64
0928 14:50:28.383876 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.384008 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2990374}
I20260928 14:50:28.384636 9848 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:28.384791 9848 ts_tablet_manager.cc:1397] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.179s user 0.005s sys 0.000s
W20260928 14:50:28.384773 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c5c6b0867466459ca14413559800ff64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c6b0867466459ca14413559800ff64 already in progress: creating tablet
I20260928 14:50:28.385195 9813 tablet_replica.cc:330] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:28.385144 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.385432 9813 raft_consensus.cc:2229] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.385310 9814 rpcz_store.cc:276] 0928 14:50:25.768767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.779813 (+ 11046us) service_pool.cc:227] Handling call
0928 14:50:27.559926 (+1780113us) ts_tablet_manager.cc:1145] Deleting tablet 4c101b1f03bb411f963f2348397c03e2
0928 14:50:27.559936 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:27.946467 (+386531us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.180585 (+234118us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.365157 (+184572us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1779219}
I20260928 14:50:28.383589 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.386620 9848 raft_consensus.cc:348] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.386904 9848 raft_consensus.cc:374] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:28.386999 9497 leader_election.cc:341] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.387006 9848 raft_consensus.cc:729] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.387184 9497 leader_election.cc:302] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.387702 10334 raft_consensus.cc:2726] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.387624 9848 consensus_queue.cc:260] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.388161 9848 ts_tablet_manager.cc:1428] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:28.388213 10321 tablet.cc:1722] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:28.388444 9848 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:28.389308 9813 raft_consensus.cc:2258] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.390020 9813 ts_tablet_manager.cc:1905] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.374428 10317 raft_consensus.cc:504] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.395227 9815 ts_tablet_manager.cc:1918] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.395431 9815 log.cc:1196] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:28.396189 9815 ts_tablet_manager.cc:1939] T b65fd0746d1b474e9fbebe6f09053743 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.399258 9855 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.399427 9855 ts_tablet_manager.cc:1397] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260928 14:50:28.400111 9855 raft_consensus.cc:348] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.400336 9855 raft_consensus.cc:374] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.400305 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_273b9098d67f4d168421a50e8e842fb1" } new_table_name: "default.Table_cea129f875fa43ee92facec9a977a47e" modify_external_catalogs: true
I20260928 14:50:28.400482 9855 raft_consensus.cc:729] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.400729 9848 tablet_bootstrap.cc:654] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.400683 9855 consensus_queue.cc:260] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.401206 9855 ts_tablet_manager.cc:1428] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:28.401713 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_229ae6a234c24d09b9f117dd871cc1a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.402230 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_229ae6a234c24d09b9f117dd871cc1a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.402292 9855 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.403753 9855 tablet_bootstrap.cc:654] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.404842 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet a19995a0d8af4d3ca562bade80ce006f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:28.405071 9815 tablet_replica.cc:330] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.405280 9815 raft_consensus.cc:2229] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.405429 9815 raft_consensus.cc:2258] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.405902 9815 ts_tablet_manager.cc:1905] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.405894 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b65fd0746d1b474e9fbebe6f09053743 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:28.406267 9814 tablet_replica.cc:330] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:28.396543 10329 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 14:50:28.406860 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f54c1b1f9054e1c9adfda720784e5a8 consensus state has no leader
I20260928 14:50:28.407123 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet cf9342e920ae48278ab3f3c6d639fc94 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:28.407495 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11f9b039838a430eac3fd422f0f4d087 consensus state has no leader
I20260928 14:50:28.407745 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:28.408376 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d4428f89dc584ff1b0b45384b781c7ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.409058 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4428f89dc584ff1b0b45384b781c7ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.412645 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_50d0ba4738bd4af2b91d2e20e9003556" } new_table_name: "default.Table_4ee63f2eb220459da4d35cfe89592798" modify_external_catalogs: true
I20260928 14:50:28.413471 9851 ts_tablet_manager.cc:1428] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.075s user 0.003s sys 0.000s
I20260928 14:50:28.413618 9814 raft_consensus.cc:2229] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.413956 9220 leader_election.cc:302] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.415015 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6d22a856b02448ecb229ff551f23c22d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.415575 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d22a856b02448ecb229ff551f23c22d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:28.416515 8940 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5e325cbe459440cfa0f3cf9fd026cbb2 consensus state has no leader
I20260928 14:50:28.417443 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4c101b1f03bb411f963f2348397c03e2 (table default.Table_12b926cfeead4b05a434279fb8a0df41 [id=30cfc95166db4e5fab7aac9d7721ec26]) successfully deleted
I20260928 14:50:28.417613 9855 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.417766 9855 ts_tablet_manager.cc:1397] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
W20260928 14:50:28.417433 9219 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:28.418450 9814 raft_consensus.cc:2258] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.418637 9855 raft_consensus.cc:348] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.419142 9814 ts_tablet_manager.cc:1905] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.418864 9855 raft_consensus.cc:374] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.419915 9855 raft_consensus.cc:729] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.420203 9855 consensus_queue.cc:260] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.421087 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_03bb5b055caf49f080ec90feb2a90fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.421643 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03bb5b055caf49f080ec90feb2a90fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.422014 9855 ts_tablet_manager.cc:1428] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:28.422192 10204 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:28.423089 9855 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.423286 10204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:28.422976 10317 leader_election.cc:288] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:28.423782 10317 raft_consensus.cc:2726] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.423094 10068 raft_consensus.cc:482] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.424065 9851 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:28.424774 9855 tablet_bootstrap.cc:654] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:28.424672 9220 leader_election.cc:341] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:28.427028 9815 ts_tablet_manager.cc:1918] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.427165 9815 log.cc:1196] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7cc4c49a4962473699103528b64a1005
I20260928 14:50:28.427497 9815 ts_tablet_manager.cc:1939] T 7cc4c49a4962473699103528b64a1005 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.428521 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7cc4c49a4962473699103528b64a1005 (table default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]) successfully deleted
I20260928 14:50:28.428853 9815 tablet_replica.cc:330] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.429116 9815 raft_consensus.cc:2229] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.429391 9815 raft_consensus.cc:2258] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.430205 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:28.430156 10068 raft_consensus.cc:504] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:28.430670 8955 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 254ab608221e4fe2bc459f9d6fee925a consensus state has no leader
I20260928 14:50:28.429909 9815 ts_tablet_manager.cc:1905] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:28.433835 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8af72ac7bedb4cd7aed28cffda867c96 consensus state has no leader
I20260928 14:50:28.433873 10068 leader_election.cc:288] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:28.435139 9220 leader_election.cc:302] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.437325 9534 tablet_service.cc:1467] Processing CreateTablet for tablet c51f5944c6534e9492594c39ae9796b2 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.437757 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c51f5944c6534e9492594c39ae9796b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.438558 10068 raft_consensus.cc:2726] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:28.438804 9219 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9d6dc266ab8248d381e4850179455795
I20260928 14:50:28.440959 9855 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.441115 9855 ts_tablet_manager.cc:1397] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
W20260928 14:50:28.441480 9220 leader_election.cc:341] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:28.441823 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 (DEFAULT_TABLE table=default.Table_273b9098d67f4d168421a50e8e842fb1 [id=a4802fba8b2c4291864aaa9ce687f468]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.441954 9255 tablet_service.cc:1467] Processing CreateTablet for tablet c51f5944c6534e9492594c39ae9796b2 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.442060 9855 raft_consensus.cc:348] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.442273 9855 raft_consensus.cc:374] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.442345 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af72ac7bedb4cd7aed28cffda867c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.442386 9855 raft_consensus.cc:729] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.442358 9220 leader_election.cc:302] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.442636 9855 consensus_queue.cc:260] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.443224 9855 ts_tablet_manager.cc:1428] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:28.443425 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c51f5944c6534e9492594c39ae9796b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.443610 9851 tablet_bootstrap.cc:654] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.443871 10068 raft_consensus.cc:2726] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.443920 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 (DEFAULT_TABLE table=default.Table_273b9098d67f4d168421a50e8e842fb1 [id=a4802fba8b2c4291864aaa9ce687f468]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.444305 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af72ac7bedb4cd7aed28cffda867c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.444245 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d (DEFAULT_TABLE table=default.Table_ab677e004fee49e4882b664fb17465d4 [id=0a4962670d0a43b2aac92a73a5fb69cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.444574 9855 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.444914 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4744deca899b4e6caa57f70ce1df8a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.446328 9855 tablet_bootstrap.cc:654] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.448238 10152 raft_consensus.cc:482] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.448414 10152 raft_consensus.cc:504] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.448671 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 4a14c0b50cad4954b5dc5666689810ba (DEFAULT_TABLE table=default.Table_c7687d91f40d47c99ca2f22db2dd127d [id=c3261b896b04437fa936a693b88a6e01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.449056 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a14c0b50cad4954b5dc5666689810ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.449200 10152 leader_election.cc:288] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.448251 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d (DEFAULT_TABLE table=default.Table_ab677e004fee49e4882b664fb17465d4 [id=0a4962670d0a43b2aac92a73a5fb69cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.449875 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06859c8dcc41d99d29365aae350afa (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.449991 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4744deca899b4e6caa57f70ce1df8a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.450384 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06859c8dcc41d99d29365aae350afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.450675 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 091600d56fdc469d8b754acd8933808b (table default.Table_85efe0ba6255470f906b736c34b310f8 [id=52b5f678a6ee42beab450c26e91f92da]). Expected version 2 got 0
I20260928 14:50:28.451000 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:28.451195 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 88015bcd867e40e5b9263930e820074a (table default.Table_f3f0e0c6daa54fecb0db72ae6e070f77 [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]). Expected version 2 got 0
I20260928 14:50:28.451380 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]). Expected version 2 got 0
I20260928 14:50:28.458319 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c90b633274d340ef940d83bcbe55c632" } modify_external_catalogs: true
I20260928 14:50:28.458596 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c90b633274d340ef940d83bcbe55c632" } modify_external_catalogs: true
I20260928 14:50:28.462124 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cea129f875fa43ee92facec9a977a47e" } modify_external_catalogs: true
I20260928 14:50:28.462613 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.463008 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a2f051a09e143b8bb0ba3be81406b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.463889 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85735981779438197f2c0f489681b96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.465844 9537 tablet_service.cc:1467] Processing CreateTablet for tablet e59b8e736b6d4644a78a6d7570746e18 (DEFAULT_TABLE table=default.Table_3cda8f50c2ba4f1f82d4a182c7e76119 [id=db3c037ac7784283bb5dc67c99a4b73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.466192 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59b8e736b6d4644a78a6d7570746e18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.468276 9497 leader_election.cc:341] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.468580 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f (DEFAULT_TABLE table=default.Table_26335d95c12a46e9a45f92335c09a089 [id=c7da048bc94343ceb9f28c8b810d8505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.468750 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 846a96509f32416087ee4667458c367e (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.469135 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.469421 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846a96509f32416087ee4667458c367e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.469794 9536 tablet_service.cc:1467] Processing CreateTablet for tablet eb9c9ea18f2046a080aca899f51f6759 (DEFAULT_TABLE table=default.Table_82216fdff1d445ae8f1c198844a9f2a9 [id=62ae0752cb544610aa2f7645bbcd92d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.470189 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9c9ea18f2046a080aca899f51f6759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.472330 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cea129f875fa43ee92facec9a977a47e" } modify_external_catalogs: true
I20260928 14:50:28.473657 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06859c8dcc41d99d29365aae350afa (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.474076 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06859c8dcc41d99d29365aae350afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.476926 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6dc266ab8248d381e4850179455795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.477159 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 4a14c0b50cad4954b5dc5666689810ba (DEFAULT_TABLE table=default.Table_c7687d91f40d47c99ca2f22db2dd127d [id=c3261b896b04437fa936a693b88a6e01]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.480633 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 consensus state has no leader
I20260928 14:50:28.486514 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a14c0b50cad4954b5dc5666689810ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.487387 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet 8218bc963a9941a49e8329d0a04d8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.489650 10215 raft_consensus.cc:482] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.490103 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:28.490471 8946 catalog_manager.cc:6565] ReplaceTablet: tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 deleted and replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f
I20260928 14:50:28.491102 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cf9342e920ae48278ab3f3c6d639fc94
I20260928 14:50:28.491449 8950 catalog_manager.cc:6565] ReplaceTablet: tablet cf9342e920ae48278ab3f3c6d639fc94 deleted and replaced by tablet ab6ccac2580049a5a615d8d36a44f373
I20260928 14:50:28.491765 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:28.493249 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8af72ac7bedb4cd7aed28cffda867c96
I20260928 14:50:28.493556 8949 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_7d735ceca02945adafa0d6e0606ff717 [id=758c0941b029421d8f865d8600a17049] alter complete (version 1)
I20260928 14:50:28.495466 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.495818 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a2f051a09e143b8bb0ba3be81406b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.496631 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f (DEFAULT_TABLE table=default.Table_26335d95c12a46e9a45f92335c09a089 [id=c7da048bc94343ceb9f28c8b810d8505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.496721 9252 tablet_service.cc:1467] Processing CreateTablet for tablet e59b8e736b6d4644a78a6d7570746e18 (DEFAULT_TABLE table=default.Table_3cda8f50c2ba4f1f82d4a182c7e76119 [id=db3c037ac7784283bb5dc67c99a4b73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.500152 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.500192 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 846a96509f32416087ee4667458c367e (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.500555 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846a96509f32416087ee4667458c367e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.501425 9256 tablet_service.cc:1467] Processing CreateTablet for tablet eb9c9ea18f2046a080aca899f51f6759 (DEFAULT_TABLE table=default.Table_82216fdff1d445ae8f1c198844a9f2a9 [id=62ae0752cb544610aa2f7645bbcd92d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.501678 9815 ts_tablet_manager.cc:1918] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.501808 9815 log.cc:1196] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:28.502211 9815 ts_tablet_manager.cc:1939] T f3ac8adb23c5478fadb6cb6765459913 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.503051 9815 tablet_replica.cc:330] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.503260 9815 raft_consensus.cc:2229] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.503424 9815 raft_consensus.cc:2258] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.503949 9815 ts_tablet_manager.cc:1905] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.505489 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59b8e736b6d4644a78a6d7570746e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.505576 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.507411 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f3ac8adb23c5478fadb6cb6765459913 (table default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]) successfully deleted
I20260928 14:50:28.509464 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.509641 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.509828 10215 raft_consensus.cc:504] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:28.509872 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85735981779438197f2c0f489681b96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:28.510553 9498 leader_election.cc:341] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.510694 9498 leader_election.cc:302] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.511148 10066 raft_consensus.cc:2726] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.511209 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.511433 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.511638 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.511822 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.512081 10215 leader_election.cc:288] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:28.512123 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c51f5944c6534e9492594c39ae9796b2 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.512431 9360 consensus_peers.cc:487] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:28.513140 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.513418 9815 ts_tablet_manager.cc:1918] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.513572 9815 log.cc:1196] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:28.513896 9815 ts_tablet_manager.cc:1939] T 999aa56f1683464d9612a2ddbfbebbda P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.514791 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 999aa56f1683464d9612a2ddbfbebbda (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:28.515475 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.517208 9815 tablet_replica.cc:330] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.517426 9815 raft_consensus.cc:2229] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.517614 9815 raft_consensus.cc:2258] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.517948 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6dc266ab8248d381e4850179455795" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.518127 9815 ts_tablet_manager.cc:1905] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.424863 10348 tablet.cc:1722] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:28.519351 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 (DEFAULT_TABLE table=default.Table_273b9098d67f4d168421a50e8e842fb1 [id=a4802fba8b2c4291864aaa9ce687f468]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.520316 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 109361us
I20260928 14:50:28.522833 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 4a14c0b50cad4954b5dc5666689810ba (DEFAULT_TABLE table=default.Table_c7687d91f40d47c99ca2f22db2dd127d [id=c3261b896b04437fa936a693b88a6e01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.523373 10215 raft_consensus.cc:482] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.523572 10215 raft_consensus.cc:504] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.524219 10215 leader_election.cc:288] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.524459 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af72ac7bedb4cd7aed28cffda867c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.526082 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a14c0b50cad4954b5dc5666689810ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.529968 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a7caeee85f464e589dd70456b01066c0" } modify_external_catalogs: true
I20260928 14:50:28.530185 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a7caeee85f464e589dd70456b01066c0" } modify_external_catalogs: true
I20260928 14:50:28.530316 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d (DEFAULT_TABLE table=default.Table_ab677e004fee49e4882b664fb17465d4 [id=0a4962670d0a43b2aac92a73a5fb69cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.534264 10204 fs_manager.cc:709] Time spent opening directory manager: real 0.025s user 0.003s sys 0.002s
I20260928 14:50:28.534402 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet f1dacb0eef514609bcaf503ccc9845e3 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:28.537685 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c51f5944c6534e9492594c39ae9796b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.542466 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 82a58b7387564863a2141a722003c5d1
I20260928 14:50:28.539670 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4744deca899b4e6caa57f70ce1df8a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.540071 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06859c8dcc41d99d29365aae350afa (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.542096 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.542654 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:28.539767 9360 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 03245f72e0aa496d895968d8e5715b56
I20260928 14:50:28.546583 9397 tablet_service.cc:1467] Processing CreateTablet for tablet eb9c9ea18f2046a080aca899f51f6759 (DEFAULT_TABLE table=default.Table_82216fdff1d445ae8f1c198844a9f2a9 [id=62ae0752cb544610aa2f7645bbcd92d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.547200 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f1dacb0eef514609bcaf503ccc9845e3
I20260928 14:50:28.547652 8949 catalog_manager.cc:6565] ReplaceTablet: tablet f1dacb0eef514609bcaf503ccc9845e3 deleted and replaced by tablet 9ca013d1c5b44730b7163e71dc408b04
I20260928 14:50:28.547617 9393 tablet_service.cc:1467] Processing CreateTablet for tablet e59b8e736b6d4644a78a6d7570746e18 (DEFAULT_TABLE table=default.Table_3cda8f50c2ba4f1f82d4a182c7e76119 [id=db3c037ac7784283bb5dc67c99a4b73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.547950 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 846a96509f32416087ee4667458c367e (DEFAULT_TABLE table=default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.548377 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.550274 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06859c8dcc41d99d29365aae350afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.550546 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_520e7cce9fb941bbb5019c3c73d1132f" } modify_external_catalogs: true
I20260928 14:50:28.550724 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_520e7cce9fb941bbb5019c3c73d1132f" } modify_external_catalogs: true
I20260928 14:50:28.550966 10356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260928 14:50:28.551250 9360 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:28.552037 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dad1b85ab48345fbb7e8642eed1cc48d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.552361 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59b8e736b6d4644a78a6d7570746e18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.552758 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dad1b85ab48345fbb7e8642eed1cc48d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.553678 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9c9ea18f2046a080aca899f51f6759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.554334 10204 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.006s sys 0.003s
I20260928 14:50:28.554661 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846a96509f32416087ee4667458c367e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.555213 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a2f051a09e143b8bb0ba3be81406b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.555403 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_272ffcd346ae4b539727e6e5312c89ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.555888 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_272ffcd346ae4b539727e6e5312c89ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.554666 10204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
uuid: "c6b99976d8024a79a0603523b9d32f29"
format_stamp: "Formatted at 2026-09-28 14:50:16 on dist-test-slave-g607"
I20260928 14:50:28.557919 10204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:28.559520 9529 tablet_service.cc:1467] Processing CreateTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 (DEFAULT_TABLE table=default.Table_cefdcbcd585f4698a86a85904f5f2793 [id=74184a3b7e154ab8aba9191c450de754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.559981 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5cb151d58f545d9b1e6f652a0627ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.562906 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e762fd7ab0074c308dc4407d3c3f70a9" } modify_external_catalogs: true
I20260928 14:50:28.563104 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e762fd7ab0074c308dc4407d3c3f70a9" } modify_external_catalogs: true
I20260928 14:50:28.563154 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5325bfedb92641f799564a45fa0f40b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.563591 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5325bfedb92641f799564a45fa0f40b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.564375 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0fec5d22085a418188e9d10f1798ebf4" } new_table_name: "default.Table_4184ff7f97d64119a5a80a7baf746830" modify_external_catalogs: true
I20260928 14:50:28.567214 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.567662 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.567924 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.568148 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.568545 9396 tablet_service.cc:1467] Processing CreateTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 (DEFAULT_TABLE table=default.Table_cefdcbcd585f4698a86a85904f5f2793 [id=74184a3b7e154ab8aba9191c450de754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.541119 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f (DEFAULT_TABLE table=default.Table_26335d95c12a46e9a45f92335c09a089 [id=c7da048bc94343ceb9f28c8b810d8505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.569119 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.569406 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:28.569559 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5cb151d58f545d9b1e6f652a0627ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.570761 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.573083 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.575628 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9c9ea18f2046a080aca899f51f6759. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.577207 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.578713 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 11f9b039838a430eac3fd422f0f4d087
W20260928 14:50:28.579465 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1016ad6219294ccd829fca9b264ab06f consensus state has no leader
I20260928 14:50:28.579625 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.580020 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.587598 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.589591 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 666de9dd64734708b35738605204ed7d (DEFAULT_TABLE table=default.Table_c7744794790b441483591e21438133b5 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.590035 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 666de9dd64734708b35738605204ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.590714 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.591153 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 666de9dd64734708b35738605204ed7d (DEFAULT_TABLE table=default.Table_c7744794790b441483591e21438133b5 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.591604 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 666de9dd64734708b35738605204ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.592641 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b6fed86d9eda45cab2083fca73825383 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.592991 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa393b1fc2b40ebb87df86180717db8 (DEFAULT_TABLE table=default.Table_a0970a2d63544b6da80d91d68a45226e [id=a325eabc142d47b88dae65aaba6082c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.593673 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 (DEFAULT_TABLE table=default.Table_69359a2fb5f541a5a6f13af1a82119b2 [id=796bdf7268ff407d9c87a2c0487e18ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.593954 9399 tablet_service.cc:1467] Processing CreateTablet for tablet b14339044619424c9be020fa99ad681e (DEFAULT_TABLE table=default.Table_04a048509ef24182a5ba414faa2066d8 [id=921a3c5cf74b41b6bde6987563b81319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.594240 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6fed86d9eda45cab2083fca73825383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.594421 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b14339044619424c9be020fa99ad681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.594722 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.591523 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 1016ad6219294ccd829fca9b264ab06f (DEFAULT_TABLE table=default.Table_4184ff7f97d64119a5a80a7baf746830 [id=d530e32c2df249aea93ebf2a3cbfb968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.595088 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f02364b809f4e1c8d558f121d4d88b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.595152 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1016ad6219294ccd829fca9b264ab06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.601635 9405 tablet_service.cc:1467] Processing CreateTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a (DEFAULT_TABLE table=default.Table_b5fb99de4a8240cdbda5493a5185ba57 [id=0fe8de98dfb54d84912d74fec349c41b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.602010 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4f5da7a6b4a4e867d4e260a274d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.606202 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa393b1fc2b40ebb87df86180717db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.609766 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f4b20a5e784d909f7297cc7f1b05e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.610368 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.613947 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 (DEFAULT_TABLE table=default.Table_69359a2fb5f541a5a6f13af1a82119b2 [id=796bdf7268ff407d9c87a2c0487e18ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.601595 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03245f72e0aa496d895968d8e5715b56" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.614315 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa393b1fc2b40ebb87df86180717db8 (DEFAULT_TABLE table=default.Table_a0970a2d63544b6da80d91d68a45226e [id=a325eabc142d47b88dae65aaba6082c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.614420 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f4b20a5e784d909f7297cc7f1b05e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.614693 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa393b1fc2b40ebb87df86180717db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.610818 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf10326ec24b99ae2ab1ba8779d1a3" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:28.621387 9360 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.621654 9360 leader_election.cc:302] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:28.622231 9360 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.622341 9360 leader_election.cc:302] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:28.622720 10189 raft_consensus.cc:2726] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.622942 10189 raft_consensus.cc:2726] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.624197 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 1016ad6219294ccd829fca9b264ab06f (DEFAULT_TABLE table=default.Table_4184ff7f97d64119a5a80a7baf746830 [id=d530e32c2df249aea93ebf2a3cbfb968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.624678 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 (DEFAULT_TABLE table=default.Table_69359a2fb5f541a5a6f13af1a82119b2 [id=796bdf7268ff407d9c87a2c0487e18ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.624684 9536 tablet_service.cc:1467] Processing CreateTablet for tablet b6fed86d9eda45cab2083fca73825383 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.624993 9220 leader_election.cc:341] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: Tablet not RUNNING: STOPPED
I20260928 14:50:28.625105 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6fed86d9eda45cab2083fca73825383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.625424 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 1016ad6219294ccd829fca9b264ab06f (DEFAULT_TABLE table=default.Table_4184ff7f97d64119a5a80a7baf746830 [id=d530e32c2df249aea93ebf2a3cbfb968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.625449 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa393b1fc2b40ebb87df86180717db8 (DEFAULT_TABLE table=default.Table_a0970a2d63544b6da80d91d68a45226e [id=a325eabc142d47b88dae65aaba6082c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.625664 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.625837 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 666de9dd64734708b35738605204ed7d (DEFAULT_TABLE table=default.Table_c7744794790b441483591e21438133b5 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.625963 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 7a70f70162c2433aab5136514bd5fc03 (DEFAULT_TABLE table=default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c [id=666ea3e778c24323b14a49f198718eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.626024 9267 tablet_service.cc:1467] Processing CreateTablet for tablet b6fed86d9eda45cab2083fca73825383 (DEFAULT_TABLE table=default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.626327 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a70f70162c2433aab5136514bd5fc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.626670 9253 tablet_service.cc:1467] Processing CreateTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 (DEFAULT_TABLE table=default.Table_cefdcbcd585f4698a86a85904f5f2793 [id=74184a3b7e154ab8aba9191c450de754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.627442 9814 ts_tablet_manager.cc:1918] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.627580 9814 log.cc:1196] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ce25abb4559241f58054f27435fd6078
I20260928 14:50:28.628274 9814 ts_tablet_manager.cc:1939] T ce25abb4559241f58054f27435fd6078 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:28.628245 9530 tablet_service.cc:1467] Processing CreateTablet for tablet b14339044619424c9be020fa99ad681e (DEFAULT_TABLE table=default.Table_04a048509ef24182a5ba414faa2066d8 [id=921a3c5cf74b41b6bde6987563b81319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.628299 9395 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5877a52264f0e9ebb070792e39e55 (DEFAULT_TABLE table=default.Table_272ffcd346ae4b539727e6e5312c89ba [id=a2ce402620b04755ac7ff07c9f40851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.628614 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b14339044619424c9be020fa99ad681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.628691 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5877a52264f0e9ebb070792e39e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.628960 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.629089 9538 tablet_service.cc:1467] Processing CreateTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a (DEFAULT_TABLE table=default.Table_b5fb99de4a8240cdbda5493a5185ba57 [id=0fe8de98dfb54d84912d74fec349c41b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.629699 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f4b20a5e784d909f7297cc7f1b05e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.631074 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.629483 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4f5da7a6b4a4e867d4e260a274d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.639828 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 (DEFAULT_TABLE table=default.Table_5325bfedb92641f799564a45fa0f40b6 [id=d028a977d3164064bd0d2671c828119d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.640319 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 835ba6c803a34707b77bb8bc280b9e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.645637 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 666de9dd64734708b35738605204ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.647593 9851 tablet_bootstrap.cc:492] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:28.647653 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6fed86d9eda45cab2083fca73825383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.647912 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1016ad6219294ccd829fca9b264ab06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.648818 9851 ts_tablet_manager.cc:1397] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.232s user 0.009s sys 0.006s
I20260928 14:50:28.649726 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.651574 9851 raft_consensus.cc:348] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.651955 9220 leader_election.cc:302] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.654335 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 318) took 2778 ms. Trace:
I20260928 14:50:28.654213 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ebdec478d58042548c75729bd5b6c7c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.654840 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebdec478d58042548c75729bd5b6c7c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.655032 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aeb307bca9f04e3fba16a493beb31b91" } new_table_name: "default.Table_ad1ea40cde8748a3801f5825208eeac1" modify_external_catalogs: true
I20260928 14:50:28.656105 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5b5e5d62d87d4917a33183603d3f1859" } new_table_name: "default.Table_2969f92d404942518e3feadd54948444" modify_external_catalogs: true
I20260928 14:50:28.656257 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f437d450119b40f5af9c5e4f167cd36e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.656944 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f437d450119b40f5af9c5e4f167cd36e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.657738 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_82216fdff1d445ae8f1c198844a9f2a9" } new_table_name: "default.Table_70b9cb8130704fd18757a75e660fdff0" modify_external_catalogs: true
I20260928 14:50:28.658433 8948 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]). Expected version 2 got 0
I20260928 14:50:28.661850 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c (DEFAULT_TABLE table=default.Table_dad1b85ab48345fbb7e8642eed1cc48d [id=35bead5cfc8549dc874c2ddd78a10fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.661918 10066 raft_consensus.cc:482] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.662184 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bb9c7fc599425484fd3fc0b94f3a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.662074 10066 raft_consensus.cc:504] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.662748 10066 leader_election.cc:288] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.663530 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9648be4c626e44e0986c196704483955" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:28.664408 9498 leader_election.cc:341] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:28.666047 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52993ae8b63d4fbaa8cf38720af3dea5 consensus state has no leader
W20260928 14:50:28.666945 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4eeb2aa92a24b628156d34129f1381c consensus state has no leader
I20260928 14:50:28.667392 9390 tablet_service.cc:1467] Processing CreateTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 (DEFAULT_TABLE table=default.Table_d4428f89dc584ff1b0b45384b781c7ff [id=fc2da5874632462ca86a70d742522108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.667748 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cf2eb5b59649e099da1947c4ccf430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.669203 9813 ts_tablet_manager.cc:1918] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.669337 9813 log.cc:1196] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9d6dc266ab8248d381e4850179455795
I20260928 14:50:28.670302 9813 ts_tablet_manager.cc:1939] T 9d6dc266ab8248d381e4850179455795 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:28.671118 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 311) took 3110 ms. Trace:
I20260928 14:50:28.671258 9813 rpcz_store.cc:276] 0928 14:50:25.560220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.569692 (+ 9472us) service_pool.cc:227] Handling call
0928 14:50:28.385113 (+2815421us) ts_tablet_manager.cc:1145] Deleting tablet 9d6dc266ab8248d381e4850179455795
0928 14:50:28.385123 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.532643 (+147520us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.669070 (+136427us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.671084 (+ 2014us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2815148}
I20260928 14:50:28.671715 9813 tablet_replica.cc:330] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:28.671916 9813 raft_consensus.cc:2229] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:28.672094 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c (DEFAULT_TABLE table=default.Table_dad1b85ab48345fbb7e8642eed1cc48d [id=35bead5cfc8549dc874c2ddd78a10fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.672094 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 (DEFAULT_TABLE table=default.Table_5325bfedb92641f799564a45fa0f40b6 [id=d028a977d3164064bd0d2671c828119d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.672322 9813 raft_consensus.cc:2258] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.672725 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9d6dc266ab8248d381e4850179455795 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:28.672740 9536 tablet_service.cc:1467] Processing CreateTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 (DEFAULT_TABLE table=default.Table_d4428f89dc584ff1b0b45384b781c7ff [id=fc2da5874632462ca86a70d742522108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.673226 9813 ts_tablet_manager.cc:1905] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.673687 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 5b171a26e7e643c9bc98c580b7bae60f (DEFAULT_TABLE table=default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.674875 9549 tablet_service.cc:1467] Processing CreateTablet for tablet c163d657ec4f40598d7f4f3879e6d817 (DEFAULT_TABLE table=default.Table_03bb5b055caf49f080ec90feb2a90fd0 [id=c8176e349a7d43b19cf1ab3e7c7c987b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.675886 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d (DEFAULT_TABLE table=default.Table_6d22a856b02448ecb229ff551f23c22d [id=ad213ed249fa48f087d0f12f32893689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.676061 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.676520 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 5b171a26e7e643c9bc98c580b7bae60f (DEFAULT_TABLE table=default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.676851 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b171a26e7e643c9bc98c580b7bae60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.677583 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 9ca013d1c5b44730b7163e71dc408b04 (DEFAULT_TABLE table=default.Table_ab3bd6d5c946451699ce00e5a839a2d0 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.679682 9542 tablet_service.cc:1467] Processing CreateTablet for tablet ab6ccac2580049a5a615d8d36a44f373 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.679837 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb9c9ea18f2046a080aca899f51f6759 consensus state has no leader
I20260928 14:50:28.680176 10068 raft_consensus.cc:2726] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.680569 9851 raft_consensus.cc:374] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.680680 9851 raft_consensus.cc:729] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.684541 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e74879f8be614d689d6faef67df823f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.685070 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e74879f8be614d689d6faef67df823f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.672784 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 835ba6c803a34707b77bb8bc280b9e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.686874 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.691975 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4ee40fce2b0d4e6e8f274c932bd6fefe" } new_table_name: "default.Table_05205c49cc5d404d922ebef15030f7a6" modify_external_catalogs: true
I20260928 14:50:28.692185 9851 consensus_queue.cc:260] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.692809 9851 ts_tablet_manager.cc:1428] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20260928 14:50:28.703331 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b171a26e7e643c9bc98c580b7bae60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.703306 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c163d657ec4f40598d7f4f3879e6d817 (DEFAULT_TABLE table=default.Table_03bb5b055caf49f080ec90feb2a90fd0 [id=c8176e349a7d43b19cf1ab3e7c7c987b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:28.703760 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7aa9167742a94a0ab586e15205a0ccdc consensus state has no leader
I20260928 14:50:28.703874 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 7a70f70162c2433aab5136514bd5fc03 (DEFAULT_TABLE table=default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c [id=666ea3e778c24323b14a49f198718eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.704514 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c163d657ec4f40598d7f4f3879e6d817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.706017 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cf2eb5b59649e099da1947c4ccf430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.705227 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a41dbf3f70674d78a5963e7f82f8680e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.706532 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a41dbf3f70674d78a5963e7f82f8680e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.707887 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d (DEFAULT_TABLE table=default.Table_6d22a856b02448ecb229ff551f23c22d [id=ad213ed249fa48f087d0f12f32893689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.710141 9255 tablet_service.cc:1467] Processing CreateTablet for tablet b14339044619424c9be020fa99ad681e (DEFAULT_TABLE table=default.Table_04a048509ef24182a5ba414faa2066d8 [id=921a3c5cf74b41b6bde6987563b81319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.710534 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c163d657ec4f40598d7f4f3879e6d817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.713165 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fc92b51b52204e60b316163867152d8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.713586 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6ccac2580049a5a615d8d36a44f373. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.713718 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc92b51b52204e60b316163867152d8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.717697 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ca013d1c5b44730b7163e71dc408b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.719506 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 77396c87dbe84f38967ee0d7c898fa9c (DEFAULT_TABLE table=default.Table_229ae6a234c24d09b9f117dd871cc1a8 [id=c730c5bdfb0b48a1bc3935e8fdfc3bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.720158 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77396c87dbe84f38967ee0d7c898fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.721290 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c (DEFAULT_TABLE table=default.Table_dad1b85ab48345fbb7e8642eed1cc48d [id=35bead5cfc8549dc874c2ddd78a10fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.725646 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bb9c7fc599425484fd3fc0b94f3a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.726987 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_795852c44f3e445fb688726c11fb5c42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.727551 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_795852c44f3e445fb688726c11fb5c42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.727993 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 9ca013d1c5b44730b7163e71dc408b04 (DEFAULT_TABLE table=default.Table_ab3bd6d5c946451699ce00e5a839a2d0 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.730778 9397 tablet_service.cc:1467] Processing CreateTablet for tablet ab6ccac2580049a5a615d8d36a44f373 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.731118 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.731366 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.731864 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ca013d1c5b44730b7163e71dc408b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.733342 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa393b1fc2b40ebb87df86180717db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.734000 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 9ca013d1c5b44730b7163e71dc408b04 (DEFAULT_TABLE table=default.Table_ab3bd6d5c946451699ce00e5a839a2d0 [id=406fbbcbe232457bbe03bfe66ec127f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.734223 10068 raft_consensus.cc:482] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.734535 9262 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5877a52264f0e9ebb070792e39e55 (DEFAULT_TABLE table=default.Table_272ffcd346ae4b539727e6e5312c89ba [id=a2ce402620b04755ac7ff07c9f40851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.736017 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 7a70f70162c2433aab5136514bd5fc03 (DEFAULT_TABLE table=default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c [id=666ea3e778c24323b14a49f198718eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.737066 10068 raft_consensus.cc:504] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.738291 10068 leader_election.cc:288] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:28.738397 9257 tablet_service.cc:1467] Processing CreateTablet for tablet c163d657ec4f40598d7f4f3879e6d817 (DEFAULT_TABLE table=default.Table_03bb5b055caf49f080ec90feb2a90fd0 [id=c8176e349a7d43b19cf1ab3e7c7c987b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.722607 9814 rpcz_store.cc:276] 0928 14:50:25.868922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.868979 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:28.385697 (+2516718us) ts_tablet_manager.cc:1145] Deleting tablet ce25abb4559241f58054f27435fd6078
0928 14:50:28.385707 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.438202 (+ 52495us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.622650 (+184448us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.647228 (+ 24578us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2516436}
I20260928 14:50:28.740217 10205 consensus_queue.cc:1035] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260928 14:50:28.740269 9545 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5877a52264f0e9ebb070792e39e55 (DEFAULT_TABLE table=default.Table_272ffcd346ae4b539727e6e5312c89ba [id=a2ce402620b04755ac7ff07c9f40851b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.738423 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9648be4c626e44e0986c196704483955" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.741822 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 5b171a26e7e643c9bc98c580b7bae60f (DEFAULT_TABLE table=default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.744920 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a70f70162c2433aab5136514bd5fc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.744875 9263 tablet_service.cc:1467] Processing CreateTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 (DEFAULT_TABLE table=default.Table_d4428f89dc584ff1b0b45384b781c7ff [id=fc2da5874632462ca86a70d742522108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.748597 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 (DEFAULT_TABLE table=default.Table_5325bfedb92641f799564a45fa0f40b6 [id=d028a977d3164064bd0d2671c828119d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.751924 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5cb151d58f545d9b1e6f652a0627ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.752421 9265 tablet_service.cc:1467] Processing CreateTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a (DEFAULT_TABLE table=default.Table_b5fb99de4a8240cdbda5493a5185ba57 [id=0fe8de98dfb54d84912d74fec349c41b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.752672 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5877a52264f0e9ebb070792e39e55. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:28.753643 9497 leader_election.cc:341] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.754382 9851 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:28.754796 9256 tablet_service.cc:1467] Processing CreateTablet for tablet ab6ccac2580049a5a615d8d36a44f373 (DEFAULT_TABLE table=default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.754904 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 77396c87dbe84f38967ee0d7c898fa9c (DEFAULT_TABLE table=default.Table_229ae6a234c24d09b9f117dd871cc1a8 [id=c730c5bdfb0b48a1bc3935e8fdfc3bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.755386 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d (DEFAULT_TABLE table=default.Table_6d22a856b02448ecb229ff551f23c22d [id=ad213ed249fa48f087d0f12f32893689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.755646 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 835ba6c803a34707b77bb8bc280b9e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.756302 9855 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:28.757124 9219 leader_election.cc:341] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8218bc963a9941a49e8329d0a04d8252
I20260928 14:50:28.757628 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 323) took 2867 ms. Trace:
I20260928 14:50:28.753489 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 77396c87dbe84f38967ee0d7c898fa9c (DEFAULT_TABLE table=default.Table_229ae6a234c24d09b9f117dd871cc1a8 [id=c730c5bdfb0b48a1bc3935e8fdfc3bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:28.758795 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77396c87dbe84f38967ee0d7c898fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.759446 10215 raft_consensus.cc:482] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.760212 9855 ts_tablet_manager.cc:1397] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.312s user 0.046s sys 0.013s
I20260928 14:50:28.763288 9814 rpcz_store.cc:276] 0928 14:50:25.885620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.885665 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:28.739420 (+2853755us) ts_tablet_manager.cc:1145] Deleting tablet a19995a0d8af4d3ca562bade80ce006f
0928 14:50:28.751377 (+ 11957us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x618000005118. stack: 00007fdd1550c66e 00007fdd1550c430 00007fdd145935ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fdd155020fd 00007fdd1550316e 00007fdd28457cfd 00007fdd283d5883 00007fdd246756e6 00007fdd24676a37 00007fdd246a9404 00007fdd2468a870 00007fdd2468a5fd 00000000009edb7c
0928 14:50:28.751387 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.753335 (+ 1948us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4066048,"tablet-delete.queue_time_us":2853546}
I20260928 14:50:28.763728 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 324) took 2877 ms. Trace:
I20260928 14:50:28.763844 9814 rpcz_store.cc:276] 0928 14:50:25.886475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.886531 (+ 56us) service_pool.cc:227] Handling call
0928 14:50:28.763590 (+2877059us) ts_tablet_manager.cc:1145] Deleting tablet 41b8584ba1914c3390aee99baaee289e
0928 14:50:28.763600 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.763690 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2876842}
I20260928 14:50:28.764226 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 325) took 2864 ms. Trace:
I20260928 14:50:28.764335 9814 rpcz_store.cc:276] 0928 14:50:25.900132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.900179 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:28.764110 (+2863931us) ts_tablet_manager.cc:1145] Deleting tablet b65fd0746d1b474e9fbebe6f09053743
0928 14:50:28.764119 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.764196 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863682}
I20260928 14:50:28.764669 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 326) took 2863 ms. Trace:
I20260928 14:50:28.764770 9814 rpcz_store.cc:276] 0928 14:50:25.901484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.901555 (+ 71us) service_pool.cc:227] Handling call
0928 14:50:28.764529 (+2862974us) ts_tablet_manager.cc:1145] Deleting tablet 6a828130854b4e4e8c44b2b45260e50e
0928 14:50:28.764538 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.764623 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862791}
I20260928 14:50:28.765038 9814 tablet_replica.cc:330] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:28.765239 9814 raft_consensus.cc:2229] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.765388 9814 raft_consensus.cc:2258] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.770116 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1016ad6219294ccd829fca9b264ab06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.770941 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77396c87dbe84f38967ee0d7c898fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.774087 9814 ts_tablet_manager.cc:1905] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.782166 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6ccac2580049a5a615d8d36a44f373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.781728 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6ccac2580049a5a615d8d36a44f373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.783962 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b171a26e7e643c9bc98c580b7bae60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.784314 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a70f70162c2433aab5136514bd5fc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.784569 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c163d657ec4f40598d7f4f3879e6d817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.784765 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.786415 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cf2eb5b59649e099da1947c4ccf430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.787948 9851 tablet_bootstrap.cc:654] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.788754 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4f5da7a6b4a4e867d4e260a274d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.789170 10215 raft_consensus.cc:504] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.790912 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5877a52264f0e9ebb070792e39e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.792168 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8218bc963a9941a49e8329d0a04d8252" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.793150 10152 raft_consensus.cc:482] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.793351 10152 raft_consensus.cc:504] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.793552 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:28.793924 10066 raft_consensus.cc:482] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.761564 9497 leader_election.cc:302] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.797910 9424 raft_consensus.cc:2379] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:28.798749 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c" } modify_external_catalogs: true
I20260928 14:50:28.798970 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c" } modify_external_catalogs: true
I20260928 14:50:28.799908 10066 raft_consensus.cc:504] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.800477 10066 leader_election.cc:288] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.800594 10054 raft_consensus.cc:2726] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.801759 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.802167 9848 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:28.799485 9855 raft_consensus.cc:348] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.803383 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74388823ef59495e8cc13452d0033e0c" } modify_external_catalogs: true
I20260928 14:50:28.803694 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74388823ef59495e8cc13452d0033e0c" } modify_external_catalogs: true
W20260928 14:50:28.804186 9497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 48410.1us
I20260928 14:50:28.805974 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ca013d1c5b44730b7163e71dc408b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.802109 10215 leader_election.cc:288] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.807965 9220 leader_election.cc:302] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.808935 10152 leader_election.cc:288] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.794910 9567 raft_consensus.cc:2454] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:28.809458 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.809535 9855 raft_consensus.cc:374] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.812216 9855 raft_consensus.cc:729] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:28.815394 9497 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.815451 9855 consensus_queue.cc:260] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.815951 9855 ts_tablet_manager.cc:1428] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.056s user 0.000s sys 0.002s
I20260928 14:50:28.816286 9855 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.817711 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7a70f70162c2433aab5136514bd5fc03
I20260928 14:50:28.818020 9855 tablet_bootstrap.cc:654] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.818375 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b914e3c8243490d92378a8765d6390f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:28.818843 9497 leader_election.cc:341] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.820792 9815 ts_tablet_manager.cc:1918] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.823310 10205 raft_consensus.cc:3037] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:28.827487 9815 log.cc:1196] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c9a7573c751d412aa8394d6277c28b7f
I20260928 14:50:28.831956 10205 raft_consensus.cc:2726] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.832839 10152 raft_consensus.cc:482] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.833364 10152 raft_consensus.cc:504] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.833794 9848 ts_tablet_manager.cc:1397] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.414s user 0.010s sys 0.008s
I20260928 14:50:28.833910 10152 leader_election.cc:288] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:28.837175 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bc3e689e2ffa4edb8ef1004287e40c99
I20260928 14:50:28.837622 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bb9c7fc599425484fd3fc0b94f3a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.841602 9815 ts_tablet_manager.cc:1939] T c9a7573c751d412aa8394d6277c28b7f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:28.842032 9360 leader_election.cc:341] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.842300 9360 leader_election.cc:302] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:28.842320 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 389) took 1257 ms. Trace:
I20260928 14:50:28.842746 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_783c475fe2dc470c85133e418a70741a" } modify_external_catalogs: true
I20260928 14:50:28.842941 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_783c475fe2dc470c85133e418a70741a" } modify_external_catalogs: true
I20260928 14:50:28.842914 9815 rpcz_store.cc:276] 0928 14:50:27.584727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.586072 (+ 1345us) service_pool.cc:227] Handling call
0928 14:50:28.517127 (+931055us) ts_tablet_manager.cc:1145] Deleting tablet c9a7573c751d412aa8394d6277c28b7f
0928 14:50:28.517138 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.687595 (+170457us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.811247 (+123652us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.842287 (+ 31040us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":930844}
I20260928 14:50:28.843245 9815 tablet_replica.cc:330] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.843947 9815 raft_consensus.cc:2229] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.844105 9815 raft_consensus.cc:2258] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.845252 9815 ts_tablet_manager.cc:1905] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.849807 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b14339044619424c9be020fa99ad681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:28.850620 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.851306 10215 raft_consensus.cc:2781] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:28.851420 10215 raft_consensus.cc:482] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:28.851737 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b914e3c8243490d92378a8765d6390f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.851779 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:28.854156 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_327215c77105491289e905e60ba09b2c" } modify_external_catalogs: true
I20260928 14:50:28.854401 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_327215c77105491289e905e60ba09b2c" } modify_external_catalogs: true
I20260928 14:50:28.852474 10215 raft_consensus.cc:3037] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:28.857115 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b80c8683b20345bc9ade4e5fedccadb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.857678 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b80c8683b20345bc9ade4e5fedccadb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.859411 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1ec91a2f8ab14f82888c9ed84ff6433a" } modify_external_catalogs: true
I20260928 14:50:28.859499 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6d22a856b02448ecb229ff551f23c22d" } new_table_name: "default.Table_02e5b36a67804830879c207d98f45dda" modify_external_catalogs: true
W20260928 14:50:28.859629 9498 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.859715 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1ec91a2f8ab14f82888c9ed84ff6433a" } modify_external_catalogs: true
I20260928 14:50:28.859768 9498 leader_election.cc:302] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:28.860185 9498 leader_election.cc:341] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.860378 9498 leader_election.cc:302] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:28.860797 9498 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.861020 10152 raft_consensus.cc:2726] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.861186 10152 raft_consensus.cc:2726] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.870388 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dbb8d20e6b3347098f4550902d7d6ce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.870968 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbb8d20e6b3347098f4550902d7d6ce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.871313 10189 raft_consensus.cc:482] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.872160 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_52f8e9a66b7d4a3983276c85bcce6661"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.872617 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52f8e9a66b7d4a3983276c85bcce6661 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.873684 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_189ff43beccd48af8e898b45130b3595"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.874102 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_189ff43beccd48af8e898b45130b3595 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.876935 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9a753aaf7f8c4498b6ba35fa27d8c537
I20260928 14:50:28.880178 10189 raft_consensus.cc:504] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.881103 9848 raft_consensus.cc:348] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.881501 9848 raft_consensus.cc:374] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.881628 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.858718 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.881563 10189 leader_election.cc:288] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.881770 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a70f70162c2433aab5136514bd5fc03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:28.889776 9848 raft_consensus.cc:729] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:28.891711 9360 leader_election.cc:341] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:28.894359 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:28.894658 9285 raft_consensus.cc:2454] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:28.894718 9848 consensus_queue.cc:260] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.895671 9360 leader_election.cc:302] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:28.895929 9813 ts_tablet_manager.cc:1918] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:28.896072 9813 log.cc:1196] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/c9cee872de1f4ce8b803cb8e8fb018d2
W20260928 14:50:28.896198 9497 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.896359 9497 leader_election.cc:302] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:28.896744 10054 raft_consensus.cc:2726] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:28.896796 9848 ts_tablet_manager.cc:1428] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.063s user 0.002s sys 0.001s
I20260928 14:50:28.897387 10189 raft_consensus.cc:2781] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 14:50:28.897650 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a70f70162c2433aab5136514bd5fc03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.898540 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.899884 10189 raft_consensus.cc:482] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:28.900599 9848 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:28.900875 10189 raft_consensus.cc:3037] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Advancing to term 2
I20260928 14:50:28.901079 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c9a7573c751d412aa8394d6277c28b7f (table default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]) successfully deleted
W20260928 14:50:28.909464 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b75816a9816497ca6bc6ba8e5c5eb3d consensus state has no leader
I20260928 14:50:28.910334 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:28.912395 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_f38371501cb347d3b36246f9a12070f8 [id=1692d8fdf9b240f6a1662de9319db005]). Expected version 3 got 0
I20260928 14:50:28.913923 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3d27738fcfbc42f298e26149dfd28182
I20260928 14:50:28.917073 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a70f70162c2433aab5136514bd5fc03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.919209 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ce25abb4559241f58054f27435fd6078 (table default.Table_ab8b665217b04cf7a742ad3a5bda5573 [id=a95034bdd2ac4f5e9a36e1e16b407355]) successfully deleted
I20260928 14:50:28.920854 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet dd70cf6ee2d343878c90ae4818f1eb8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.921972 9848 tablet_bootstrap.cc:654] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:28.919697 8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.60:39777, user_credentials={real_user=slave}} blocked reactor thread for 56840.1us
I20260928 14:50:28.922240 9813 ts_tablet_manager.cc:1939] T c9cee872de1f4ce8b803cb8e8fb018d2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:28.923004 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a19995a0d8af4d3ca562bade80ce006f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19995a0d8af4d3ca562bade80ce006f already in progress: creating tablet
W20260928 14:50:28.923439 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 41b8584ba1914c3390aee99baaee289e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b8584ba1914c3390aee99baaee289e already in progress: creating tablet
I20260928 14:50:28.924296 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3e689e2ffa4edb8ef1004287e40c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:28.923789 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b65fd0746d1b474e9fbebe6f09053743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65fd0746d1b474e9fbebe6f09053743 already in progress: creating tablet
W20260928 14:50:28.926169 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6a828130854b4e4e8c44b2b45260e50e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a828130854b4e4e8c44b2b45260e50e already in progress: creating tablet
I20260928 14:50:28.927280 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.931300 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 312) took 3362 ms. Trace:
I20260928 14:50:28.931401 9813 rpcz_store.cc:276] 0928 14:50:25.560365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.570021 (+ 9656us) service_pool.cc:227] Handling call
0928 14:50:28.671646 (+3101625us) ts_tablet_manager.cc:1145] Deleting tablet c9cee872de1f4ce8b803cb8e8fb018d2
0928 14:50:28.671656 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.774591 (+102935us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.895827 (+121236us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.922986 (+ 27159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3101410}
I20260928 14:50:28.932415 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 324) took 3322 ms. Trace:
I20260928 14:50:28.932528 9813 rpcz_store.cc:276] 0928 14:50:25.609205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.634539 (+ 25334us) service_pool.cc:227] Handling call
0928 14:50:28.931644 (+3297105us) ts_tablet_manager.cc:1145] Deleting tablet 75f9359df0ac466c912cd20fc6b94390
0928 14:50:28.931656 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.931748 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3296090}
I20260928 14:50:28.904058 10215 raft_consensus.cc:504] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.934172 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:28.934398 9567 raft_consensus.cc:3037] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:28.935302 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.937224 9567 raft_consensus.cc:2454] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:28.938732 9813 tablet_replica.cc:330] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:28.942042 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d27738fcfbc42f298e26149dfd28182 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:28.943338 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6c12e9856a1445b09905de43397569d0" } new_table_name: "default.Table_6dc63b0600564c98b9f3ac0d01162e82" modify_external_catalogs: true
I20260928 14:50:28.944855 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ce487be9bc85404e964691db4be47df6" } new_table_name: "default.Table_6dacb88cb9c74873a8f69da29a43fed9" modify_external_catalogs: true
I20260928 14:50:28.945731 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.946738 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_52368c8a8a824232a457354c4907c956"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:28.947146 9813 raft_consensus.cc:2229] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:28.947340 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52368c8a8a824232a457354c4907c956 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.947440 9360 leader_election.cc:302] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:28.950590 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b81e986eb6cf4b74bec8daef77d9395c" } new_table_name: "default.Table_ae66aaf2db624c129f3b5cb1709326e1" modify_external_catalogs: true
I20260928 14:50:28.952651 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:28.953759 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_14c64dbddb824381846db69cd0640e63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:28.954507 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14c64dbddb824381846db69cd0640e63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:28.954903 10215 leader_election.cc:288] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.956398 9855 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:28.956635 9855 ts_tablet_manager.cc:1397] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.140s user 0.000s sys 0.011s
I20260928 14:50:28.957427 9855 raft_consensus.cc:348] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.957686 9855 raft_consensus.cc:374] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:28.957795 9855 raft_consensus.cc:729] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:28.958014 9855 consensus_queue.cc:260] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.967541 10152 raft_consensus.cc:482] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.967681 9855 ts_tablet_manager.cc:1428] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260928 14:50:28.967924 9855 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:28.969494 9855 tablet_bootstrap.cc:654] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:28.967684 10152 raft_consensus.cc:504] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:28.970844 10152 leader_election.cc:288] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:28.972687 9815 ts_tablet_manager.cc:1918] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:28.972827 9815 log.cc:1196] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:28.973132 9815 ts_tablet_manager.cc:1939] T f095e4cbf95147d9afb83434ae1fd29f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:28.973860 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 395) took 1388 ms. Trace:
I20260928 14:50:28.973954 9815 rpcz_store.cc:276] 0928 14:50:27.585206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.586309 (+ 1103us) service_pool.cc:227] Handling call
0928 14:50:28.843190 (+1256881us) ts_tablet_manager.cc:1145] Deleting tablet f095e4cbf95147d9afb83434ae1fd29f
0928 14:50:28.843200 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:28.864557 (+ 21357us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.972587 (+108030us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:28.973803 (+ 1216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1256708}
I20260928 14:50:28.974282 9815 tablet_replica.cc:330] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:28.974462 9815 raft_consensus.cc:2229] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:28.974656 9815 raft_consensus.cc:2258] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:28.975122 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88d6b4482e7b42fca17e5b917e1c1bed consensus state has no leader
W20260928 14:50:28.976338 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0868e5ce22874134a2f50e2404970bb8 consensus state has no leader
I20260928 14:50:28.978055 10152 raft_consensus.cc:482] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:28.978226 10152 raft_consensus.cc:504] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:28.978830 10152 leader_election.cc:288] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:28.980651 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eae5af64cea44e7f86358edae40caa99 consensus state has no leader
I20260928 14:50:28.982961 9815 ts_tablet_manager.cc:1905] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:28.989787 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d27738fcfbc42f298e26149dfd28182 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:28.990033 10360 log.cc:924] Time spent T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260928 14:50:28.990851 9851 tablet_bootstrap.cc:492] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:28.991053 9851 ts_tablet_manager.cc:1397] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.298s user 0.023s sys 0.020s
I20260928 14:50:28.991429 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:28.992429 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:28.994246 9497 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:28.994899 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f095e4cbf95147d9afb83434ae1fd29f (table default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]) successfully deleted
I20260928 14:50:28.995075 9813 raft_consensus.cc:2258] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:28.995314 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 5b695c68118b49359f1899d30208b1b7 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:28.995836 10215 raft_consensus.cc:2781] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:28.996450 10215 raft_consensus.cc:686] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:28.996754 10215 consensus_queue.cc:237] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.001423 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5b695c68118b49359f1899d30208b1b7
I20260928 14:50:29.001839 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 5b695c68118b49359f1899d30208b1b7 deleted and replaced by tablet 9b3abf8936d34eaba6d60245727738dc
I20260928 14:50:29.003558 10189 raft_consensus.cc:504] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.004200 9813 ts_tablet_manager.cc:1905] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.004868 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.006290 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_f38371501cb347d3b36246f9a12070f8 [id=1692d8fdf9b240f6a1662de9319db005]). Expected version 3 got 0
I20260928 14:50:29.008724 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 8fbe74a73dda4330af8814bbba0cfc70 (DEFAULT_TABLE table=default.Table_fc92b51b52204e60b316163867152d8d [id=4f91c41523434de1aa823294e089f5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.009222 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fbe74a73dda4330af8814bbba0cfc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.015462 9851 raft_consensus.cc:348] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.015607 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 43c887b7c4e8434a9342d49145fde3ae (DEFAULT_TABLE table=default.Table_f437d450119b40f5af9c5e4f167cd36e [id=db8c31df807442d9b6ee3bb32c0c6417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.015722 9851 raft_consensus.cc:374] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.015743 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (table default.Table_4f27adee7f5546bdacf1cf473d252a5b [id=290e5d7ef835430987ca8992b8142bf6]). Expected version 1 got 0
I20260928 14:50:29.016029 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43c887b7c4e8434a9342d49145fde3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.016682 10152 raft_consensus.cc:482] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.016824 10152 raft_consensus.cc:504] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.017446 10152 leader_election.cc:288] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:29.020910 9851 raft_consensus.cc:729] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.015952 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2b819b194d4373a59a3e94267361c1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.022245 10054 raft_consensus.cc:482] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.022418 10054 raft_consensus.cc:504] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.022953 10054 leader_election.cc:288] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:29.023389 9497 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.021153 9851 consensus_queue.cc:260] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.025537 9815 ts_tablet_manager.cc:1918] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.026357 9815 log.cc:1196] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:29.027153 9815 ts_tablet_manager.cc:1939] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.028874 9851 ts_tablet_manager.cc:1428] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260928 14:50:29.028898 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 392) took 1443 ms. Trace:
I20260928 14:50:29.030571 9815 rpcz_store.cc:276] 0928 14:50:27.584982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.586506 (+ 1524us) service_pool.cc:227] Handling call
0928 14:50:28.974202 (+1387696us) ts_tablet_manager.cc:1145] Deleting tablet 3f8db468ad3c4bba8c701c3d8feba9f4
0928 14:50:28.974212 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.006363 (+ 32151us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.025372 (+ 19009us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.028866 (+ 3494us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1387491}
I20260928 14:50:29.031657 9815 tablet_replica.cc:330] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.032080 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88015bcd867e40e5b9263930e820074a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.032401 10189 leader_election.cc:288] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:29.029001 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.034176 9815 raft_consensus.cc:2229] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.034848 9815 raft_consensus.cc:2258] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.035917 9815 ts_tablet_manager.cc:1905] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.039170 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 8fbe74a73dda4330af8814bbba0cfc70 (DEFAULT_TABLE table=default.Table_fc92b51b52204e60b316163867152d8d [id=4f91c41523434de1aa823294e089f5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.044793 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
I20260928 14:50:29.045564 9851 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:29.054730 9497 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.058907 10204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:29.057915 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 43c887b7c4e8434a9342d49145fde3ae (DEFAULT_TABLE table=default.Table_f437d450119b40f5af9c5e4f167cd36e [id=db8c31df807442d9b6ee3bb32c0c6417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.059836 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fbe74a73dda4330af8814bbba0cfc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.065121 9815 ts_tablet_manager.cc:1918] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.067899 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43c887b7c4e8434a9342d49145fde3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.069219 9815 log.cc:1196] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:29.070156 9815 ts_tablet_manager.cc:1939] T 57e56077833e41dbacf54c1757ba6a38 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.068611 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f79fcac805b42ba8b66949fbdfeb8f6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:29.071564 9497 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.072559 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 391) took 1487 ms. Trace:
I20260928 14:50:29.073894 9815 rpcz_store.cc:276] 0928 14:50:27.584883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.586739 (+ 1856us) service_pool.cc:227] Handling call
0928 14:50:29.031569 (+1444830us) ts_tablet_manager.cc:1145] Deleting tablet 57e56077833e41dbacf54c1757ba6a38
0928 14:50:29.031580 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.049243 (+ 17663us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.065014 (+ 15771us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.072509 (+ 7495us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1444645}
I20260928 14:50:29.073222 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 67956e8ba12d4411bfca6263b84aa93e (DEFAULT_TABLE table=default.Table_ebdec478d58042548c75729bd5b6c7c7 [id=8c5f014cd2f545abb221b135a4477b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.075450 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67956e8ba12d4411bfca6263b84aa93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.075783 9815 tablet_replica.cc:330] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.076417 9815 raft_consensus.cc:2229] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.077414 9815 raft_consensus.cc:2258] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.078323 9815 ts_tablet_manager.cc:1905] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.078986 9851 tablet_bootstrap.cc:654] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.083758 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet 89959226fd6247d4b89c54cc6ef4ede6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.084563 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bc56b27db3a9485ca73d987fdac482f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.085273 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc56b27db3a9485ca73d987fdac482f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.094257 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_85efe0ba6255470f906b736c34b310f8" } new_table_name: "default.Table_5a0e54b68ecb48adb9658774ac31c91c" modify_external_catalogs: true
I20260928 14:50:29.099970 9815 ts_tablet_manager.cc:1918] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:29.104782 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 091600d56fdc469d8b754acd8933808b consensus state has no leader
I20260928 14:50:29.107710 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b3fa664a13f240a8ab876df02ff31cd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.110236 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3fa664a13f240a8ab876df02ff31cd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.112283 9815 log.cc:1196] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ca5c040fa6ba4e2785959874a3346bf7
I20260928 14:50:29.113229 9815 ts_tablet_manager.cc:1939] T ca5c040fa6ba4e2785959874a3346bf7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.114915 9813 ts_tablet_manager.cc:1918] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.115046 9813 log.cc:1196] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ed0d79a39b2543049506422432990617
I20260928 14:50:29.116317 9813 ts_tablet_manager.cc:1939] T ed0d79a39b2543049506422432990617 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.116675 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 323) took 3507 ms. Trace:
I20260928 14:50:29.114943 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 393) took 1529 ms. Trace:
I20260928 14:50:29.117460 9813 rpcz_store.cc:276] 0928 14:50:25.609041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.635340 (+ 26299us) service_pool.cc:227] Handling call
0928 14:50:28.932736 (+3297396us) ts_tablet_manager.cc:1145] Deleting tablet ed0d79a39b2543049506422432990617
0928 14:50:28.932747 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.082260 (+149513us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.114692 (+ 32432us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.116643 (+ 1951us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3293847}
I20260928 14:50:29.117990 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 325) took 3470 ms. Trace:
I20260928 14:50:29.118167 9813 rpcz_store.cc:276] 0928 14:50:25.647934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.648005 (+ 71us) service_pool.cc:227] Handling call
0928 14:50:29.117858 (+3469853us) ts_tablet_manager.cc:1145] Deleting tablet 2f0b97883acb4adfa4091653545e894b
0928 14:50:29.117868 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.117956 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3469639}
I20260928 14:50:29.118568 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 322) took 3531 ms. Trace:
I20260928 14:50:29.118718 9813 rpcz_store.cc:276] 0928 14:50:25.587561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.662407 (+ 74846us) service_pool.cc:227] Handling call
0928 14:50:29.118454 (+3456047us) ts_tablet_manager.cc:1145] Deleting tablet 6feba01e78004e50a71c610c9a63aeb5
0928 14:50:29.118463 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.118542 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3455777}
I20260928 14:50:29.119073 9813 tablet_replica.cc:330] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.119208 9814 ts_tablet_manager.cc:1918] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.119398 9813 raft_consensus.cc:2229] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.119611 9813 raft_consensus.cc:2258] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.119652 9814 log.cc:1196] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5a64ffa786f045b480efe51eb69d7074
I20260928 14:50:29.120065 9814 ts_tablet_manager.cc:1939] T 5a64ffa786f045b480efe51eb69d7074 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.120281 9813 ts_tablet_manager.cc:1905] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.120815 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 327) took 3216 ms. Trace:
I20260928 14:50:29.120932 9814 rpcz_store.cc:276] 0928 14:50:25.904426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.904472 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:28.764970 (+2860498us) ts_tablet_manager.cc:1145] Deleting tablet 5a64ffa786f045b480efe51eb69d7074
0928 14:50:28.764978 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.084904 (+319926us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.119103 (+ 34199us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.120759 (+ 1656us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860308}
I20260928 14:50:29.121220 9815 rpcz_store.cc:276] 0928 14:50:27.585061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.586947 (+ 1886us) service_pool.cc:227] Handling call
0928 14:50:29.075165 (+1488218us) ts_tablet_manager.cc:1145] Deleting tablet ca5c040fa6ba4e2785959874a3346bf7
0928 14:50:29.075177 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.095102 (+ 19925us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.099864 (+ 4762us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.114908 (+ 15044us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487905}
I20260928 14:50:29.121385 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 328) took 3205 ms. Trace:
I20260928 14:50:29.121479 9814 rpcz_store.cc:276] 0928 14:50:25.915849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.915901 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:29.121210 (+3205309us) ts_tablet_manager.cc:1145] Deleting tablet 8234670cb2604ba7b405ad7f70e03a2f
0928 14:50:29.121219 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.121339 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205084}
I20260928 14:50:29.124056 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet c9cee872de1f4ce8b803cb8e8fb018d2 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
I20260928 14:50:29.124286 9851 tablet_bootstrap.cc:492] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:29.124491 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 75f9359df0ac466c912cd20fc6b94390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f9359df0ac466c912cd20fc6b94390 already in progress: creating tablet
I20260928 14:50:29.125623 9815 tablet_replica.cc:330] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.125618 10204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:29.125926 9815 raft_consensus.cc:2229] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.125952 10204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:29.126150 9815 raft_consensus.cc:2258] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.126400 9851 ts_tablet_manager.cc:1397] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.091s user 0.009s sys 0.005s
I20260928 14:50:29.126621 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 341) took 3024 ms. Trace:
I20260928 14:50:29.126760 9814 rpcz_store.cc:276] 0928 14:50:26.101960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.102022 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:29.123295 (+3021273us) ts_tablet_manager.cc:1145] Deleting tablet 69e3c8ef3e20451dbf91b671655974e5
0928 14:50:29.123304 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.126390 (+ 3086us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3020695}
I20260928 14:50:29.126876 9815 ts_tablet_manager.cc:1905] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:29.129283 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 187666us
I20260928 14:50:29.132344 9814 tablet_replica.cc:330] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.132658 9814 raft_consensus.cc:2229] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.133792 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_59caae98d16342cc8ea4b5b3e2f8fb76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:29.134001 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_095d6dc7887348e1ab7bcb8be6278f3d" } modify_external_catalogs: true
I20260928 14:50:29.134212 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_095d6dc7887348e1ab7bcb8be6278f3d" } modify_external_catalogs: true
W20260928 14:50:29.134476 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59caae98d16342cc8ea4b5b3e2f8fb76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.134544 9814 raft_consensus.cc:2258] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.135061 9814 ts_tablet_manager.cc:1905] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.135820 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b34a358cd1549abb1b21255b0d0edcf" } modify_external_catalogs: true
I20260928 14:50:29.135982 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b34a358cd1549abb1b21255b0d0edcf" } modify_external_catalogs: true
I20260928 14:50:29.137416 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32e7e11092d1475cba53e51a0f61d6f1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:29.139707 9287 raft_consensus.cc:3037] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.142338 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_18b0ab4255ca4b42a4c0f4e3312292f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.143602 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18b0ab4255ca4b42a4c0f4e3312292f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.147600 9283 raft_consensus.cc:3037] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Advancing to term 2
I20260928 14:50:29.148299 9851 raft_consensus.cc:348] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.148972 9851 raft_consensus.cc:374] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.149075 9851 raft_consensus.cc:729] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.153440 9815 ts_tablet_manager.cc:1918] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.157366 9815 log.cc:1196] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:29.157773 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:29.158093 9815 ts_tablet_manager.cc:1939] T fd24e60a0e944f6086ff9c9fbe2e8180 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.158416 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7ef356a4c9d34af4b300d38eab49a569
I20260928 14:50:29.158854 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 390) took 1574 ms. Trace:
I20260928 14:50:29.159014 9815 rpcz_store.cc:276] 0928 14:50:27.584802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.587253 (+ 2451us) service_pool.cc:227] Handling call
0928 14:50:29.125517 (+1538264us) ts_tablet_manager.cc:1145] Deleting tablet fd24e60a0e944f6086ff9c9fbe2e8180
0928 14:50:29.125566 (+ 49us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.142994 (+ 17428us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.153332 (+ 10338us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.158801 (+ 5469us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1537979}
I20260928 14:50:29.161168 9815 tablet_replica.cc:330] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.161791 9815 raft_consensus.cc:2229] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.162401 9815 raft_consensus.cc:2258] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.163162 9815 ts_tablet_manager.cc:1905] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.164510 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.164740 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.164985 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d27738fcfbc42f298e26149dfd28182 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.165359 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 43c887b7c4e8434a9342d49145fde3ae (DEFAULT_TABLE table=default.Table_f437d450119b40f5af9c5e4f167cd36e [id=db8c31df807442d9b6ee3bb32c0c6417]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.166185 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2f0b97883acb4adfa4091653545e894b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f0b97883acb4adfa4091653545e894b already in progress: creating tablet
W20260928 14:50:29.166503 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6feba01e78004e50a71c610c9a63aeb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6feba01e78004e50a71c610c9a63aeb5 already in progress: creating tablet
I20260928 14:50:29.167271 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43c887b7c4e8434a9342d49145fde3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.167727 9851 consensus_queue.cc:260] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.172169 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 8fbe74a73dda4330af8814bbba0cfc70 (DEFAULT_TABLE table=default.Table_fc92b51b52204e60b316163867152d8d [id=4f91c41523434de1aa823294e089f5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.172796 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.173139 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fbe74a73dda4330af8814bbba0cfc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.173616 10205 raft_consensus.cc:482] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.176365 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e0b8288fc9b47ce8c70dec324dfecf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.176429 10205 raft_consensus.cc:504] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.176939 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 67956e8ba12d4411bfca6263b84aa93e (DEFAULT_TABLE table=default.Table_ebdec478d58042548c75729bd5b6c7c7 [id=8c5f014cd2f545abb221b135a4477b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.177268 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67956e8ba12d4411bfca6263b84aa93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.177263 10205 leader_election.cc:288] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:29.177877 9851 ts_tablet_manager.cc:1428] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260928 14:50:29.178755 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.179790 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5a64ffa786f045b480efe51eb69d7074 (table default.Table_381accf700114544b20a817ee30e9fff [id=d1cbf4f020a44f349d4de94aa0a2f725]) successfully deleted
I20260928 14:50:29.179898 9815 ts_tablet_manager.cc:1918] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.180079 9851 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:29.180418 9815 log.cc:1196] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/066df778654449bda96f68b5035c4d73
I20260928 14:50:29.181553 9283 raft_consensus.cc:2454] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 2.
I20260928 14:50:29.183029 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.183386 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2b819b194d4373a59a3e94267361c1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.183965 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff596370c52465ca7c531b8760af5c8 (DEFAULT_TABLE table=default.Table_e74879f8be614d689d6faef67df823f1 [id=60cb5e1d86f7418b90bac3d625770081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.184240 9815 ts_tablet_manager.cc:1939] T 066df778654449bda96f68b5035c4d73 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.184388 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff596370c52465ca7c531b8760af5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.184958 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 396) took 1599 ms. Trace:
I20260928 14:50:29.185082 9815 rpcz_store.cc:276] 0928 14:50:27.585319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.587419 (+ 2100us) service_pool.cc:227] Handling call
0928 14:50:29.161039 (+1573620us) ts_tablet_manager.cc:1145] Deleting tablet 066df778654449bda96f68b5035c4d73
0928 14:50:29.161051 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.171037 (+ 9986us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.174248 (+ 3211us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.184925 (+ 10677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573486}
I20260928 14:50:29.186913 9815 tablet_replica.cc:330] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.178171 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8948e45987b94ca69004c42e224ce93f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.187173 9815 raft_consensus.cc:2229] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.187363 9815 raft_consensus.cc:2258] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:29.187652 9360 leader_election.cc:341] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.190225 9424 raft_consensus.cc:2379] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
I20260928 14:50:29.190688 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f79fcac805b42ba8b66949fbdfeb8f6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.191133 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88015bcd867e40e5b9263930e820074a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.192646 9815 ts_tablet_manager.cc:1905] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:29.192806 9498 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.192952 9498 leader_election.cc:302] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:29.193424 9498 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.193593 9498 leader_election.cc:302] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.193632 9851 tablet_bootstrap.cc:654] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.193998 10054 raft_consensus.cc:2726] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.194222 10054 raft_consensus.cc:2726] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.196499 9498 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.196628 9498 leader_election.cc:302] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.196990 10152 raft_consensus.cc:2726] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.197418 9498 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.197592 9498 leader_election.cc:302] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.198213 10152 raft_consensus.cc:2726] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.198562 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8234670cb2604ba7b405ad7f70e03a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8234670cb2604ba7b405ad7f70e03a2f already in progress: creating tablet
I20260928 14:50:29.200083 9855 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.200263 9855 ts_tablet_manager.cc:1397] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.232s user 0.009s sys 0.042s
W20260928 14:50:29.200964 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 69e3c8ef3e20451dbf91b671655974e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69e3c8ef3e20451dbf91b671655974e5 already in progress: creating tablet
I20260928 14:50:29.200973 9855 raft_consensus.cc:348] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.201225 9855 raft_consensus.cc:374] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.201308 9855 raft_consensus.cc:729] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.201700 9855 consensus_queue.cc:260] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.202258 9855 ts_tablet_manager.cc:1428] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:29.202668 9855 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.204381 9855 tablet_bootstrap.cc:654] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.204771 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 3aff7eb9a7ff4ed79305806c30c30627 (DEFAULT_TABLE table=default.Table_a41dbf3f70674d78a5963e7f82f8680e [id=3c7ccec83e854fe79539b979befdc62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.205170 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aff7eb9a7ff4ed79305806c30c30627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.205586 9814 ts_tablet_manager.cc:1918] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.205868 9814 log.cc:1196] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9aeda483866146f89198e6f14456f0f2
I20260928 14:50:29.206491 9815 ts_tablet_manager.cc:1918] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.207165 9815 log.cc:1196] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6a828130854b4e4e8c44b2b45260e50e
I20260928 14:50:29.207687 9815 ts_tablet_manager.cc:1939] T 6a828130854b4e4e8c44b2b45260e50e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.208341 9814 ts_tablet_manager.cc:1939] T 9aeda483866146f89198e6f14456f0f2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.208910 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.209167 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 388) took 1624 ms. Trace:
I20260928 14:50:29.209642 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.209913 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 343) took 2943 ms. Trace:
I20260928 14:50:29.209980 9815 rpcz_store.cc:276] 0928 14:50:27.584617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.593845 (+ 9228us) service_pool.cc:227] Handling call
0928 14:50:29.186856 (+1593011us) ts_tablet_manager.cc:1145] Deleting tablet 6a828130854b4e4e8c44b2b45260e50e
0928 14:50:29.186868 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.196552 (+ 9684us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.206400 (+ 9848us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.209108 (+ 2708us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1592815}
I20260928 14:50:29.210065 9814 rpcz_store.cc:276] 0928 14:50:26.266381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.266430 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:29.127032 (+2860602us) ts_tablet_manager.cc:1145] Deleting tablet 9aeda483866146f89198e6f14456f0f2
0928 14:50:29.127041 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.182922 (+ 55881us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.199578 (+ 16656us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.209877 (+ 10299us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860374}
I20260928 14:50:29.210399 9814 tablet_replica.cc:330] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.210621 9814 raft_consensus.cc:2229] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.210804 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.210671 9815 tablet_replica.cc:330] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.210812 9814 raft_consensus.cc:2258] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.211208 9815 raft_consensus.cc:2229] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.211565 9815 raft_consensus.cc:2258] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.211930 9814 ts_tablet_manager.cc:1905] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.212220 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.212294 9815 ts_tablet_manager.cc:1905] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.214294 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 67956e8ba12d4411bfca6263b84aa93e (DEFAULT_TABLE table=default.Table_ebdec478d58042548c75729bd5b6c7c7 [id=8c5f014cd2f545abb221b135a4477b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.215207 9388 tablet_service.cc:1467] Processing CreateTablet for tablet d34a235b38aa4e9ba328a7f542342653 (DEFAULT_TABLE table=default.Table_795852c44f3e445fb688726c11fb5c42 [id=e27157f2f6c142498522224ade73f572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.215617 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d34a235b38aa4e9ba328a7f542342653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.215747 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67956e8ba12d4411bfca6263b84aa93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.218451 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff596370c52465ca7c531b8760af5c8 (DEFAULT_TABLE table=default.Table_e74879f8be614d689d6faef67df823f1 [id=60cb5e1d86f7418b90bac3d625770081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.218832 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff596370c52465ca7c531b8760af5c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:29.223523 9360 leader_election.cc:341] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 32e7e11092d1475cba53e51a0f61d6f1
W20260928 14:50:29.224092 9219 consensus_peers.cc:487] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8193754d28d34c18bfc38ae0abd05f4c. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:29.224490 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 8948e45987b94ca69004c42e224ce93f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:29.224691 9219 leader_election.cc:341] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8948e45987b94ca69004c42e224ce93f
I20260928 14:50:29.224896 9219 leader_election.cc:302] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.225232 10205 consensus_queue.cc:1035] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:29.225739 10205 raft_consensus.cc:3037] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.228523 10205 raft_consensus.cc:2726] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.231985 9855 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.232125 9855 ts_tablet_manager.cc:1397] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.009s
I20260928 14:50:29.232887 9855 raft_consensus.cc:348] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.233124 9855 raft_consensus.cc:374] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.233382 9855 raft_consensus.cc:729] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.233606 9360 leader_election.cc:302] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:29.233703 9855 consensus_queue.cc:260] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.234364 9855 ts_tablet_manager.cc:1428] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:29.234253 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff596370c52465ca7c531b8760af5c8 (DEFAULT_TABLE table=default.Table_e74879f8be614d689d6faef67df823f1 [id=60cb5e1d86f7418b90bac3d625770081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.235868 9855 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.235944 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 3aff7eb9a7ff4ed79305806c30c30627 (DEFAULT_TABLE table=default.Table_a41dbf3f70674d78a5963e7f82f8680e [id=3c7ccec83e854fe79539b979befdc62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.237941 9855 tablet_bootstrap.cc:654] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.242285 9815 ts_tablet_manager.cc:1918] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.242509 9815 log.cc:1196] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2f0b97883acb4adfa4091653545e894b
I20260928 14:50:29.242903 9848 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.242936 9815 ts_tablet_manager.cc:1939] T 2f0b97883acb4adfa4091653545e894b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.243134 9848 ts_tablet_manager.cc:1397] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.346s user 0.011s sys 0.011s
I20260928 14:50:29.243973 9848 raft_consensus.cc:348] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.244234 9848 raft_consensus.cc:374] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.244513 9848 raft_consensus.cc:729] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.244817 9848 consensus_queue.cc:260] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.245617 9848 ts_tablet_manager.cc:1428] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260928 14:50:29.246371 9360 raft_consensus.cc:2670] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:29.250948 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 57e56077833e41dbacf54c1757ba6a38 (table default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]) successfully deleted
I20260928 14:50:29.251181 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ca5c040fa6ba4e2785959874a3346bf7 (table default.Table_c2ea7b972a3441858741b741d8452bd7 [id=8fe8d4808cbe43a3ad3d3f217582b27c]) successfully deleted
I20260928 14:50:29.251374 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet fd24e60a0e944f6086ff9c9fbe2e8180 (table default.Table_c10738b4aa7a42c2a6eef90a1999483a [id=9ef3939e8d864755819b15d57ed3b443]) successfully deleted
I20260928 14:50:29.251540 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 066df778654449bda96f68b5035c4d73 (table default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]) successfully deleted
I20260928 14:50:29.251839 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6a828130854b4e4e8c44b2b45260e50e (table default.Table_4f67958edd6b445693683ebf4f469972 [id=135455fa96ab4b05ae173bd269ba5269]) successfully deleted
I20260928 14:50:29.253317 9848 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.252754 8952 catalog_manager.cc:5495] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:29.256925 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1ee21c77ab98461184377947a7f2e3de" } modify_external_catalogs: true
I20260928 14:50:29.257117 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1ee21c77ab98461184377947a7f2e3de" } modify_external_catalogs: true
I20260928 14:50:29.262645 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:29.263222 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff596370c52465ca7c531b8760af5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.265393 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e6b7fbb9aae540268b85c3556e9ed7bd" } new_table_name: "default.Table_8b349ec7ad604085ae146a0fbd98eb86" modify_external_catalogs: true
I20260928 14:50:29.266330 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.266685 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.270208 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_37089a672aa04a4dbbd1bdc4e6bc7f4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.270744 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37089a672aa04a4dbbd1bdc4e6bc7f4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:29.272145 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f9b6cbf2d949839216e807130b2eb9 consensus state has no leader
I20260928 14:50:29.273576 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab677e004fee49e4882b664fb17465d4" } modify_external_catalogs: true
I20260928 14:50:29.273756 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab677e004fee49e4882b664fb17465d4" } modify_external_catalogs: true
I20260928 14:50:29.276913 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_56a26be7b12646229ddff62c431dd486"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:29.277086 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8bc54dd6856f4710b282b4dce6e03df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.277551 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc54dd6856f4710b282b4dce6e03df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:29.277565 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56a26be7b12646229ddff62c431dd486 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.280931 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7bb67fe09d1544418318121e5efde0a0" } modify_external_catalogs: true
I20260928 14:50:29.281214 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7bb67fe09d1544418318121e5efde0a0" } modify_external_catalogs: true
I20260928 14:50:29.281293 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet a303792e4c804844bc6037fabb425be4 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.283056 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 422) took 1141 ms. Trace:
I20260928 14:50:29.283213 9815 rpcz_store.cc:276] 0928 14:50:28.141259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.141759 (+ 500us) service_pool.cc:227] Handling call
0928 14:50:29.210594 (+1068835us) ts_tablet_manager.cc:1145] Deleting tablet 2f0b97883acb4adfa4091653545e894b
0928 14:50:29.210605 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.235459 (+ 24854us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.242145 (+ 6686us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.283011 (+ 40866us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053736}
I20260928 14:50:29.283710 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 425) took 1029 ms. Trace:
I20260928 14:50:29.283831 9815 rpcz_store.cc:276] 0928 14:50:28.253731 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.253770 (+ 39us) service_pool.cc:227] Handling call
0928 14:50:29.283525 (+1029755us) ts_tablet_manager.cc:1145] Deleting tablet 5f348f9e962748a0992d85b9d3d72aeb
0928 14:50:29.283538 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.283659 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1028631}
I20260928 14:50:29.284228 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 424) took 1031 ms. Trace:
I20260928 14:50:29.284365 9815 rpcz_store.cc:276] 0928 14:50:28.252384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.252581 (+ 197us) service_pool.cc:227] Handling call
0928 14:50:29.284062 (+1031481us) ts_tablet_manager.cc:1145] Deleting tablet 62d6975813b744fb80dcc432cec61cb4
0928 14:50:29.284074 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.284161 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027728}
I20260928 14:50:29.284554 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_aa976d19165445859cf0a1d3b9c21d13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:29.284749 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 426) took 1026 ms. Trace:
I20260928 14:50:29.284861 9815 rpcz_store.cc:276] 0928 14:50:28.258581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.258627 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:29.284598 (+1025971us) ts_tablet_manager.cc:1145] Deleting tablet 1c54cb0e8f2347d9b139c8766fb61ab1
0928 14:50:29.284609 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.284698 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1023816}
W20260928 14:50:29.284997 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa976d19165445859cf0a1d3b9c21d13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.287988 9815 tablet_replica.cc:330] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.288256 9815 raft_consensus.cc:2229] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:29.288635 9815 raft_consensus.cc:2258] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.290517 9848 tablet_bootstrap.cc:654] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.291172 9815 ts_tablet_manager.cc:1905] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.295441 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4744deca899b4e6caa57f70ce1df8a8d
I20260928 14:50:29.297655 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet dc8400fdb8d948b084733011b16df1b3 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.298373 9815 ts_tablet_manager.cc:1918] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:29.298592 9815 log.cc:1196] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:29.299201 9815 ts_tablet_manager.cc:1939] T 2f02364b809f4e1c8d558f121d4d88b9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.299870 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8788bca431d24b76960a8ce26a49831c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.300361 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8788bca431d24b76960a8ce26a49831c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.302723 9855 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.302901 9855 ts_tablet_manager.cc:1397] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.067s user 0.016s sys 0.009s
I20260928 14:50:29.303566 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a303792e4c804844bc6037fabb425be4
I20260928 14:50:29.303941 8954 catalog_manager.cc:6565] ReplaceTablet: tablet a303792e4c804844bc6037fabb425be4 deleted and replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f
I20260928 14:50:29.304132 9855 raft_consensus.cc:348] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.300623 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.304494 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet be232889594147bdbe2d4825c3e8c7d0
I20260928 14:50:29.304622 9855 raft_consensus.cc:374] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.304790 9855 raft_consensus.cc:729] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.305167 9855 consensus_queue.cc:260] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.305824 9855 ts_tablet_manager.cc:1428] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:29.306134 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f3f0e0c6daa54fecb0db72ae6e070f77" } new_table_name: "default.Table_b9e0d1da94af43e98734c49c00835d4c" modify_external_catalogs: true
I20260928 14:50:29.306860 9855 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.307590 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.307852 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.308689 9855 tablet_bootstrap.cc:654] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.309422 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eb64624ba99c4e48ae2d157843c73477" } new_table_name: "default.Table_557fd68bac1a42fc8085e5565fed4304" modify_external_catalogs: true
I20260928 14:50:29.309818 9815 tablet_replica.cc:330] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.310022 9815 raft_consensus.cc:2229] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.310218 9815 raft_consensus.cc:2258] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.311827 9815 ts_tablet_manager.cc:1905] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.313339 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 3aff7eb9a7ff4ed79305806c30c30627 (DEFAULT_TABLE table=default.Table_a41dbf3f70674d78a5963e7f82f8680e [id=3c7ccec83e854fe79539b979befdc62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.313860 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aff7eb9a7ff4ed79305806c30c30627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.313598 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0ec043b67faf4e26b3d57fae00217781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.314231 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ec043b67faf4e26b3d57fae00217781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.315124 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ba3b03ec5d55498085ffef43b3929852" } new_table_name: "default.Table_fc1ba1d4357b4f88865fb323d86d0bc4" modify_external_catalogs: true
I20260928 14:50:29.316962 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:29.317386 8946 catalog_manager.cc:6565] ReplaceTablet: tablet dc8400fdb8d948b084733011b16df1b3 deleted and replaced by tablet baa80c213f3f4aa9976cc285f6564e0f
I20260928 14:50:29.318610 9543 tablet_service.cc:1467] Processing CreateTablet for tablet d34a235b38aa4e9ba328a7f542342653 (DEFAULT_TABLE table=default.Table_795852c44f3e445fb688726c11fb5c42 [id=e27157f2f6c142498522224ade73f572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.318847 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.319038 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d34a235b38aa4e9ba328a7f542342653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.319234 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aff7eb9a7ff4ed79305806c30c30627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.322131 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.323215 9264 tablet_service.cc:1467] Processing CreateTablet for tablet d34a235b38aa4e9ba328a7f542342653 (DEFAULT_TABLE table=default.Table_795852c44f3e445fb688726c11fb5c42 [id=e27157f2f6c142498522224ade73f572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.323585 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d34a235b38aa4e9ba328a7f542342653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.324656 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:29.329279 10377 log.cc:924] Time spent T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260928 14:50:29.336318 9815 ts_tablet_manager.cc:1918] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.339684 9815 log.cc:1196] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:29.340394 9814 ts_tablet_manager.cc:1918] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.340610 9814 log.cc:1196] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/0e661ac0a85949a280d837ee0357eea7
I20260928 14:50:29.341080 9814 ts_tablet_manager.cc:1939] T 0e661ac0a85949a280d837ee0357eea7 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.341426 9815 ts_tablet_manager.cc:1939] T 3c2b819b194d4373a59a3e94267361c1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.343852 9815 tablet_replica.cc:330] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.344276 9815 raft_consensus.cc:2229] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.344681 9815 raft_consensus.cc:2258] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.345417 9815 ts_tablet_manager.cc:1905] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.349509 9813 ts_tablet_manager.cc:1918] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.349795 9813 log.cc:1196] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:29.350054 9848 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.350193 9848 ts_tablet_manager.cc:1397] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.000s
I20260928 14:50:29.358664 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.359269 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:29.361331 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f2c5afbdeda4ddfb82124031135e6cb consensus state has no leader
I20260928 14:50:29.361572 9815 ts_tablet_manager.cc:1918] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:29.361896 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7376f56883dc4032b120cc4494fa8936 consensus state has no leader
I20260928 14:50:29.361829 9848 raft_consensus.cc:348] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.363720 9815 log.cc:1196] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9648be4c626e44e0986c196704483955
I20260928 14:50:29.364503 9848 raft_consensus.cc:374] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.364600 9815 ts_tablet_manager.cc:1939] T 9648be4c626e44e0986c196704483955 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.364782 9848 raft_consensus.cc:729] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:29.362936 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:29.366044 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.362615 10365 raft_consensus.cc:482] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.366357 10365 raft_consensus.cc:504] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.367007 10365 leader_election.cc:288] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:29.367615 9815 tablet_replica.cc:330] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.350363 9813 ts_tablet_manager.cc:1939] T 32e7e11092d1475cba53e51a0f61d6f1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.368425 9815 raft_consensus.cc:2229] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.368681 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 326) took 3517 ms. Trace:
I20260928 14:50:29.368826 9813 rpcz_store.cc:276] 0928 14:50:25.850836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.857146 (+ 6310us) service_pool.cc:227] Handling call
0928 14:50:29.119014 (+3261868us) ts_tablet_manager.cc:1145] Deleting tablet 32e7e11092d1475cba53e51a0f61d6f1
0928 14:50:29.119023 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.186559 (+ 67536us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.349309 (+162750us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.368627 (+ 19318us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3261640}
I20260928 14:50:29.369066 9815 raft_consensus.cc:2258] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.369596 9815 ts_tablet_manager.cc:1905] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.370915 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 332) took 3480 ms. Trace:
I20260928 14:50:29.372731 9813 rpcz_store.cc:276] 0928 14:50:25.890238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.890478 (+ 240us) service_pool.cc:227] Handling call
0928 14:50:29.370583 (+3480105us) ts_tablet_manager.cc:1145] Deleting tablet 41b8584ba1914c3390aee99baaee289e
0928 14:50:29.370594 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.370743 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3479915}
W20260928 14:50:29.372133 9360 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee16f4482a424538812f6356655acf77
I20260928 14:50:29.369738 9848 consensus_queue.cc:260] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.376075 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 32e7e11092d1475cba53e51a0f61d6f1 (table default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]) successfully deleted
I20260928 14:50:29.376711 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9aeda483866146f89198e6f14456f0f2 (table default.Table_9c79f3003b9a414bbe7b61df842d89b5 [id=e0b7b13aea3a4915ac0773c5f23971fe]) successfully deleted
I20260928 14:50:29.377642 9848 ts_tablet_manager.cc:1428] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260928 14:50:29.378715 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 331) took 3488 ms. Trace:
I20260928 14:50:29.378818 9813 rpcz_store.cc:276] 0928 14:50:25.890101 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.890406 (+ 305us) service_pool.cc:227] Handling call
0928 14:50:29.378554 (+3488148us) ts_tablet_manager.cc:1145] Deleting tablet a19995a0d8af4d3ca562bade80ce006f
0928 14:50:29.378564 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.378668 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3487735}
I20260928 14:50:29.379592 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.379771 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 344) took 3073 ms. Trace:
I20260928 14:50:29.380602 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.381436 9815 ts_tablet_manager.cc:1918] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.381579 9815 log.cc:1196] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c85735981779438197f2c0f489681b96
I20260928 14:50:29.382222 9848 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.381048 9814 rpcz_store.cc:276] 0928 14:50:26.300570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.300623 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:29.210331 (+2909708us) ts_tablet_manager.cc:1145] Deleting tablet 0e661ac0a85949a280d837ee0357eea7
0928 14:50:29.210342 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.229236 (+ 18894us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.264194 (+ 34958us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.373757 (+109563us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2909470}
I20260928 14:50:29.383860 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 333) took 3483 ms. Trace:
I20260928 14:50:29.383970 9813 rpcz_store.cc:276] 0928 14:50:25.900304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.900507 (+ 203us) service_pool.cc:227] Handling call
0928 14:50:29.383705 (+3483198us) ts_tablet_manager.cc:1145] Deleting tablet b65fd0746d1b474e9fbebe6f09053743
0928 14:50:29.383716 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.383808 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3483003}
I20260928 14:50:29.382630 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.384418 9815 ts_tablet_manager.cc:1939] T c85735981779438197f2c0f489681b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.385828 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 334) took 3485 ms. Trace:
I20260928 14:50:29.385942 9813 rpcz_store.cc:276] 0928 14:50:25.900456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.900732 (+ 276us) service_pool.cc:227] Handling call
0928 14:50:29.385626 (+3484894us) ts_tablet_manager.cc:1145] Deleting tablet 6a828130854b4e4e8c44b2b45260e50e
0928 14:50:29.385635 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.385764 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3484705}
W20260928 14:50:29.386641 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 41b8584ba1914c3390aee99baaee289e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b8584ba1914c3390aee99baaee289e already in progress: creating tablet
W20260928 14:50:29.386878 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a19995a0d8af4d3ca562bade80ce006f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19995a0d8af4d3ca562bade80ce006f already in progress: creating tablet
I20260928 14:50:29.386941 9815 tablet_replica.cc:330] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:29.387190 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b65fd0746d1b474e9fbebe6f09053743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b65fd0746d1b474e9fbebe6f09053743 already in progress: creating tablet
W20260928 14:50:29.387466 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6a828130854b4e4e8c44b2b45260e50e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a828130854b4e4e8c44b2b45260e50e already in progress: creating tablet
I20260928 14:50:29.387490 9815 raft_consensus.cc:2229] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.387732 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2f0b97883acb4adfa4091653545e894b (table default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]) successfully deleted
I20260928 14:50:29.387825 9848 tablet_bootstrap.cc:654] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:29.387991 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5f348f9e962748a0992d85b9d3d72aeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f348f9e962748a0992d85b9d3d72aeb already in progress: creating tablet
I20260928 14:50:29.388005 9815 raft_consensus.cc:2258] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:29.388230 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 62d6975813b744fb80dcc432cec61cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62d6975813b744fb80dcc432cec61cb4 already in progress: creating tablet
W20260928 14:50:29.388438 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c54cb0e8f2347d9b139c8766fb61ab1 already in progress: creating tablet
W20260928 14:50:29.388659 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ab71087d034c4bedb06df9e5ccefad45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab71087d034c4bedb06df9e5ccefad45 already in progress: creating tablet
I20260928 14:50:29.388821 9813 tablet_replica.cc:330] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.389088 9813 raft_consensus.cc:2229] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.389302 9813 raft_consensus.cc:2258] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.389487 9815 ts_tablet_manager.cc:1905] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.389806 9813 ts_tablet_manager.cc:1905] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:29.388870 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8520b28899bc42b08e239502adb8fece because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8520b28899bc42b08e239502adb8fece already in progress: creating tablet
I20260928 14:50:29.391764 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 345) took 3053 ms. Trace:
I20260928 14:50:29.391885 9814 rpcz_store.cc:276] 0928 14:50:26.332015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.332079 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:29.384030 (+3051951us) ts_tablet_manager.cc:1145] Deleting tablet 28ee844aa3c24336b4acb66dc43186e9
0928 14:50:29.384042 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.385786 (+ 1744us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3051671}
I20260928 14:50:29.394500 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee16f4482a424538812f6356655acf77" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.397075 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 346) took 3003 ms. Trace:
I20260928 14:50:29.397182 9814 rpcz_store.cc:276] 0928 14:50:26.389273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.394114 (+ 4841us) service_pool.cc:227] Handling call
0928 14:50:29.392167 (+2998053us) ts_tablet_manager.cc:1145] Deleting tablet 9648be4c626e44e0986c196704483955
0928 14:50:29.392178 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.392262 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2997527}
I20260928 14:50:29.398031 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 347) took 2972 ms. Trace:
I20260928 14:50:29.398133 9814 rpcz_store.cc:276] 0928 14:50:26.425456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.441762 (+ 16306us) service_pool.cc:227] Handling call
0928 14:50:29.397395 (+2955633us) ts_tablet_manager.cc:1145] Deleting tablet 4bd612753b914a079ccf89249b073018
0928 14:50:29.397405 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.397482 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2918161}
I20260928 14:50:29.398964 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 348) took 2910 ms. Trace:
I20260928 14:50:29.399057 9814 rpcz_store.cc:276] 0928 14:50:26.488293 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.491336 (+ 3043us) service_pool.cc:227] Handling call
0928 14:50:29.398338 (+2907002us) ts_tablet_manager.cc:1145] Deleting tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b
0928 14:50:29.398347 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.398433 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2906733}
I20260928 14:50:29.399670 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 349) took 2892 ms. Trace:
I20260928 14:50:29.399767 9814 rpcz_store.cc:276] 0928 14:50:26.507296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.545582 (+ 38286us) service_pool.cc:227] Handling call
0928 14:50:29.399269 (+2853687us) ts_tablet_manager.cc:1145] Deleting tablet f28a74dc0afe4f20b47139a703550ef6
0928 14:50:29.399278 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.399352 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2853495}
I20260928 14:50:29.400352 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 350) took 2830 ms. Trace:
I20260928 14:50:29.400524 9815 ts_tablet_manager.cc:1918] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.400444 9814 rpcz_store.cc:276] 0928 14:50:26.569300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.569778 (+ 478us) service_pool.cc:227] Handling call
0928 14:50:29.399957 (+2830179us) ts_tablet_manager.cc:1145] Deleting tablet e89035a3d41a4af78a8e7afbdb89c7e0
0928 14:50:29.399966 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.400034 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2829935}
I20260928 14:50:29.400660 9815 log.cc:1196] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8b914e3c8243490d92378a8765d6390f
I20260928 14:50:29.400965 9815 ts_tablet_manager.cc:1939] T 8b914e3c8243490d92378a8765d6390f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.401667 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 351) took 2583 ms. Trace:
I20260928 14:50:29.401814 9814 rpcz_store.cc:276] 0928 14:50:26.817451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.817537 (+ 86us) service_pool.cc:227] Handling call
0928 14:50:29.400671 (+2583134us) ts_tablet_manager.cc:1145] Deleting tablet f3dee7ff6d5544908cdd9dbd45ce521a
0928 14:50:29.400680 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.400768 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2582897}
I20260928 14:50:29.403435 9814 tablet_replica.cc:330] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.403659 9814 raft_consensus.cc:2229] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.406096 9814 raft_consensus.cc:2258] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.406888 9851 tablet_bootstrap.cc:492] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:29.408311 9814 ts_tablet_manager.cc:1905] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.409592 9815 tablet_replica.cc:330] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.410006 9815 raft_consensus.cc:2229] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:29.410552 9815 raft_consensus.cc:2258] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.411379 9815 ts_tablet_manager.cc:1905] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.413810 9851 ts_tablet_manager.cc:1397] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.235s user 0.013s sys 0.025s
I20260928 14:50:29.414785 9851 raft_consensus.cc:348] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.415126 9851 raft_consensus.cc:374] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.415527 9851 raft_consensus.cc:729] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.415920 9851 consensus_queue.cc:260] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.416786 9851 ts_tablet_manager.cc:1428] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260928 14:50:29.421983 9360 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.422252 9360 leader_election.cc:302] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:29.422623 8940 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 88015bcd867e40e5b9263930e820074a (table default.Table_b9e0d1da94af43e98734c49c00835d4c [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:29.431241 9851 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:29.433352 9851 tablet_bootstrap.cc:654] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.433753 10054 raft_consensus.cc:482] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.433965 10054 raft_consensus.cc:504] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:29.436884 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 already in progress: creating tablet
I20260928 14:50:29.437088 10054 leader_election.cc:288] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:29.437141 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 45405.9us
W20260928 14:50:29.437408 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cf9342e920ae48278ab3f3c6d639fc94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9342e920ae48278ab3f3c6d639fc94 already in progress: creating tablet
I20260928 14:50:29.437747 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_c90b633274d340ef940d83bcbe55c632 [id=24b463abfd834c8b9c6f579d967741b2]) successfully deleted
I20260928 14:50:29.438252 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3c2b819b194d4373a59a3e94267361c1 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
I20260928 14:50:29.438469 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9648be4c626e44e0986c196704483955 (table default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]) successfully deleted
I20260928 14:50:29.438700 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c85735981779438197f2c0f489681b96 (table default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]) successfully deleted
W20260928 14:50:29.438921 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8af72ac7bedb4cd7aed28cffda867c96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af72ac7bedb4cd7aed28cffda867c96 already in progress: creating tablet
I20260928 14:50:29.439142 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8b914e3c8243490d92378a8765d6390f (table default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]) successfully deleted
W20260928 14:50:29.439342 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f1dacb0eef514609bcaf503ccc9845e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1dacb0eef514609bcaf503ccc9845e3 already in progress: creating tablet
W20260928 14:50:29.439575 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b already in progress: creating tablet
W20260928 14:50:29.439808 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 11f9b039838a430eac3fd422f0f4d087 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9b039838a430eac3fd422f0f4d087 already in progress: creating tablet
W20260928 14:50:29.440052 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 82a58b7387564863a2141a722003c5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82a58b7387564863a2141a722003c5d1 already in progress: creating tablet
I20260928 14:50:29.440249 9815 ts_tablet_manager.cc:1918] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 14:50:29.440279 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7a70f70162c2433aab5136514bd5fc03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a70f70162c2433aab5136514bd5fc03 already in progress: creating tablet
I20260928 14:50:29.441118 9815 log.cc:1196] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/bc3e689e2ffa4edb8ef1004287e40c99
I20260928 14:50:29.442152 9855 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.442322 9855 ts_tablet_manager.cc:1397] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.136s user 0.018s sys 0.023s
I20260928 14:50:29.443238 9855 raft_consensus.cc:348] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.443523 9855 raft_consensus.cc:374] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.443646 9855 raft_consensus.cc:729] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.443900 9855 consensus_queue.cc:260] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.444533 9855 ts_tablet_manager.cc:1428] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:29.444789 9815 ts_tablet_manager.cc:1939] T bc3e689e2ffa4edb8ef1004287e40c99 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.445127 9855 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.447043 10368 raft_consensus.cc:2726] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.449949 9855 tablet_bootstrap.cc:654] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.450165 9815 tablet_replica.cc:330] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.451354 9815 raft_consensus.cc:2229] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:29.451707 9815 raft_consensus.cc:2258] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.452268 9815 ts_tablet_manager.cc:1905] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.453222 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e53b8b73b37464687d343493d186660" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:29.453850 9498 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.458592 9813 ts_tablet_manager.cc:1918] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.460144 9813 log.cc:1196] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8218bc963a9941a49e8329d0a04d8252
I20260928 14:50:29.462633 9855 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.462838 9855 ts_tablet_manager.cc:1397] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260928 14:50:29.463495 9813 ts_tablet_manager.cc:1939] T 8218bc963a9941a49e8329d0a04d8252 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.463701 9855 raft_consensus.cc:348] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.463979 9855 raft_consensus.cc:374] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.464128 9855 raft_consensus.cc:729] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.464361 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 335) took 3560 ms. Trace:
I20260928 14:50:29.464430 9855 consensus_queue.cc:260] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.465139 9813 rpcz_store.cc:276] 0928 14:50:25.903852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.904078 (+ 226us) service_pool.cc:227] Handling call
0928 14:50:29.388587 (+3484509us) ts_tablet_manager.cc:1145] Deleting tablet 8218bc963a9941a49e8329d0a04d8252
0928 14:50:29.388596 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.445952 (+ 57356us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.458417 (+ 12465us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.464316 (+ 5899us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3484334}
I20260928 14:50:29.465197 9855 ts_tablet_manager.cc:1428] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:29.465818 9815 ts_tablet_manager.cc:1918] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:29.465246 9814 ts_tablet_manager.cc:1918] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:29.465319 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e53b8b73b37464687d343493d186660" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.466518 9814 log.cc:1196] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c9cee872de1f4ce8b803cb8e8fb018d2
I20260928 14:50:29.466549 9855 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.466961 9814 ts_tablet_manager.cc:1939] T c9cee872de1f4ce8b803cb8e8fb018d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:29.467742 9497 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.467866 9497 leader_election.cc:302] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.468209 10054 raft_consensus.cc:2726] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.468376 9815 log.cc:1196] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:29.465327 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.466143 9851 tablet_bootstrap.cc:492] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:29.468953 9851 ts_tablet_manager.cc:1397] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.004s
I20260928 14:50:29.469250 9815 ts_tablet_manager.cc:1939] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.473613 9855 tablet_bootstrap.cc:654] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.474422 9851 raft_consensus.cc:348] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.474690 9851 raft_consensus.cc:374] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.474783 9851 raft_consensus.cc:729] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.475185 9815 tablet_replica.cc:330] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.475615 9813 tablet_replica.cc:330] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.475807 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8218bc963a9941a49e8329d0a04d8252 (table default.Table_52d13edfb61a4b7aa82f6a3997a78f2c [id=77614b71faa3420291481f6e7c502533]) successfully deleted
I20260928 14:50:29.475941 9813 raft_consensus.cc:2229] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.476099 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.476158 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 352) took 2528 ms. Trace:
I20260928 14:50:29.476219 9813 raft_consensus.cc:2258] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.476279 9814 rpcz_store.cc:276] 0928 14:50:26.947684 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.947740 (+ 56us) service_pool.cc:227] Handling call
0928 14:50:29.402173 (+2454433us) ts_tablet_manager.cc:1145] Deleting tablet c9cee872de1f4ce8b803cb8e8fb018d2
0928 14:50:29.402183 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.412279 (+ 10096us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.436632 (+ 24353us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.476118 (+ 39486us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2454139}
I20260928 14:50:29.477231 9813 ts_tablet_manager.cc:1905] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.477741 9815 raft_consensus.cc:2229] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.478024 9815 raft_consensus.cc:2258] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.478967 9815 ts_tablet_manager.cc:1905] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.482900 9848 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.483273 9848 ts_tablet_manager.cc:1397] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.101s user 0.008s sys 0.004s
I20260928 14:50:29.483364 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.484362 9848 raft_consensus.cc:348] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.484710 9848 raft_consensus.cc:374] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.484845 9848 raft_consensus.cc:729] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.485143 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 1b22c3f9578a464a96be0bac6127e56d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.485193 9848 consensus_queue.cc:260] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.485459 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet c5c6b0867466459ca14413559800ff64 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.485914 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_26335d95c12a46e9a45f92335c09a089" } new_table_name: "default.Table_b7a4bbe399d049febce65ba67480aa5b" modify_external_catalogs: true
I20260928 14:50:29.487113 9848 ts_tablet_manager.cc:1428] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:29.488240 9848 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.493357 9848 tablet_bootstrap.cc:654] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.494184 9855 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.494841 9855 ts_tablet_manager.cc:1397] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.000s
I20260928 14:50:29.484323 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5166a828e84d46af3112cdc7bb0a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.495607 9855 raft_consensus.cc:348] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.495777 9848 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.495884 9855 raft_consensus.cc:374] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.496039 9855 raft_consensus.cc:729] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.496161 9814 tablet_replica.cc:330] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.496349 9848 ts_tablet_manager.cc:1397] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20260928 14:50:29.496330 9855 consensus_queue.cc:260] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.496557 9814 raft_consensus.cc:2229] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.496766 9814 raft_consensus.cc:2258] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.497403 9814 ts_tablet_manager.cc:1905] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:29.497787 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f consensus state has no leader
I20260928 14:50:29.498157 9848 raft_consensus.cc:348] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.498370 9848 raft_consensus.cc:374] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.498451 9848 raft_consensus.cc:729] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.499457 9855 ts_tablet_manager.cc:1428] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:29.500525 9855 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.500593 9848 consensus_queue.cc:260] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.501500 9851 consensus_queue.cc:260] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.503787 9848 ts_tablet_manager.cc:1428] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260928 14:50:29.504091 9848 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.506597 9851 ts_tablet_manager.cc:1428] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.034s user 0.000s sys 0.002s
I20260928 14:50:29.507468 9848 tablet_bootstrap.cc:654] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.511278 9815 ts_tablet_manager.cc:1918] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 14:50:29.511399 9815 log.cc:1196] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3d27738fcfbc42f298e26149dfd28182
I20260928 14:50:29.512874 9851 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:29.515041 9851 tablet_bootstrap.cc:654] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.519795 9813 ts_tablet_manager.cc:1918] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:29.525640 9855 tablet_bootstrap.cc:654] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.525609 9815 ts_tablet_manager.cc:1939] T 3d27738fcfbc42f298e26149dfd28182 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.527150 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c17c1cbf98644dbbac8e9d0865546c51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.527796 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c17c1cbf98644dbbac8e9d0865546c51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.530910 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1b22c3f9578a464a96be0bac6127e56d
I20260928 14:50:29.529275 9855 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.531242 9855 ts_tablet_manager.cc:1397] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260928 14:50:29.531487 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 1b22c3f9578a464a96be0bac6127e56d deleted and replaced by tablet b8738a1591f644758f44fc720fd694a3
I20260928 14:50:29.532042 9855 raft_consensus.cc:348] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.532219 9855 raft_consensus.cc:374] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.532318 9855 raft_consensus.cc:729] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.532550 9855 consensus_queue.cc:260] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.536183 9855 ts_tablet_manager.cc:1428] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:29.538573 9855 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.540540 9855 tablet_bootstrap.cc:654] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.541994 9815 tablet_replica.cc:330] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:29.542817 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_92d3b119492d4f65aa2b228040ac958f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.543638 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92d3b119492d4f65aa2b228040ac958f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.545555 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b22c3f9578a464a96be0bac6127e56d with delete_type TABLET_DATA_DELETED (replaced by tablet b8738a1591f644758f44fc720fd694a3) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.547055 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2d639e49570c44278e4e9dfbff7c7bab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.547614 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d639e49570c44278e4e9dfbff7c7bab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.550246 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4184ff7f97d64119a5a80a7baf746830" } modify_external_catalogs: true
I20260928 14:50:29.550366 9815 raft_consensus.cc:2229] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.550551 9815 raft_consensus.cc:2258] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.550588 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4184ff7f97d64119a5a80a7baf746830" } modify_external_catalogs: true
I20260928 14:50:29.550984 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a809f55fc9f74186ac02d15951aeff1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.551584 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a809f55fc9f74186ac02d15951aeff1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.550257 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_69359a2fb5f541a5a6f13af1a82119b2" } modify_external_catalogs: true
I20260928 14:50:29.552104 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_69359a2fb5f541a5a6f13af1a82119b2" } modify_external_catalogs: true
I20260928 14:50:29.553049 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 01c1e945f1c54281856bfabe08fba42e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.553560 9815 ts_tablet_manager.cc:1905] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.556125 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dcca53c9f1de4318950f7f3be0ef227f" } new_table_name: "default.Table_a2a8aa86e56f421b82a50a72786e472c" modify_external_catalogs: true
I20260928 14:50:29.556237 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e30db7589ca148c489d5e75da88d4412"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.556737 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e30db7589ca148c489d5e75da88d4412 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.557396 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b80c8683b20345bc9ade4e5fedccadb0" } modify_external_catalogs: true
I20260928 14:50:29.558295 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3de913f218814860a16fcc09f89fc8dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.558799 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3de913f218814860a16fcc09f89fc8dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.559270 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 0e661ac0a85949a280d837ee0357eea7 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
W20260928 14:50:29.559818 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 28ee844aa3c24336b4acb66dc43186e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ee844aa3c24336b4acb66dc43186e9 already in progress: creating tablet
W20260928 14:50:29.560985 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9648be4c626e44e0986c196704483955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9648be4c626e44e0986c196704483955 already in progress: creating tablet
W20260928 14:50:29.562032 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4bd612753b914a079ccf89249b073018 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd612753b914a079ccf89249b073018 already in progress: creating tablet
I20260928 14:50:29.563295 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b80c8683b20345bc9ade4e5fedccadb0" } modify_external_catalogs: true
W20260928 14:50:29.563125 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b already in progress: creating tablet
W20260928 14:50:29.565562 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f28a74dc0afe4f20b47139a703550ef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f28a74dc0afe4f20b47139a703550ef6 already in progress: creating tablet
W20260928 14:50:29.565934 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e89035a3d41a4af78a8e7afbdb89c7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89035a3d41a4af78a8e7afbdb89c7e0 already in progress: creating tablet
W20260928 14:50:29.566293 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f3dee7ff6d5544908cdd9dbd45ce521a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3dee7ff6d5544908cdd9dbd45ce521a already in progress: creating tablet
I20260928 14:50:29.566489 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c9cee872de1f4ce8b803cb8e8fb018d2 (table default.Table_6fbaf4d9bce042248e29b61994dc2384 [id=15559dd97c1d4d67bb24d208c0d2af7e]) successfully deleted
I20260928 14:50:29.567629 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae8348f77764a5e8787a33f657ca80d (DEFAULT_TABLE table=default.Table_18b0ab4255ca4b42a4c0f4e3312292f2 [id=b6f02064389b40e18b15d907ed70c02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.568063 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae8348f77764a5e8787a33f657ca80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.574129 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a50b4fe8d86464f933baec07478db25 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bea51859e0c4bc984288f94c2fcea2e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.576444 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 79f4b20a5e784d909f7297cc7f1b05e6
I20260928 14:50:29.576715 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 76a0117aff69403e816ff37592db935f (DEFAULT_TABLE table=default.Table_189ff43beccd48af8e898b45130b3595 [id=282988394f5c48779b485b8b67505cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.578004 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1016ad6219294ccd829fca9b264ab06f
I20260928 14:50:29.578086 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 4684ba575d9d45f3bb059a15efdd936d (DEFAULT_TABLE table=default.Table_b80c8683b20345bc9ade4e5fedccadb0 [id=6d30455519bb46d8a147dbd77e2a1537]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.579159 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f54c1b1f9054e1c9adfda720784e5a8 consensus state has no leader
I20260928 14:50:29.579241 9394 tablet_service.cc:1467] Processing CreateTablet for tablet d72c3c622ca0439686a7f13ab74f3abf (DEFAULT_TABLE table=default.Table_52368c8a8a824232a457354c4907c956 [id=606c4c67c6e84b42bf911bf48f4d79ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.579823 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 66096599d4c5458db2af10eb9bac947b (DEFAULT_TABLE table=default.Table_dbb8d20e6b3347098f4550902d7d6ce4 [id=8950fbd3e79c4d9eb9d51a3294b3f824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.580348 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.580655 9403 tablet_service.cc:1467] Processing CreateTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.581195 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a0117aff69403e816ff37592db935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.581663 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4684ba575d9d45f3bb059a15efdd936d
I20260928 14:50:29.582085 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 1016ad6219294ccd829fca9b264ab06f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.582921 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd (DEFAULT_TABLE table=default.Table_59caae98d16342cc8ea4b5b3e2f8fb76 [id=233b20f184344782ac0a084128931942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.583626 9401 tablet_service.cc:1467] Processing CreateTablet for tablet b8237f7d97304a98889bde6817358eda (DEFAULT_TABLE table=default.Table_bc56b27db3a9485ca73d987fdac482f8 [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.584041 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 4684ba575d9d45f3bb059a15efdd936d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.584388 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.584947 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b339b4e3cfbd40c1a35a4c6083926869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.585819 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8237f7d97304a98889bde6817358eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.588881 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d72c3c622ca0439686a7f13ab74f3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.590142 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66096599d4c5458db2af10eb9bac947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.593326 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f761337edf4a0f9e5dcda0ae28cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.598980 9814 ts_tablet_manager.cc:1918] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.603848 9814 log.cc:1196] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9b998502f90a4df08b4078f833ad8c05
I20260928 14:50:29.603940 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f (DEFAULT_TABLE table=default.Table_14c64dbddb824381846db69cd0640e63 [id=c3661daf210e487da61f9890001cf516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.604658 9814 ts_tablet_manager.cc:1939] T 9b998502f90a4df08b4078f833ad8c05 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.604749 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3abf8936d34eaba6d60245727738dc (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.605978 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4684ba575d9d45f3bb059a15efdd936d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.610862 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf (DEFAULT_TABLE table=default.Table_b3fa664a13f240a8ab876df02ff31cd3 [id=33d37caf528641b1866b37e9cfc8b723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.611233 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eaafbd52e464862ae0f0d44ffae58cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.611630 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 353) took 2663 ms. Trace:
I20260928 14:50:29.611810 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ade6066d90547b6bb9be50799bf8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.616405 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3abf8936d34eaba6d60245727738dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.616714 9814 rpcz_store.cc:276] 0928 14:50:26.947866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.948081 (+ 215us) service_pool.cc:227] Handling call
0928 14:50:29.495973 (+2547892us) ts_tablet_manager.cc:1145] Deleting tablet 9b998502f90a4df08b4078f833ad8c05
0928 14:50:29.496001 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.539938 (+ 43937us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.598865 (+ 58927us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.611575 (+ 12710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2547662}
I20260928 14:50:29.618309 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 354) took 2594 ms. Trace:
I20260928 14:50:29.619609 9814 rpcz_store.cc:276] 0928 14:50:27.023336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.023390 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:29.617918 (+2594528us) ts_tablet_manager.cc:1145] Deleting tablet 71b5f68b570e4fff8f8748e4c762ad78
0928 14:50:29.617930 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.618147 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2594216}
I20260928 14:50:29.620857 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 355) took 2344 ms. Trace:
I20260928 14:50:29.621660 9814 rpcz_store.cc:276] 0928 14:50:27.276247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.276297 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:29.620671 (+2344374us) ts_tablet_manager.cc:1145] Deleting tablet b9f843006a1e43a49f177433c7a3e1ea
0928 14:50:29.620682 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.620784 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344139}
I20260928 14:50:29.622676 9814 tablet_replica.cc:330] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.623364 9814 raft_consensus.cc:2229] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.624086 9814 raft_consensus.cc:2258] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.625099 9814 ts_tablet_manager.cc:1905] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.647416 9813 log.cc:1196] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2a30439ac5a8485a9b6ebbe1371087b1
I20260928 14:50:29.648595 9848 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.649923 9848 ts_tablet_manager.cc:1397] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.145s user 0.026s sys 0.026s
I20260928 14:50:29.653041 9848 raft_consensus.cc:348] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.654692 9848 raft_consensus.cc:374] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.654947 9848 raft_consensus.cc:729] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.656039 9848 consensus_queue.cc:260] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.656735 9848 ts_tablet_manager.cc:1428] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:29.661576 9848 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.662381 9814 ts_tablet_manager.cc:1918] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.662534 9814 log.cc:1196] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/32e7e11092d1475cba53e51a0f61d6f1
I20260928 14:50:29.663092 9814 ts_tablet_manager.cc:1939] T 32e7e11092d1475cba53e51a0f61d6f1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.663913 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 358) took 2295 ms. Trace:
I20260928 14:50:29.664129 9814 rpcz_store.cc:276] 0928 14:50:27.368581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.373989 (+ 5408us) service_pool.cc:227] Handling call
0928 14:50:29.622577 (+2248588us) ts_tablet_manager.cc:1145] Deleting tablet 32e7e11092d1475cba53e51a0f61d6f1
0928 14:50:29.622588 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.633119 (+ 10531us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.661427 (+ 28308us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.663874 (+ 2447us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2247996}
I20260928 14:50:29.664814 9813 ts_tablet_manager.cc:1939] T 2a30439ac5a8485a9b6ebbe1371087b1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.665462 9848 tablet_bootstrap.cc:654] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.666734 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 336) took 3762 ms. Trace:
I20260928 14:50:29.666846 9813 rpcz_store.cc:276] 0928 14:50:25.904030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.904335 (+ 305us) service_pool.cc:227] Handling call
0928 14:50:29.475488 (+3571153us) ts_tablet_manager.cc:1145] Deleting tablet 2a30439ac5a8485a9b6ebbe1371087b1
0928 14:50:29.475501 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.480347 (+ 4846us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.519674 (+ 39327us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.666680 (+147006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3570950}
I20260928 14:50:29.667294 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2a30439ac5a8485a9b6ebbe1371087b1 (table default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]) successfully deleted
I20260928 14:50:29.667733 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 337) took 3753 ms. Trace:
I20260928 14:50:29.667835 9813 rpcz_store.cc:276] 0928 14:50:25.914441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.914486 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:29.667567 (+3753081us) ts_tablet_manager.cc:1145] Deleting tablet 8234670cb2604ba7b405ad7f70e03a2f
0928 14:50:29.667577 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.667678 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3752874}
W20260928 14:50:29.668249 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8234670cb2604ba7b405ad7f70e03a2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8234670cb2604ba7b405ad7f70e03a2f already in progress: creating tablet
I20260928 14:50:29.668629 9813 tablet_replica.cc:330] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.668921 9813 raft_consensus.cc:2229] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:29.669608 9813 raft_consensus.cc:2258] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.679215 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 359) took 2227 ms. Trace:
I20260928 14:50:29.679371 9814 rpcz_store.cc:276] 0928 14:50:27.451626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.451676 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:29.679081 (+2227405us) ts_tablet_manager.cc:1145] Deleting tablet 24b256211679481eb0e0309c56ff60c6
0928 14:50:29.679091 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.679183 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2227176}
I20260928 14:50:29.686097 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b22c3f9578a464a96be0bac6127e56d with delete_type TABLET_DATA_DELETED (replaced by tablet b8738a1591f644758f44fc720fd694a3) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.687037 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd (DEFAULT_TABLE table=default.Table_59caae98d16342cc8ea4b5b3e2f8fb76 [id=233b20f184344782ac0a084128931942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.687474 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f761337edf4a0f9e5dcda0ae28cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.689841 9262 tablet_service.cc:1467] Processing CreateTablet for tablet b8237f7d97304a98889bde6817358eda (DEFAULT_TABLE table=default.Table_bc56b27db3a9485ca73d987fdac482f8 [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.690248 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8237f7d97304a98889bde6817358eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.691452 10054 raft_consensus.cc:482] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.691681 10054 raft_consensus.cc:504] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.693835 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 4684ba575d9d45f3bb059a15efdd936d (DEFAULT_TABLE table=default.Table_b80c8683b20345bc9ade4e5fedccadb0 [id=6d30455519bb46d8a147dbd77e2a1537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.694181 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4684ba575d9d45f3bb059a15efdd936d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.698652 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae8348f77764a5e8787a33f657ca80d (DEFAULT_TABLE table=default.Table_18b0ab4255ca4b42a4c0f4e3312292f2 [id=b6f02064389b40e18b15d907ed70c02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.699008 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae8348f77764a5e8787a33f657ca80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.701890 10365 raft_consensus.cc:482] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.702224 10365 raft_consensus.cc:504] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.703594 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296732efcb349ab9cc87e3ff1e11fd0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.704622 10365 leader_election.cc:288] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:29.705253 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc4c49a4962473699103528b64a1005" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:29.706907 9360 leader_election.cc:341] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.708108 10054 leader_election.cc:288] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:29.708395 10152 raft_consensus.cc:482] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.712738 10152 raft_consensus.cc:504] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.714653 9813 ts_tablet_manager.cc:1905] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.716743 10152 leader_election.cc:288] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:29.717262 9498 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.718119 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2898a032e1488b98c31b5e83371a71" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.718992 10371 raft_consensus.cc:482] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.719089 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2898a032e1488b98c31b5e83371a71" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.719158 10371 raft_consensus.cc:504] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.720758 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a50b4fe8d86464f933baec07478db25" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:29.721012 9360 leader_election.cc:341] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7cc4c49a4962473699103528b64a1005
I20260928 14:50:29.721262 9360 leader_election.cc:302] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:29.721019 9425 raft_consensus.cc:2454] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:29.722364 10365 raft_consensus.cc:2726] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.722810 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296732efcb349ab9cc87e3ff1e11fd0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.723479 9220 leader_election.cc:302] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:29.722697 10371 leader_election.cc:288] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:29.724185 10371 raft_consensus.cc:2781] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:29.724433 10371 raft_consensus.cc:482] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:29.724560 10371 raft_consensus.cc:3037] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.727859 10371 raft_consensus.cc:504] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.728865 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a50b4fe8d86464f933baec07478db25" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:29.729070 9425 raft_consensus.cc:3037] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.731889 9425 raft_consensus.cc:2454] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:29.732425 9220 leader_election.cc:302] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
W20260928 14:50:29.733034 9498 leader_election.cc:341] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.733330 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b22c3f9578a464a96be0bac6127e56d with delete_type TABLET_DATA_DELETED (replaced by tablet b8738a1591f644758f44fc720fd694a3) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.734460 10068 raft_consensus.cc:2781] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:29.734604 10068 raft_consensus.cc:686] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
W20260928 14:50:29.734833 9497 leader_election.cc:341] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.734967 9497 leader_election.cc:302] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.735714 10152 raft_consensus.cc:2726] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.736706 9497 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.736608 10068 consensus_queue.cc:237] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.736807 9497 leader_election.cc:302] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.737362 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 360) took 2262 ms. Trace:
I20260928 14:50:29.737957 9814 rpcz_store.cc:276] 0928 14:50:27.474699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.474748 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:29.732962 (+2258214us) ts_tablet_manager.cc:1145] Deleting tablet 73bbcf31960d478087a0a91337c34ec8
0928 14:50:29.732974 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.737322 (+ 4348us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2253920}
I20260928 14:50:29.738407 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 361) took 2235 ms. Trace:
I20260928 14:50:29.738543 9814 rpcz_store.cc:276] 0928 14:50:27.502784 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.502830 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:29.738269 (+2235439us) ts_tablet_manager.cc:1145] Deleting tablet cadfdf093ab04b61af441cff6c9c510b
0928 14:50:29.738280 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.738369 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2235246}
I20260928 14:50:29.738888 9814 tablet_replica.cc:330] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.739122 9814 raft_consensus.cc:2229] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.739275 9814 raft_consensus.cc:2258] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.739687 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 7ae8348f77764a5e8787a33f657ca80d (DEFAULT_TABLE table=default.Table_18b0ab4255ca4b42a4c0f4e3312292f2 [id=b6f02064389b40e18b15d907ed70c02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.739797 9814 ts_tablet_manager.cc:1905] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:29.738097 9219 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6a50b4fe8d86464f933baec07478db25
I20260928 14:50:29.687614 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]) successfully deleted
W20260928 14:50:29.740891 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 53274.9us
I20260928 14:50:29.740921 9534 tablet_service.cc:1467] Processing CreateTablet for tablet b8237f7d97304a98889bde6817358eda (DEFAULT_TABLE table=default.Table_bc56b27db3a9485ca73d987fdac482f8 [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.741122 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a753aaf7f8c4498b6ba35fa27d8c537 already in progress: creating tablet
W20260928 14:50:29.741173 9219 leader_election.cc:341] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6a50b4fe8d86464f933baec07478db25
I20260928 14:50:29.741495 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd (DEFAULT_TABLE table=default.Table_59caae98d16342cc8ea4b5b3e2f8fb76 [id=233b20f184344782ac0a084128931942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.741773 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]) successfully deleted
I20260928 14:50:29.741842 9848 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.741972 9848 ts_tablet_manager.cc:1397] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.083s user 0.018s sys 0.018s
I20260928 14:50:29.741969 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]) successfully deleted
W20260928 14:50:29.742255 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5b695c68118b49359f1899d30208b1b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b695c68118b49359f1899d30208b1b7 already in progress: creating tablet
W20260928 14:50:29.742785 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 86f11c5ca3154bac934cae3842f16de4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f11c5ca3154bac934cae3842f16de4 already in progress: creating tablet
I20260928 14:50:29.742841 10152 raft_consensus.cc:2726] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.743010 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7ef356a4c9d34af4b300d38eab49a569 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef356a4c9d34af4b300d38eab49a569 already in progress: creating tablet
W20260928 14:50:29.743197 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c6b4b4c775fe4eacaaa557d4daa2a600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b4b4c775fe4eacaaa557d4daa2a600 already in progress: creating tablet
W20260928 14:50:29.743391 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4744deca899b4e6caa57f70ce1df8a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4744deca899b4e6caa57f70ce1df8a8d already in progress: creating tablet
W20260928 14:50:29.743566 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a303792e4c804844bc6037fabb425be4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a303792e4c804844bc6037fabb425be4 already in progress: creating tablet
I20260928 14:50:29.743458 9848 raft_consensus.cc:348] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:29.743759 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet be232889594147bdbe2d4825c3e8c7d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be232889594147bdbe2d4825c3e8c7d0 already in progress: creating tablet
W20260928 14:50:29.743927 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet dc8400fdb8d948b084733011b16df1b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc8400fdb8d948b084733011b16df1b3 already in progress: creating tablet
I20260928 14:50:29.743937 9848 raft_consensus.cc:374] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.744158 9848 raft_consensus.cc:729] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.744520 9287 raft_consensus.cc:3037] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.744410 9848 consensus_queue.cc:260] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.744654 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_63cbd45ae23a4ee7ac51f928b7613600"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:29.745064 9848 ts_tablet_manager.cc:1428] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260928 14:50:29.745200 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63cbd45ae23a4ee7ac51f928b7613600 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.746444 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c7687d91f40d47c99ca2f22db2dd127d" } modify_external_catalogs: true
I20260928 14:50:29.746640 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c7687d91f40d47c99ca2f22db2dd127d" } modify_external_catalogs: true
I20260928 14:50:29.746714 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_37089a672aa04a4dbbd1bdc4e6bc7f4a" } new_table_name: "default.Table_8071c3ffdde14e4ea2b4f2eae4596529" modify_external_catalogs: true
I20260928 14:50:29.747190 9848 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.747176 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f39bb48fe52441c5a026c16c6230bd76" } modify_external_catalogs: true
I20260928 14:50:29.747371 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f39bb48fe52441c5a026c16c6230bd76" } modify_external_catalogs: true
I20260928 14:50:29.747915 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f573f1430fb34a24978cb467dd065e73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.748469 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f573f1430fb34a24978cb467dd065e73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.749635 9848 tablet_bootstrap.cc:654] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.751082 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e314d6b2a6bb4dbcaa7c626dd204434d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.751576 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e314d6b2a6bb4dbcaa7c626dd204434d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.752743 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eba035915e264e878ed46dfadc6f379d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.753222 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eba035915e264e878ed46dfadc6f379d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.754272 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6aecd9c9eb214e7b8ee8656d158656d0" } new_table_name: "default.Table_ce86cfe203734bd4bd139c7bf581ac85" modify_external_catalogs: true
I20260928 14:50:29.755442 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_557fd68bac1a42fc8085e5565fed4304" } new_table_name: "default.Table_a0f0a244b6ba408d913cec35fdead9db" modify_external_catalogs: true
I20260928 14:50:29.759773 9848 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.760048 9848 ts_tablet_manager.cc:1397] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.010s
I20260928 14:50:29.761281 9848 raft_consensus.cc:348] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.761716 9848 raft_consensus.cc:374] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.761940 9848 raft_consensus.cc:729] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.762336 9848 consensus_queue.cc:260] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.762491 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f761337edf4a0f9e5dcda0ae28cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.763734 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8237f7d97304a98889bde6817358eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.763872 9848 ts_tablet_manager.cc:1428] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:29.764570 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ae8348f77764a5e8787a33f657ca80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.764873 9848 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.766479 9848 tablet_bootstrap.cc:654] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.768695 9815 ts_tablet_manager.cc:1918] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.768850 9815 log.cc:1196] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/0e53b8b73b37464687d343493d186660
I20260928 14:50:29.769253 9815 ts_tablet_manager.cc:1939] T 0e53b8b73b37464687d343493d186660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:29.769629 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 4684ba575d9d45f3bb059a15efdd936d (DEFAULT_TABLE table=default.Table_b80c8683b20345bc9ade4e5fedccadb0 [id=6d30455519bb46d8a147dbd77e2a1537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.770040 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4684ba575d9d45f3bb059a15efdd936d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.771751 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 76a0117aff69403e816ff37592db935f (DEFAULT_TABLE table=default.Table_189ff43beccd48af8e898b45130b3595 [id=282988394f5c48779b485b8b67505cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.772083 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a0117aff69403e816ff37592db935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.787665 9534 tablet_service.cc:1467] Processing CreateTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.788333 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b339b4e3cfbd40c1a35a4c6083926869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.789263 9848 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.789590 9848 ts_tablet_manager.cc:1397] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.006s
I20260928 14:50:29.789765 9855 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.789992 9855 ts_tablet_manager.cc:1397] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.252s user 0.082s sys 0.086s
I20260928 14:50:29.791181 9848 raft_consensus.cc:348] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.791510 9848 raft_consensus.cc:374] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.791695 9848 raft_consensus.cc:729] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.792073 9848 consensus_queue.cc:260] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.794543 9848 ts_tablet_manager.cc:1428] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:29.794934 9848 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.798846 9813 ts_tablet_manager.cc:1918] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 14:50:29.803727 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e13976317a32495ab377654b738667ca consensus state has no leader
W20260928 14:50:29.804133 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7376f56883dc4032b120cc4494fa8936 consensus state has no leader
W20260928 14:50:29.804621 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39091da7a6fb4aceadd3434bd304c268 consensus state has no leader
I20260928 14:50:29.805737 9813 log.cc:1196] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/17d7539290064c2c9fda29a5f16d375b
W20260928 14:50:29.799979 9360 consensus_peers.cc:487] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:29.808068 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:29.808732 9813 ts_tablet_manager.cc:1939] T 17d7539290064c2c9fda29a5f16d375b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.809125 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 339) took 3868 ms. Trace:
I20260928 14:50:29.809242 9813 rpcz_store.cc:276] 0928 14:50:25.940700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:25.940743 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:29.668487 (+3727744us) ts_tablet_manager.cc:1145] Deleting tablet 17d7539290064c2c9fda29a5f16d375b
0928 14:50:29.668497 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.748133 (+ 79636us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.798696 (+ 50563us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.809093 (+ 10397us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3727558}
I20260928 14:50:29.809484 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9b998502f90a4df08b4078f833ad8c05 (table default.Table_d83ce30f16b64ea3b15795a1e1794df9 [id=38b992583c1741329584f34379a32cae]) successfully deleted
I20260928 14:50:29.810220 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 351) took 3696 ms. Trace:
I20260928 14:50:29.810483 9813 rpcz_store.cc:276] 0928 14:50:26.113478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.113555 (+ 77us) service_pool.cc:227] Handling call
0928 14:50:29.810013 (+3696458us) ts_tablet_manager.cc:1145] Deleting tablet 69e3c8ef3e20451dbf91b671655974e5
0928 14:50:29.810025 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.810143 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3690119}
I20260928 14:50:29.811077 9813 tablet_replica.cc:330] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.811547 9813 raft_consensus.cc:2229] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:29.811962 9813 pending_rounds.cc:62] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:29.809825 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 17d7539290064c2c9fda29a5f16d375b (table default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]) successfully deleted
I20260928 14:50:29.812215 9813 pending_rounds.cc:68] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326381180436480 op_type: NO_OP noop_request { }
I20260928 14:50:29.812469 9813 raft_consensus.cc:2866] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:29.812631 9813 raft_consensus.cc:2258] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:29.812695 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 69e3c8ef3e20451dbf91b671655974e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69e3c8ef3e20451dbf91b671655974e5 already in progress: creating tablet
I20260928 14:50:29.813258 9813 ts_tablet_manager.cc:1905] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.813966 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd00b9377b245a29d2a6735248112bc (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.814397 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd00b9377b245a29d2a6735248112bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.816098 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.816516 9399 tablet_service.cc:1467] Processing CreateTablet for tablet fbf7193095e54214a5b9241728239c8c (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.816973 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf7193095e54214a5b9241728239c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.821929 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.791290 9855 raft_consensus.cc:348] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.822201 9855 raft_consensus.cc:374] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.822301 9855 raft_consensus.cc:729] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.822525 9855 consensus_queue.cc:260] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.800570 9848 tablet_bootstrap.cc:654] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.823338 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 39091da7a6fb4aceadd3434bd304c268 (DEFAULT_TABLE table=default.Table_8071c3ffdde14e4ea2b4f2eae4596529 [id=f759fe3632ad445ebf1d7bcc1c5aed70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.823697 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39091da7a6fb4aceadd3434bd304c268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.823889 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce (DEFAULT_TABLE table=default.Table_92d3b119492d4f65aa2b228040ac958f [id=f9c8e9781b03480f8a6500e36500ddfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.824337 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 504c0f61d8844bd18062a3b40cd6f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.824288 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 5d08466aa7d54f12b137986258a6d174 (DEFAULT_TABLE table=default.Table_2d639e49570c44278e4e9dfbff7c7bab [id=aede97bb521e444299de23f07bf2f10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.824664 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d08466aa7d54f12b137986258a6d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.827011 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 69239e1cc64f40e59f14c3716437de54 (DEFAULT_TABLE table=default.Table_aa976d19165445859cf0a1d3b9c21d13 [id=cb81b545941c499795b85f3eabbd8dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.827396 9855 ts_tablet_manager.cc:1428] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.037s user 0.000s sys 0.003s
I20260928 14:50:29.827466 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69239e1cc64f40e59f14c3716437de54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.827766 9855 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.830087 10371 leader_election.cc:288] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:29.797904 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 66096599d4c5458db2af10eb9bac947b (DEFAULT_TABLE table=default.Table_dbb8d20e6b3347098f4550902d7d6ce4 [id=8950fbd3e79c4d9eb9d51a3294b3f824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.833123 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66096599d4c5458db2af10eb9bac947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.833402 10152 raft_consensus.cc:482] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.833634 10152 raft_consensus.cc:504] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.833830 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4a14c0b50cad4954b5dc5666689810ba
I20260928 14:50:29.834348 10152 leader_election.cc:288] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:29.834838 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a14c0b50cad4954b5dc5666689810ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.835455 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "852b70b1f7444ad2ab92d66d580a0db7" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:29.798751 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.835793 9401 tablet_service.cc:1467] Processing CreateTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b (DEFAULT_TABLE table=default.Table_8bc54dd6856f4710b282b4dce6e03df6 [id=e86c3a2c8e854a01b2a335b1f05dc4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.800024 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 1016ad6219294ccd829fca9b264ab06f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:29.835999 9498 leader_election.cc:341] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.836125 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.837914 9848 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:29.838130 9848 ts_tablet_manager.cc:1397] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.002s
I20260928 14:50:29.838301 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 72cab768a1194a9c9ef3e3ab15d0f449 (DEFAULT_TABLE table=default.Table_0ec043b67faf4e26b3d57fae00217781 [id=c9890f73b6de4b249308da6ee13f2db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.838653 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72cab768a1194a9c9ef3e3ab15d0f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.838953 9848 raft_consensus.cc:348] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.839174 9848 raft_consensus.cc:374] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.839249 9848 raft_consensus.cc:729] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.839478 9848 consensus_queue.cc:260] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.801163 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 4684ba575d9d45f3bb059a15efdd936d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.805053 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3abf8936d34eaba6d60245727738dc (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.839987 9848 ts_tablet_manager.cc:1428] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:29.839923 9264 tablet_service.cc:1467] Processing CreateTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.840319 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b339b4e3cfbd40c1a35a4c6083926869. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:29.840286 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 71b5f68b570e4fff8f8748e4c762ad78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b5f68b570e4fff8f8748e4c762ad78 already in progress: creating tablet
I20260928 14:50:29.808990 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf (DEFAULT_TABLE table=default.Table_b3fa664a13f240a8ab876df02ff31cd3 [id=33d37caf528641b1866b37e9cfc8b723]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.840708 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b9f843006a1e43a49f177433c7a3e1ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9f843006a1e43a49f177433c7a3e1ea already in progress: creating tablet
I20260928 14:50:29.843309 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "852b70b1f7444ad2ab92d66d580a0db7" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.843709 10365 raft_consensus.cc:482] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.832520 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 76a0117aff69403e816ff37592db935f (DEFAULT_TABLE table=default.Table_189ff43beccd48af8e898b45130b3595 [id=282988394f5c48779b485b8b67505cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.845250 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 32e7e11092d1475cba53e51a0f61d6f1 (table default.Table_8b9e5857660a46159398f3e1588dadad [id=e2618fe876734b95b5cfd31b442a28c3]) successfully deleted
W20260928 14:50:29.846267 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 24b256211679481eb0e0309c56ff60c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24b256211679481eb0e0309c56ff60c6 already in progress: creating tablet
I20260928 14:50:29.847081 10365 raft_consensus.cc:504] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:29.847308 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 73bbcf31960d478087a0a91337c34ec8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73bbcf31960d478087a0a91337c34ec8 already in progress: creating tablet
W20260928 14:50:29.847513 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cadfdf093ab04b61af441cff6c9c510b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cadfdf093ab04b61af441cff6c9c510b already in progress: creating tablet
I20260928 14:50:29.847671 10365 leader_election.cc:288] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:29.805346 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f (DEFAULT_TABLE table=default.Table_14c64dbddb824381846db69cd0640e63 [id=c3661daf210e487da61f9890001cf516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.848166 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2dd699271542bd9b9604e746686c53" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.803179 9535 tablet_service.cc:1467] Processing CreateTablet for tablet d72c3c622ca0439686a7f13ab74f3abf (DEFAULT_TABLE table=default.Table_52368c8a8a824232a457354c4907c956 [id=606c4c67c6e84b42bf911bf48f4d79ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.848764 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76a0117aff69403e816ff37592db935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.848085 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3abf8936d34eaba6d60245727738dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:29.848827 9360 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:29.849723 9497 leader_election.cc:341] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.849896 9497 leader_election.cc:302] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.850278 10152 raft_consensus.cc:2726] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.850304 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.851248 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eaafbd52e464862ae0f0d44ffae58cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.852411 9267 tablet_service.cc:1467] Processing CreateTablet for tablet d72c3c622ca0439686a7f13ab74f3abf (DEFAULT_TABLE table=default.Table_52368c8a8a824232a457354c4907c956 [id=606c4c67c6e84b42bf911bf48f4d79ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.852833 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 66096599d4c5458db2af10eb9bac947b (DEFAULT_TABLE table=default.Table_dbb8d20e6b3347098f4550902d7d6ce4 [id=8950fbd3e79c4d9eb9d51a3294b3f824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.853324 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d72c3c622ca0439686a7f13ab74f3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.853751 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ade6066d90547b6bb9be50799bf8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.857417 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 4684ba575d9d45f3bb059a15efdd936d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.857748 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d72c3c622ca0439686a7f13ab74f3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.858047 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f (DEFAULT_TABLE table=default.Table_14c64dbddb824381846db69cd0640e63 [id=c3661daf210e487da61f9890001cf516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.858078 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3abf8936d34eaba6d60245727738dc (DEFAULT_TABLE table=default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.858330 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66096599d4c5458db2af10eb9bac947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.860486 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3abf8936d34eaba6d60245727738dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.862665 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8f2898a032e1488b98c31b5e83371a71
I20260928 14:50:29.864841 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 1016ad6219294ccd829fca9b264ab06f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.868867 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ade6066d90547b6bb9be50799bf8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.870354 9851 tablet_bootstrap.cc:492] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:29.871357 9851 ts_tablet_manager.cc:1397] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.358s user 0.013s sys 0.020s
I20260928 14:50:29.878844 9855 tablet_bootstrap.cc:654] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.882889 9848 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:29.886253 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd00b9377b245a29d2a6735248112bc (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.886767 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd00b9377b245a29d2a6735248112bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:29.889467 9360 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cf2dd699271542bd9b9604e746686c53
I20260928 14:50:29.889648 10365 raft_consensus.cc:482] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.889714 9360 leader_election.cc:302] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:29.889854 10365 raft_consensus.cc:504] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.892158 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce (DEFAULT_TABLE table=default.Table_92d3b119492d4f65aa2b228040ac958f [id=f9c8e9781b03480f8a6500e36500ddfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.892606 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 504c0f61d8844bd18062a3b40cd6f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.893149 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:29.893396 9569 raft_consensus.cc:2454] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:29.893994 9393 tablet_service.cc:1467] Processing CreateTablet for tablet b8738a1591f644758f44fc720fd694a3 (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.895364 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf (DEFAULT_TABLE table=default.Table_b3fa664a13f240a8ab876df02ff31cd3 [id=33d37caf528641b1866b37e9cfc8b723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.897959 9396 tablet_service.cc:1467] Processing CreateTablet for tablet a067ac578184491c8862fcea2c0ffc43 (DEFAULT_TABLE table=default.Table_56a26be7b12646229ddff62c431dd486 [id=3525e58e4b064de48e9ae8fa5d452756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.898299 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 69239e1cc64f40e59f14c3716437de54 (DEFAULT_TABLE table=default.Table_aa976d19165445859cf0a1d3b9c21d13 [id=cb81b545941c499795b85f3eabbd8dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.898821 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69239e1cc64f40e59f14c3716437de54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.899922 10365 leader_election.cc:288] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:29.895416 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd00b9377b245a29d2a6735248112bc (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.897271 9814 ts_tablet_manager.cc:1918] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:29.897838 9851 raft_consensus.cc:348] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.900213 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce (DEFAULT_TABLE table=default.Table_92d3b119492d4f65aa2b228040ac958f [id=f9c8e9781b03480f8a6500e36500ddfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.901328 9255 tablet_service.cc:1467] Processing CreateTablet for tablet fbf7193095e54214a5b9241728239c8c (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.901796 9814 log.cc:1196] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6ffd9bc260ae4373a946ce82ba5f0d48
I20260928 14:50:29.902731 9814 ts_tablet_manager.cc:1939] T 6ffd9bc260ae4373a946ce82ba5f0d48 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:29.903064 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:29.904320 9851 raft_consensus.cc:374] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.904484 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd00b9377b245a29d2a6735248112bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.905479 9851 raft_consensus.cc:729] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.905704 10371 raft_consensus.cc:482] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.905889 10371 raft_consensus.cc:504] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.906220 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 5d08466aa7d54f12b137986258a6d174 (DEFAULT_TABLE table=default.Table_2d639e49570c44278e4e9dfbff7c7bab [id=aede97bb521e444299de23f07bf2f10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.907068 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf7193095e54214a5b9241728239c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.907270 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d08466aa7d54f12b137986258a6d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.908887 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 504c0f61d8844bd18062a3b40cd6f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.912981 9851 consensus_queue.cc:260] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:29.910832 10215 raft_consensus.cc:2726] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.915716 9219 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:29.915957 10371 leader_election.cc:288] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:29.916221 9220 leader_election.cc:341] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:29.916332 9220 leader_election.cc:302] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.907226 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.918540 9360 leader_election.cc:302] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:29.915098 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 39091da7a6fb4aceadd3434bd304c268 (DEFAULT_TABLE table=default.Table_8071c3ffdde14e4ea2b4f2eae4596529 [id=f759fe3632ad445ebf1d7bcc1c5aed70]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.918999 9360 leader_election.cc:341] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.919790 10371 raft_consensus.cc:2726] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:29.920579 9851 ts_tablet_manager.cc:1428] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.042s user 0.002s sys 0.001s
I20260928 14:50:29.920864 9851 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:29.922077 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 5d08466aa7d54f12b137986258a6d174 (DEFAULT_TABLE table=default.Table_2d639e49570c44278e4e9dfbff7c7bab [id=aede97bb521e444299de23f07bf2f10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.922739 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 69239e1cc64f40e59f14c3716437de54 (DEFAULT_TABLE table=default.Table_aa976d19165445859cf0a1d3b9c21d13 [id=cb81b545941c499795b85f3eabbd8dff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.923099 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 363) took 2343 ms. Trace:
I20260928 14:50:29.923202 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a14c0b50cad4954b5dc5666689810ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.923290 9814 rpcz_store.cc:276] 0928 14:50:27.569240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.569297 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:29.738809 (+2169512us) ts_tablet_manager.cc:1145] Deleting tablet 6ffd9bc260ae4373a946ce82ba5f0d48
0928 14:50:29.738819 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.833328 (+ 94509us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.897177 (+ 63849us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.908008 (+ 10831us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x618000005118. stack: 00007fdd1550c66e 00007fdd1550c430 00007fdd145935ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fdd155020fd 00007fdd1550316e 00007fdd28457cfd 00007fdd283d5883 00007fdd24677752 00007fdd246a9404 00007fdd2468a870 00007fdd2468a5fd 00000000009edb7c 00007fdd15552344
0928 14:50:29.912895 (+ 4887us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2455424,"tablet-delete.queue_time_us":2169242}
I20260928 14:50:29.923714 9536 tablet_service.cc:1467] Processing CreateTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b (DEFAULT_TABLE table=default.Table_8bc54dd6856f4710b282b4dce6e03df6 [id=e86c3a2c8e854a01b2a335b1f05dc4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.924031 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eaafbd52e464862ae0f0d44ffae58cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.924075 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.926726 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d08466aa7d54f12b137986258a6d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.926790 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2898a032e1488b98c31b5e83371a71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:29.926944 9406 tablet_service.cc:1467] Processing CreateTablet for tablet baa80c213f3f4aa9976cc285f6564e0f (DEFAULT_TABLE table=default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.927145 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8738a1591f644758f44fc720fd694a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.927557 9252 tablet_service.cc:1467] Processing CreateTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b (DEFAULT_TABLE table=default.Table_8bc54dd6856f4710b282b4dce6e03df6 [id=e86c3a2c8e854a01b2a335b1f05dc4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.929582 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39091da7a6fb4aceadd3434bd304c268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.929594 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 (DEFAULT_TABLE table=default.Table_f573f1430fb34a24978cb467dd065e73 [id=4d5ddc7ef39d4d6a88121b4c39d44cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.929888 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b6e4ce1f9eed42abb3688716dc6733cf (DEFAULT_TABLE table=default.Table_a809f55fc9f74186ac02d15951aeff1e [id=9cfcf70c9f6e4c8eb485c2f1ecd5a3d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.930347 9397 tablet_service.cc:1467] Processing CreateTablet for tablet f385d804a10442e3b725a86e201dd6a5 (DEFAULT_TABLE table=default.Table_8788bca431d24b76960a8ce26a49831c [id=efe7bcff144d4a8b87d5cfc0545b55a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.933454 10215 raft_consensus.cc:2781] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:29.933624 9388 tablet_service.cc:1467] Processing CreateTablet for tablet bd9cedadc7184013a37857206bec2ff0 (DEFAULT_TABLE table=default.Table_c17c1cbf98644dbbac8e9d0865546c51 [id=4c915e1e70fc416eadaec3c812915746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.934163 9543 tablet_service.cc:1467] Processing CreateTablet for tablet fbf7193095e54214a5b9241728239c8c (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.935240 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbf7193095e54214a5b9241728239c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.937484 9814 tablet_replica.cc:330] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:29.938258 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.938417 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 299ed0acd7cf46d3b78f4f4cea31858f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.939437 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 69ef1340deca4f00a250c390afcb5064 (DEFAULT_TABLE table=default.Table_63cbd45ae23a4ee7ac51f928b7613600 [id=2c9c5608bca44d7da4970e7173316f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.938242 9814 raft_consensus.cc:2229] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.941401 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69239e1cc64f40e59f14c3716437de54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.942693 9814 raft_consensus.cc:2258] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.944809 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 0e53b8b73b37464687d343493d186660 (table default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]) successfully deleted
W20260928 14:50:29.945083 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1b22c3f9578a464a96be0bac6127e56d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b22c3f9578a464a96be0bac6127e56d already in progress: creating tablet
W20260928 14:50:29.945289 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 79f4b20a5e784d909f7297cc7f1b05e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f4b20a5e784d909f7297cc7f1b05e6 already in progress: creating tablet
I20260928 14:50:29.945502 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 72cab768a1194a9c9ef3e3ab15d0f449 (DEFAULT_TABLE table=default.Table_0ec043b67faf4e26b3d57fae00217781 [id=c9890f73b6de4b249308da6ee13f2db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.945574 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 71a94a7a6c81453c8e47149be3d6479e (DEFAULT_TABLE table=default.Table_e314d6b2a6bb4dbcaa7c626dd204434d [id=01f39971be5e45b79aec08b7bbfdb1d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.945920 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a14c0b50cad4954b5dc5666689810ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:29.948837 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72cab768a1194a9c9ef3e3ab15d0f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.949420 10152 raft_consensus.cc:482] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:29.949661 9814 ts_tablet_manager.cc:1905] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.949628 10152 raft_consensus.cc:504] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:29.950263 10152 leader_election.cc:288] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:29.950886 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:29.951493 9498 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:29.951957 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1016ad6219294ccd829fca9b264ab06f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1016ad6219294ccd829fca9b264ab06f already in progress: creating tablet
I20260928 14:50:29.952055 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:29.952505 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4684ba575d9d45f3bb059a15efdd936d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4684ba575d9d45f3bb059a15efdd936d already in progress: creating tablet
W20260928 14:50:29.952530 9497 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:29.952651 9497 leader_election.cc:302] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:29.952962 10152 raft_consensus.cc:2726] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:29.953128 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4a14c0b50cad4954b5dc5666689810ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a14c0b50cad4954b5dc5666689810ba already in progress: creating tablet
I20260928 14:50:29.953634 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4ee63f2eb220459da4d35cfe89592798" } new_table_name: "default.Table_e2b36f27809f43e0950c5f002e20c7f6" modify_external_catalogs: true
I20260928 14:50:29.954568 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 39091da7a6fb4aceadd3434bd304c268 (DEFAULT_TABLE table=default.Table_8071c3ffdde14e4ea2b4f2eae4596529 [id=f759fe3632ad445ebf1d7bcc1c5aed70]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:29.961093 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 consensus state has no leader
I20260928 14:50:29.962710 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39091da7a6fb4aceadd3434bd304c268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.962858 9813 ts_tablet_manager.cc:1918] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:29.962971 9813 log.cc:1196] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9d5166a828e84d46af3112cdc7bb0a2a
I20260928 14:50:29.963341 9813 ts_tablet_manager.cc:1939] T 9d5166a828e84d46af3112cdc7bb0a2a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:29.963663 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 353) took 3677 ms. Trace:
I20260928 14:50:29.963845 9851 tablet_bootstrap.cc:654] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.963909 9813 rpcz_store.cc:276] 0928 14:50:26.285873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.285925 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:29.810959 (+3525034us) ts_tablet_manager.cc:1145] Deleting tablet 9d5166a828e84d46af3112cdc7bb0a2a
0928 14:50:29.810971 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:29.829326 (+ 18355us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.933357 (+104031us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:29.963632 (+ 30275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3524783}
I20260928 14:50:29.964265 9813 tablet_replica.cc:330] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:29.964461 9813 raft_consensus.cc:2229] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:29.964630 9813 raft_consensus.cc:2258] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:29.965142 9813 ts_tablet_manager.cc:1905] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:29.965281 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8e4357c3d5487fa76e1e49c6cb7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.957335 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 72cab768a1194a9c9ef3e3ab15d0f449 (DEFAULT_TABLE table=default.Table_0ec043b67faf4e26b3d57fae00217781 [id=c9890f73b6de4b249308da6ee13f2db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.968315 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72cab768a1194a9c9ef3e3ab15d0f449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.962407 9855 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:29.969437 9855 ts_tablet_manager.cc:1397] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.142s user 0.001s sys 0.002s
I20260928 14:50:29.969605 10215 raft_consensus.cc:482] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:29.969734 10215 raft_consensus.cc:3037] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.970500 9855 raft_consensus.cc:348] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.970767 9855 raft_consensus.cc:374] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:29.970845 9855 raft_consensus.cc:729] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:29.971076 9855 consensus_queue.cc:260] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.972241 10215 raft_consensus.cc:504] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:29.972795 10215 leader_election.cc:288] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:29.973065 9855 ts_tablet_manager.cc:1428] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:29.973373 9855 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:29.975708 9855 tablet_bootstrap.cc:654] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:29.977020 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 2e16a0f674114ac8b4520fbce2d383d8 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.977090 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet f095e4cbf95147d9afb83434ae1fd29f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:29.977458 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a4a12967058f480baef98a006acfd807"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:29.977909 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0e7323af5cb8442585fc497fd5029809"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:29.978139 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4a12967058f480baef98a006acfd807 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:29.978590 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e7323af5cb8442585fc497fd5029809 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:29.980304 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f385d804a10442e3b725a86e201dd6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.982023 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6ffd9bc260ae4373a946ce82ba5f0d48 (table default.Table_66332b3d2ff9456496408d9a898ed929 [id=01ab7b5b658e40b4b23c3c9b8ab6b65c]) successfully deleted
I20260928 14:50:29.982012 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:29.982183 9569 raft_consensus.cc:3037] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:29.982434 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e4ce1f9eed42abb3688716dc6733cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.985535 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2e16a0f674114ac8b4520fbce2d383d8
I20260928 14:50:29.986043 8955 catalog_manager.cc:6565] ReplaceTablet: tablet 2e16a0f674114ac8b4520fbce2d383d8 deleted and replaced by tablet 58a91c01ee3c422694e08505ce64e501
I20260928 14:50:29.986402 9569 raft_consensus.cc:2454] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:29.987684 9360 leader_election.cc:302] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:29.988521 9259 tablet_service.cc:1467] Processing CreateTablet for tablet b6e4ce1f9eed42abb3688716dc6733cf (DEFAULT_TABLE table=default.Table_a809f55fc9f74186ac02d15951aeff1e [id=9cfcf70c9f6e4c8eb485c2f1ecd5a3d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.988933 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e4ce1f9eed42abb3688716dc6733cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.989446 9261 tablet_service.cc:1467] Processing CreateTablet for tablet baa80c213f3f4aa9976cc285f6564e0f (DEFAULT_TABLE table=default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.989708 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ef1340deca4f00a250c390afcb5064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.989830 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa80c213f3f4aa9976cc285f6564e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.990516 9247 tablet_service.cc:1467] Processing CreateTablet for tablet a067ac578184491c8862fcea2c0ffc43 (DEFAULT_TABLE table=default.Table_56a26be7b12646229ddff62c431dd486 [id=3525e58e4b064de48e9ae8fa5d452756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.990855 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a067ac578184491c8862fcea2c0ffc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.992659 9266 tablet_service.cc:1467] Processing CreateTablet for tablet b8738a1591f644758f44fc720fd694a3 (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.993245 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8738a1591f644758f44fc720fd694a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.994892 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9cedadc7184013a37857206bec2ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.997066 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:29.997401 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 299ed0acd7cf46d3b78f4f4cea31858f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.998204 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa80c213f3f4aa9976cc285f6564e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:29.996543 9253 tablet_service.cc:1467] Processing CreateTablet for tablet bd9cedadc7184013a37857206bec2ff0 (DEFAULT_TABLE table=default.Table_c17c1cbf98644dbbac8e9d0865546c51 [id=4c915e1e70fc416eadaec3c812915746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.001394 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2898a032e1488b98c31b5e83371a71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:29.996675 9248 tablet_service.cc:1467] Processing CreateTablet for tablet f385d804a10442e3b725a86e201dd6a5 (DEFAULT_TABLE table=default.Table_8788bca431d24b76960a8ce26a49831c [id=efe7bcff144d4a8b87d5cfc0545b55a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.004889 9855 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.005018 9855 ts_tablet_manager.cc:1397] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260928 14:50:30.005847 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a067ac578184491c8862fcea2c0ffc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.007337 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 69ef1340deca4f00a250c390afcb5064 (DEFAULT_TABLE table=default.Table_63cbd45ae23a4ee7ac51f928b7613600 [id=2c9c5608bca44d7da4970e7173316f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.007683 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 (DEFAULT_TABLE table=default.Table_f573f1430fb34a24978cb467dd065e73 [id=4d5ddc7ef39d4d6a88121b4c39d44cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.007988 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 49d69e4ad9554da9871800c8b392851c (DEFAULT_TABLE table=default.Table_eba035915e264e878ed46dfadc6f379d [id=36fdfb9776ce45c095e29afee6bdf88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.009647 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a94a7a6c81453c8e47149be3d6479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.014940 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9d5166a828e84d46af3112cdc7bb0a2a (table default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]) successfully deleted
I20260928 14:50:30.005931 9855 raft_consensus.cc:348] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.015388 9855 raft_consensus.cc:374] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.015440 10365 raft_consensus.cc:2781] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:30.015484 9855 raft_consensus.cc:729] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.015787 10365 raft_consensus.cc:686] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:30.016088 10365 consensus_queue.cc:237] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.016912 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d2f4dbbc71b9434bb2a869ed05653fda" } modify_external_catalogs: true
I20260928 14:50:30.017103 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d2f4dbbc71b9434bb2a869ed05653fda" } modify_external_catalogs: true
I20260928 14:50:30.017128 9855 consensus_queue.cc:260] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.017490 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7826416fda7a4dfab4aa4f9ccb132fff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.017866 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7ad151c9d05f448ca152d2249ab19f3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.018074 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7826416fda7a4dfab4aa4f9ccb132fff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.017725 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6f098c0f6e424ae3afd0d67cf01db2aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.018369 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ad151c9d05f448ca152d2249ab19f3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.018775 9855 ts_tablet_manager.cc:1428] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
W20260928 14:50:30.019073 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f098c0f6e424ae3afd0d67cf01db2aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.019172 10368 raft_consensus.cc:482] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.019339 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e4c780211fed497b923908fb5dda2c9e" } modify_external_catalogs: true
I20260928 14:50:30.019315 10368 raft_consensus.cc:504] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.019531 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e4c780211fed497b923908fb5dda2c9e" } modify_external_catalogs: true
I20260928 14:50:30.020123 10368 leader_election.cc:288] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.020493 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_df7292c3aae14b59a5f8ad0903f7a2cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.020572 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0442afe9c88044ffa9f10b2e1835144c" } new_table_name: "default.Table_27c8c6bf92104baba58d5f721c298c16" modify_external_catalogs: true
W20260928 14:50:30.020962 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df7292c3aae14b59a5f8ad0903f7a2cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.022292 9855 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:30.025444 9360 leader_election.cc:341] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:30.027680 10152 raft_consensus.cc:482] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.027916 10152 raft_consensus.cc:504] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.028476 10152 leader_election.cc:288] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.029083 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767958659f4f450497eb5f2a3902993e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.029572 9498 leader_election.cc:341] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.029768 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f385d804a10442e3b725a86e201dd6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.029920 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b95962f27a14d3f9dea2a54a324eb75" } modify_external_catalogs: true
I20260928 14:50:30.030122 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b95962f27a14d3f9dea2a54a324eb75" } modify_external_catalogs: true
I20260928 14:50:30.031971 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8e4357c3d5487fa76e1e49c6cb7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.033190 9855 tablet_bootstrap.cc:654] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.033185 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ef1340deca4f00a250c390afcb5064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.034168 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d69e4ad9554da9871800c8b392851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.035197 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9cedadc7184013a37857206bec2ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.038175 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.037169 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 71a94a7a6c81453c8e47149be3d6479e (DEFAULT_TABLE table=default.Table_e314d6b2a6bb4dbcaa7c626dd204434d [id=01f39971be5e45b79aec08b7bbfdb1d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:30.039407 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cb3cc5b42524a4399d0bcf21c851fd8 consensus state has no leader
I20260928 14:50:30.040304 9538 tablet_service.cc:1467] Processing CreateTablet for tablet b6e4ce1f9eed42abb3688716dc6733cf (DEFAULT_TABLE table=default.Table_a809f55fc9f74186ac02d15951aeff1e [id=9cfcf70c9f6e4c8eb485c2f1ecd5a3d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.040482 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a94a7a6c81453c8e47149be3d6479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.040661 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e4ce1f9eed42abb3688716dc6733cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.047243 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 4 got 0
I20260928 14:50:30.046219 9542 tablet_service.cc:1467] Processing CreateTablet for tablet baa80c213f3f4aa9976cc285f6564e0f (DEFAULT_TABLE table=default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.047698 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa80c213f3f4aa9976cc285f6564e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.050176 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 58a91c01ee3c422694e08505ce64e501 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.050535 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a91c01ee3c422694e08505ce64e501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.051123 9404 tablet_service.cc:1467] Processing CreateTablet for tablet c64470c7a3154fd7b5057ce464e47326 (DEFAULT_TABLE table=default.Table_a4a12967058f480baef98a006acfd807 [id=c8ee81e2541e4217b6388cf1f59723e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.051481 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64470c7a3154fd7b5057ce464e47326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.055631 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f (DEFAULT_TABLE table=default.Table_dc507eb5822445f7979ec88c8ca800b8 [id=6d447d56ce46413f934c0d407c8b7eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.055986 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 299ed0acd7cf46d3b78f4f4cea31858f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.058686 9534 tablet_service.cc:1467] Processing CreateTablet for tablet b8738a1591f644758f44fc720fd694a3 (DEFAULT_TABLE table=default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.061622 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2898a032e1488b98c31b5e83371a71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.061687 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.062249 9815 tablet_replica.cc:330] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.062474 9815 raft_consensus.cc:2229] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.064095 9815 raft_consensus.cc:2258] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.064726 9815 ts_tablet_manager.cc:1905] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.063059 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3dee7ff6d5544908cdd9dbd45ce521a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.062786 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767958659f4f450497eb5f2a3902993e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.068687 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.069547 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.069656 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.070850 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 49d69e4ad9554da9871800c8b392851c (DEFAULT_TABLE table=default.Table_eba035915e264e878ed46dfadc6f379d [id=36fdfb9776ce45c095e29afee6bdf88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.072293 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 49d69e4ad9554da9871800c8b392851c (DEFAULT_TABLE table=default.Table_eba035915e264e878ed46dfadc6f379d [id=36fdfb9776ce45c095e29afee6bdf88c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.072762 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 (DEFAULT_TABLE table=default.Table_f573f1430fb34a24978cb467dd065e73 [id=4d5ddc7ef39d4d6a88121b4c39d44cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.073213 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8738a1591f644758f44fc720fd694a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.073834 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8e4357c3d5487fa76e1e49c6cb7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.074612 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 56151b288b634d6bb0bc7113afa5fbaa
I20260928 14:50:30.074679 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 42b9f78ecb674ae691d407615680ca56
I20260928 14:50:30.075210 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ad844de91e4040c3a8ae4873c0fa6ba4
I20260928 14:50:30.075711 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d69e4ad9554da9871800c8b392851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.077760 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d69e4ad9554da9871800c8b392851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.079777 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 71a94a7a6c81453c8e47149be3d6479e (DEFAULT_TABLE table=default.Table_e314d6b2a6bb4dbcaa7c626dd204434d [id=01f39971be5e45b79aec08b7bbfdb1d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.080119 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a94a7a6c81453c8e47149be3d6479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.081178 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.081604 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.081974 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.082381 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.082757 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:30.082891 9360 leader_election.cc:341] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.083074 9360 leader_election.cc:302] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:30.083375 9497 leader_election.cc:341] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.083581 9497 leader_election.cc:302] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.084982 10365 raft_consensus.cc:2726] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.084147 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.088056 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.090305 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.084053 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 69ef1340deca4f00a250c390afcb5064 (DEFAULT_TABLE table=default.Table_63cbd45ae23a4ee7ac51f928b7613600 [id=2c9c5608bca44d7da4970e7173316f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.103525 10365 raft_consensus.cc:482] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.104286 10365 raft_consensus.cc:504] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.104820 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ef1340deca4f00a250c390afcb5064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.105290 10365 leader_election.cc:288] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.106400 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095e4cbf95147d9afb83434ae1fd29f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.107455 10152 raft_consensus.cc:2726] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:30.107723 9360 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:30.107998 9360 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:30.111598 9543 tablet_service.cc:1467] Processing CreateTablet for tablet a067ac578184491c8862fcea2c0ffc43 (DEFAULT_TABLE table=default.Table_56a26be7b12646229ddff62c431dd486 [id=3525e58e4b064de48e9ae8fa5d452756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.112214 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a067ac578184491c8862fcea2c0ffc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.114518 10152 raft_consensus.cc:482] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.114672 10152 raft_consensus.cc:504] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.116506 10152 leader_election.cc:288] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.116770 9815 ts_tablet_manager.cc:1918] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.116959 9815 log.cc:1196] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8f2898a032e1488b98c31b5e83371a71
I20260928 14:50:30.117681 9815 ts_tablet_manager.cc:1939] T 8f2898a032e1488b98c31b5e83371a71 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.118602 9815 tablet_replica.cc:330] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.118676 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc8400fdb8d948b084733011b16df1b3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.119596 9360 leader_election.cc:302] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.119774 9535 tablet_service.cc:1467] Processing CreateTablet for tablet bd9cedadc7184013a37857206bec2ff0 (DEFAULT_TABLE table=default.Table_c17c1cbf98644dbbac8e9d0865546c51 [id=4c915e1e70fc416eadaec3c812915746]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:30.120168 9498 leader_election.cc:341] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.120451 10365 raft_consensus.cc:2726] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.120630 9536 tablet_service.cc:1467] Processing CreateTablet for tablet f385d804a10442e3b725a86e201dd6a5 (DEFAULT_TABLE table=default.Table_8788bca431d24b76960a8ce26a49831c [id=efe7bcff144d4a8b87d5cfc0545b55a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.121045 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f385d804a10442e3b725a86e201dd6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.121610 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.121898 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9cedadc7184013a37857206bec2ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.123212 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 440b98459fa9484fa44685126decf342 (DEFAULT_TABLE table=default.Table_7ad151c9d05f448ca152d2249ab19f3a [id=94ba4c0eab2e479b8eb3d28504b6df6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.123369 9815 raft_consensus.cc:2229] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.123669 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440b98459fa9484fa44685126decf342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.123711 9815 raft_consensus.cc:2258] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.124342 9815 ts_tablet_manager.cc:1905] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.124759 9388 tablet_service.cc:1467] Processing CreateTablet for tablet a5eb8907be064167a3739715d24c94e9 (DEFAULT_TABLE table=default.Table_0e7323af5cb8442585fc497fd5029809 [id=204e571142204136aa203a123454f267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.125253 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5eb8907be064167a3739715d24c94e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.129261 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6a9e78b3fe43389ac91de1329ced8f (DEFAULT_TABLE table=default.Table_df7292c3aae14b59a5f8ad0903f7a2cb [id=45dd3a1426bd4196a17d97475719b662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.129861 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6a9e78b3fe43389ac91de1329ced8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.137148 9851 tablet_bootstrap.cc:492] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:30.138643 9396 tablet_service.cc:1467] Processing CreateTablet for tablet f92d30a7102f49828227b1428e2224da (DEFAULT_TABLE table=default.Table_6f098c0f6e424ae3afd0d67cf01db2aa [id=42cf05f35fba4aab9cd6dc79afe81e0a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:30.138821 9220 consensus_peers.cc:487] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a30439ac5a8485a9b6ebbe1371087b1. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:30.139114 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92d30a7102f49828227b1428e2224da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.141409 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:30.142140 9360 leader_election.cc:341] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.142614 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc8400fdb8d948b084733011b16df1b3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.143245 9497 leader_election.cc:341] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.143450 9497 leader_election.cc:302] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.143800 10152 raft_consensus.cc:2726] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.151257 10152 raft_consensus.cc:482] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.151506 10152 raft_consensus.cc:504] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.153007 10152 leader_election.cc:288] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.153861 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e3c8ef3e20451dbf91b671655974e5" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.156606 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 (DEFAULT_TABLE table=default.Table_7826416fda7a4dfab4aa4f9ccb132fff [id=223e61391cbf4ab1a64bb1baa0894fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.156689 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.158699 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.160712 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e3c8ef3e20451dbf91b671655974e5" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.161417 9498 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.161559 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.163023 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8f2898a032e1488b98c31b5e83371a71 (table default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]) successfully deleted
I20260928 14:50:30.166129 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a55156d0bf94b5fbd810d321e78b760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.163688 9266 tablet_service.cc:1467] Processing CreateTablet for tablet c64470c7a3154fd7b5057ce464e47326 (DEFAULT_TABLE table=default.Table_a4a12967058f480baef98a006acfd807 [id=c8ee81e2541e4217b6388cf1f59723e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.162809 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6a9e78b3fe43389ac91de1329ced8f (DEFAULT_TABLE table=default.Table_df7292c3aae14b59a5f8ad0903f7a2cb [id=45dd3a1426bd4196a17d97475719b662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.162839 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 58a91c01ee3c422694e08505ce64e501 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.168385 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64470c7a3154fd7b5057ce464e47326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.169422 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a91c01ee3c422694e08505ce64e501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.162323 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 (DEFAULT_TABLE table=default.Table_7826416fda7a4dfab4aa4f9ccb132fff [id=223e61391cbf4ab1a64bb1baa0894fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.171041 9247 tablet_service.cc:1467] Processing CreateTablet for tablet f92d30a7102f49828227b1428e2224da (DEFAULT_TABLE table=default.Table_6f098c0f6e424ae3afd0d67cf01db2aa [id=42cf05f35fba4aab9cd6dc79afe81e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.172740 9254 tablet_service.cc:1467] Processing CreateTablet for tablet a5eb8907be064167a3739715d24c94e9 (DEFAULT_TABLE table=default.Table_0e7323af5cb8442585fc497fd5029809 [id=204e571142204136aa203a123454f267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.173723 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6a9e78b3fe43389ac91de1329ced8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.178949 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d89af305177149bcb01720f55a1c349b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.179935 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d89af305177149bcb01720f55a1c349b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.180054 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3d0f69a3ab6c49828d3aa04000fb1761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.180544 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d0f69a3ab6c49828d3aa04000fb1761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.182819 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.183043 10215 raft_consensus.cc:482] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 658e483a10314e8d93c2f6e9084f2a91)
I20260928 14:50:30.183259 10215 raft_consensus.cc:504] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.183459 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 (DEFAULT_TABLE table=default.Table_7826416fda7a4dfab4aa4f9ccb132fff [id=223e61391cbf4ab1a64bb1baa0894fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.184013 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a55156d0bf94b5fbd810d321e78b760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.185638 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595dccb9d03b4dd48698262aad630ac2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.187397 10215 leader_election.cc:288] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:30.187530 10365 raft_consensus.cc:482] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.188418 10365 raft_consensus.cc:504] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.189060 10365 leader_election.cc:288] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:30.189733 9360 leader_election.cc:341] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 595dccb9d03b4dd48698262aad630ac2
W20260928 14:50:30.190655 9360 leader_election.cc:341] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: Tablet not RUNNING: STOPPED
I20260928 14:50:30.191787 9360 leader_election.cc:302] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.163714 9814 ts_tablet_manager.cc:1918] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 14:50:30.192350 9360 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:30.192816 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 440b98459fa9484fa44685126decf342 (DEFAULT_TABLE table=default.Table_7ad151c9d05f448ca152d2249ab19f3a [id=94ba4c0eab2e479b8eb3d28504b6df6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.193984 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a55156d0bf94b5fbd810d321e78b760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.194208 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.194902 10365 raft_consensus.cc:2726] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 14:50:30.195466 9542 tablet_service.cc:1467] Processing CreateTablet for tablet f92d30a7102f49828227b1428e2224da (DEFAULT_TABLE table=default.Table_6f098c0f6e424ae3afd0d67cf01db2aa [id=42cf05f35fba4aab9cd6dc79afe81e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.195847 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92d30a7102f49828227b1428e2224da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.197336 8941 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer c6b99976d8024a79a0603523b9d32f29 (127.8.181.60:39777): Couldn't send request to peer c6b99976d8024a79a0603523b9d32f29. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.60:39777: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 14:50:30.201968 9534 tablet_service.cc:1467] Processing CreateTablet for tablet a5eb8907be064167a3739715d24c94e9 (DEFAULT_TABLE table=default.Table_0e7323af5cb8442585fc497fd5029809 [id=204e571142204136aa203a123454f267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.201982 10365 consensus_queue.cc:1035] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:30.202461 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5eb8907be064167a3739715d24c94e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.204384 9848 tablet_bootstrap.cc:654] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.206137 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1eb8a9faf04e3b97db9e0f8e9104f8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.207325 9814 log.cc:1196] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/595dccb9d03b4dd48698262aad630ac2
I20260928 14:50:30.207449 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6a9e78b3fe43389ac91de1329ced8f (DEFAULT_TABLE table=default.Table_df7292c3aae14b59a5f8ad0903f7a2cb [id=45dd3a1426bd4196a17d97475719b662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.207795 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6a9e78b3fe43389ac91de1329ced8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.207916 9360 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.208062 9360 leader_election.cc:302] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.211186 10365 raft_consensus.cc:2726] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:30.220882 9497 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.221021 9497 leader_election.cc:302] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.221493 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.221843 10152 raft_consensus.cc:2726] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.222184 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 440b98459fa9484fa44685126decf342 (DEFAULT_TABLE table=default.Table_7ad151c9d05f448ca152d2249ab19f3a [id=94ba4c0eab2e479b8eb3d28504b6df6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.222644 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440b98459fa9484fa44685126decf342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.224597 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92d30a7102f49828227b1428e2224da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.225112 9814 ts_tablet_manager.cc:1939] T 595dccb9d03b4dd48698262aad630ac2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.227895 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 362) took 2658 ms. Trace:
I20260928 14:50:30.229442 9855 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.229801 9535 tablet_service.cc:1467] Processing CreateTablet for tablet c64470c7a3154fd7b5057ce464e47326 (DEFAULT_TABLE table=default.Table_a4a12967058f480baef98a006acfd807 [id=c8ee81e2541e4217b6388cf1f59723e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.230144 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64470c7a3154fd7b5057ce464e47326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.233636 9855 ts_tablet_manager.cc:1397] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.211s user 0.001s sys 0.004s
I20260928 14:50:30.234918 9855 raft_consensus.cc:348] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.235157 9855 raft_consensus.cc:374] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.235237 9855 raft_consensus.cc:729] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.235450 9855 consensus_queue.cc:260] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.237221 9855 ts_tablet_manager.cc:1428] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:30.237867 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 58a91c01ee3c422694e08505ce64e501 (DEFAULT_TABLE table=default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.245061 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f338945deb424cb4b3e267df128a7786"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.245673 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f338945deb424cb4b3e267df128a7786 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.250808 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440b98459fa9484fa44685126decf342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.251772 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c (DEFAULT_TABLE table=default.Table_d89af305177149bcb01720f55a1c349b [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.252456 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5eb8907be064167a3739715d24c94e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.254709 9814 rpcz_store.cc:276] 0928 14:50:27.569072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.570607 (+ 1535us) service_pool.cc:227] Handling call
0928 14:50:29.923774 (+2353167us) ts_tablet_manager.cc:1145] Deleting tablet 595dccb9d03b4dd48698262aad630ac2
0928 14:50:29.923809 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.095786 (+171977us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.159795 (+ 64009us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.227857 (+ 68062us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2352918}
I20260928 14:50:30.255323 9814 tablet_replica.cc:330] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.256695 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_84285a91b8754696889a5a145368f19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.257246 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dc507eb5822445f7979ec88c8ca800b8" } new_table_name: "default.Table_39fb4e4216bf46188c6df0df4e908528" modify_external_catalogs: true
W20260928 14:50:30.257467 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84285a91b8754696889a5a145368f19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.258833 9855 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.259210 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e74879f8be614d689d6faef67df823f1" } new_table_name: "default.Table_5eaa39cffce14b8c943fc61ddef2edb7" modify_external_catalogs: true
I20260928 14:50:30.262537 9815 ts_tablet_manager.cc:1918] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.262887 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f27adee7f5546bdacf1cf473d252a5b" } modify_external_catalogs: true
I20260928 14:50:30.263180 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f27adee7f5546bdacf1cf473d252a5b" } modify_external_catalogs: true
I20260928 14:50:30.263973 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7826416fda7a4dfab4aa4f9ccb132fff" } modify_external_catalogs: true
I20260928 14:50:30.264194 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7826416fda7a4dfab4aa4f9ccb132fff" } modify_external_catalogs: true
I20260928 14:50:30.264775 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8788bca431d24b76960a8ce26a49831c" } new_table_name: "default.Table_1c2caec8b75342b2a381248db04f48c0" modify_external_catalogs: true
I20260928 14:50:30.263476 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7f4aa32aaf4c84bc5630afbab11736 (DEFAULT_TABLE table=default.Table_3d0f69a3ab6c49828d3aa04000fb1761 [id=4e7aa418358944409484caa7000724e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.266091 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_075a808990274110b90e02a28f3bddba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.266654 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_075a808990274110b90e02a28f3bddba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.267009 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9b2bb8161df24988895bf046bc6a1c44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.267450 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b2bb8161df24988895bf046bc6a1c44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.267853 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f92d1f0e69409a8ef355d550cfb52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.267899 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.268546 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.268499 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_118c187f247340e28ea7760243f97cf0" } new_table_name: "default.Table_081cef36a86d487a87f4a9f1ecf6c8b3" modify_external_catalogs: true
I20260928 14:50:30.268884 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_13fba19288b84741b37b6b24d12ceb0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.269166 9815 log.cc:1196] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/82b042c6ffc148939dcba9b710f198d3
W20260928 14:50:30.269304 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13fba19288b84741b37b6b24d12ceb0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.269407 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7f4aa32aaf4c84bc5630afbab11736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.270650 9815 ts_tablet_manager.cc:1939] T 82b042c6ffc148939dcba9b710f198d3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.271489 9815 tablet_replica.cc:330] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.271693 9815 raft_consensus.cc:2229] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:30.275005 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ff596370c52465ca7c531b8760af5c8 consensus state has no leader
W20260928 14:50:30.276221 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 299ed0acd7cf46d3b78f4f4cea31858f consensus state has no leader
I20260928 14:50:30.277707 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 82b042c6ffc148939dcba9b710f198d3 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:30.278921 9815 raft_consensus.cc:2258] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.281396 9815 ts_tablet_manager.cc:1905] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.286954 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 595dccb9d03b4dd48698262aad630ac2 (table default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]) successfully deleted
I20260928 14:50:30.288655 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:30.289934 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f385d804a10442e3b725a86e201dd6a5 consensus state has no leader
I20260928 14:50:30.293430 10368 raft_consensus.cc:482] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.293713 10368 raft_consensus.cc:504] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.294467 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 1016ad6219294ccd829fca9b264ab06f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:30.294566 10368 leader_election.cc:288] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:30.300432 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 390f10fd4b5f42e182b686cc1ccefb26 consensus state has no leader
I20260928 14:50:30.301011 9851 ts_tablet_manager.cc:1397] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.217s user 0.000s sys 0.012s
I20260928 14:50:30.305073 9813 ts_tablet_manager.cc:1918] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.306713 9814 raft_consensus.cc:2229] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.306905 9814 raft_consensus.cc:2258] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:30.306944 9360 leader_election.cc:341] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c9a7573c751d412aa8394d6277c28b7f
I20260928 14:50:30.308773 10445 raft_consensus.cc:482] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.310249 8955 catalog_manager.cc:5495] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:30.311054 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 4 got 0
I20260928 14:50:30.311614 9535 tablet_service.cc:1467] Processing CreateTablet for tablet efc95c0861c9489ab6df340fc53e310d (DEFAULT_TABLE table=default.Table_f338945deb424cb4b3e267df128a7786 [id=3a7c9a26ba574bb18b9d39af7084bba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.312037 10445 raft_consensus.cc:504] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.316378 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9a7573c751d412aa8394d6277c28b7f" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.316859 9267 tablet_service.cc:1467] Processing CreateTablet for tablet efc95c0861c9489ab6df340fc53e310d (DEFAULT_TABLE table=default.Table_f338945deb424cb4b3e267df128a7786 [id=3a7c9a26ba574bb18b9d39af7084bba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.317842 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc95c0861c9489ab6df340fc53e310d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.318356 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a91c01ee3c422694e08505ce64e501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.318480 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c (DEFAULT_TABLE table=default.Table_d89af305177149bcb01720f55a1c349b [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.319429 9388 tablet_service.cc:1467] Processing CreateTablet for tablet efc95c0861c9489ab6df340fc53e310d (DEFAULT_TABLE table=default.Table_f338945deb424cb4b3e267df128a7786 [id=3a7c9a26ba574bb18b9d39af7084bba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.319918 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc95c0861c9489ab6df340fc53e310d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.321262 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7f4aa32aaf4c84bc5630afbab11736 (DEFAULT_TABLE table=default.Table_3d0f69a3ab6c49828d3aa04000fb1761 [id=4e7aa418358944409484caa7000724e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.321666 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc95c0861c9489ab6df340fc53e310d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.321846 9813 log.cc:1196] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8948e45987b94ca69004c42e224ce93f
I20260928 14:50:30.322031 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7f4aa32aaf4c84bc5630afbab11736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.323891 9813 ts_tablet_manager.cc:1939] T 8948e45987b94ca69004c42e224ce93f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:30.324230 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 354) took 4037 ms. Trace:
I20260928 14:50:30.324322 9813 rpcz_store.cc:276] 0928 14:50:26.287236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.287282 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:29.964212 (+3676930us) ts_tablet_manager.cc:1145] Deleting tablet 8948e45987b94ca69004c42e224ce93f
0928 14:50:29.964222 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.144069 (+179847us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.304865 (+160796us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.324181 (+ 19316us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3676675}
I20260928 14:50:30.329350 9855 tablet_bootstrap.cc:654] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.330252 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7f4aa32aaf4c84bc5630afbab11736 (DEFAULT_TABLE table=default.Table_3d0f69a3ab6c49828d3aa04000fb1761 [id=4e7aa418358944409484caa7000724e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.330902 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:30.331926 9814 ts_tablet_manager.cc:1905] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.332317 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f02364b809f4e1c8d558f121d4d88b9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.333268 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.339154 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f92d1f0e69409a8ef355d550cfb52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.339193 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8a55156d0bf94b5fbd810d321e78b760
I20260928 14:50:30.332345 9851 raft_consensus.cc:348] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.342273 10445 leader_election.cc:288] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:30.345016 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7f4aa32aaf4c84bc5630afbab11736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.345314 9851 raft_consensus.cc:374] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.346803 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.346957 9851 raft_consensus.cc:729] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.347039 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8948e45987b94ca69004c42e224ce93f (table default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]) successfully deleted
I20260928 14:50:30.333179 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:30.348031 9219 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:30.348881 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.349813 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_81d22cb6ebbd4493b48d69af0c3b0227" } new_table_name: "default.Table_405df45dc13a4ff084c15b99fcf01e2d" modify_external_catalogs: true
I20260928 14:50:30.351670 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_46a114a9c79f44b7a5d27044b9cbeda1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.352237 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46a114a9c79f44b7a5d27044b9cbeda1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.355106 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_299e54db07bd4d3ca9187dea43609f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.355734 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_299e54db07bd4d3ca9187dea43609f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.358114 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dad1b85ab48345fbb7e8642eed1cc48d" } modify_external_catalogs: true
I20260928 14:50:30.358381 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dad1b85ab48345fbb7e8642eed1cc48d" } modify_external_catalogs: true
I20260928 14:50:30.359833 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_efdda1920fdd4a118b80b0f5485931b9" } modify_external_catalogs: true
I20260928 14:50:30.360044 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_efdda1920fdd4a118b80b0f5485931b9" } modify_external_catalogs: true
I20260928 14:50:30.361254 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7" } modify_external_catalogs: true
I20260928 14:50:30.361441 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7" } modify_external_catalogs: true
I20260928 14:50:30.348029 9851 consensus_queue.cc:260] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.357589 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a55156d0bf94b5fbd810d321e78b760 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.374567 10368 raft_consensus.cc:482] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.360436 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 3bdcddceb8844a9f80bdd9b0761a5433 (DEFAULT_TABLE table=default.Table_9b2bb8161df24988895bf046bc6a1c44 [id=622debe3283c4c1ab262274078f48100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.375046 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bdcddceb8844a9f80bdd9b0761a5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.375161 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.375531 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b (DEFAULT_TABLE table=default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac [id=dc4748fd3936417c90b087c6c54ece14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.361337 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 462da126db8e4027b042cb7933c87737 (DEFAULT_TABLE table=default.Table_075a808990274110b90e02a28f3bddba [id=71afe0d60d404145ab6ca3a52201b540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.362365 9545 tablet_service.cc:1467] Processing CreateTablet for tablet cd266b1e19c748f0b743840d44838958 (DEFAULT_TABLE table=default.Table_84285a91b8754696889a5a145368f19d [id=b92aea95f5ce443a8f3c1100fe06d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.379002 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd266b1e19c748f0b743840d44838958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.380294 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]). Expected version 1 got 0
I20260928 14:50:30.381649 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462da126db8e4027b042cb7933c87737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.383438 9219 leader_election.cc:302] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.385311 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 76ad7685ece44665896f687697bddccf
I20260928 14:50:30.385576 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 58bb9c7fc599425484fd3fc0b94f3a8c
I20260928 14:50:30.386307 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d806161b858145e1a4fa946587ae1529
I20260928 14:50:30.386572 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 3bdcddceb8844a9f80bdd9b0761a5433 (DEFAULT_TABLE table=default.Table_9b2bb8161df24988895bf046bc6a1c44 [id=622debe3283c4c1ab262274078f48100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.387413 9851 ts_tablet_manager.cc:1428] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260928 14:50:30.388023 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.388902 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.393849 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 3461b27174ca4bb184a3369d5de47bcc (DEFAULT_TABLE table=default.Table_13fba19288b84741b37b6b24d12ceb0c [id=f73be2c7a1304e57a23385aefe3c35d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.394063 10368 raft_consensus.cc:504] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.394268 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.394260 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.394650 10368 leader_election.cc:288] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.395443 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 3461b27174ca4bb184a3369d5de47bcc (DEFAULT_TABLE table=default.Table_13fba19288b84741b37b6b24d12ceb0c [id=f73be2c7a1304e57a23385aefe3c35d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.396127 9406 tablet_service.cc:1467] Processing CreateTablet for tablet cd266b1e19c748f0b743840d44838958 (DEFAULT_TABLE table=default.Table_84285a91b8754696889a5a145368f19d [id=b92aea95f5ce443a8f3c1100fe06d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.396595 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 355) took 4018 ms. Trace:
I20260928 14:50:30.397223 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.397533 10445 raft_consensus.cc:2726] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.397751 9261 tablet_service.cc:1467] Processing CreateTablet for tablet cd266b1e19c748f0b743840d44838958 (DEFAULT_TABLE table=default.Table_84285a91b8754696889a5a145368f19d [id=b92aea95f5ce443a8f3c1100fe06d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:30.398895 9219 consensus_peers.cc:487] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d27738fcfbc42f298e26149dfd28182. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:30.400101 9851 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:30.400197 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.401147 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.362536 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c (DEFAULT_TABLE table=default.Table_d89af305177149bcb01720f55a1c349b [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.363524 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b (DEFAULT_TABLE table=default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac [id=dc4748fd3936417c90b087c6c54ece14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.401927 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3461b27174ca4bb184a3369d5de47bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.402037 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.403257 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 462da126db8e4027b042cb7933c87737 (DEFAULT_TABLE table=default.Table_075a808990274110b90e02a28f3bddba [id=71afe0d60d404145ab6ca3a52201b540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.404064 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b (DEFAULT_TABLE table=default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac [id=dc4748fd3936417c90b087c6c54ece14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.397037 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 3bdcddceb8844a9f80bdd9b0761a5433 (DEFAULT_TABLE table=default.Table_9b2bb8161df24988895bf046bc6a1c44 [id=622debe3283c4c1ab262274078f48100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.404850 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.364624 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 3461b27174ca4bb184a3369d5de47bcc (DEFAULT_TABLE table=default.Table_13fba19288b84741b37b6b24d12ceb0c [id=f73be2c7a1304e57a23385aefe3c35d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.405942 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3461b27174ca4bb184a3369d5de47bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.406790 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd266b1e19c748f0b743840d44838958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.369045 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.408275 9813 rpcz_store.cc:276] 0928 14:50:26.340444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.340508 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:30.347293 (+4006785us) ts_tablet_manager.cc:1145] Deleting tablet 28ee844aa3c24336b4acb66dc43186e9
0928 14:50:30.347305 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.358761 (+ 11456us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3983165}
I20260928 14:50:30.412060 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bdcddceb8844a9f80bdd9b0761a5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.413836 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 462da126db8e4027b042cb7933c87737 (DEFAULT_TABLE table=default.Table_075a808990274110b90e02a28f3bddba [id=71afe0d60d404145ab6ca3a52201b540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.414175 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaf10326ec24b99ae2ab1ba8779d1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.415112 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fccef376c9f40f7b7f6cafbb83f8f0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.415130 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 28ee844aa3c24336b4acb66dc43186e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ee844aa3c24336b4acb66dc43186e9 already in progress: creating tablet
I20260928 14:50:30.415550 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 356) took 4020 ms. Trace:
I20260928 14:50:30.415637 9813 rpcz_store.cc:276] 0928 14:50:26.395306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.395481 (+ 175us) service_pool.cc:227] Handling call
0928 14:50:30.415350 (+4019869us) ts_tablet_manager.cc:1145] Deleting tablet 9648be4c626e44e0986c196704483955
0928 14:50:30.415360 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.415450 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3931406}
W20260928 14:50:30.416045 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9648be4c626e44e0986c196704483955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9648be4c626e44e0986c196704483955 already in progress: creating tablet
I20260928 14:50:30.416045 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.416389 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f92d1f0e69409a8ef355d550cfb52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.416460 9813 tablet_replica.cc:330] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:30.416738 9813 raft_consensus.cc:2229] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.417610 9813 raft_consensus.cc:2258] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.419691 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3461b27174ca4bb184a3369d5de47bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.422305 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd266b1e19c748f0b743840d44838958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.422326 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.370790 9815 ts_tablet_manager.cc:1918] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.423648 9815 log.cc:1196] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:30.424734 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4cfb345e72457babc43037d8002d95 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.425163 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4cfb345e72457babc43037d8002d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.425957 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4cfb345e72457babc43037d8002d95 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.424798 9543 tablet_service.cc:1467] Processing CreateTablet for tablet e59ac8618ca64e09b1af2469745271f8 (DEFAULT_TABLE table=default.Table_46a114a9c79f44b7a5d27044b9cbeda1 [id=8288e9b611a84cd989a7760b50567892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.426484 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59ac8618ca64e09b1af2469745271f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.426494 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462da126db8e4027b042cb7933c87737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.429728 9815 ts_tablet_manager.cc:1939] T 8296732efcb349ab9cc87e3ff1e11fd0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:30.430570 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet e13976317a32495ab377654b738667ca (table default.Table_ce86cfe203734bd4bd139c7bf581ac85 [id=9e86de8b573545cf94ae1fb95f2893c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e13976317a32495ab377654b738667ca consensus state has no leader
I20260928 14:50:30.430838 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8296732efcb349ab9cc87e3ff1e11fd0 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
I20260928 14:50:30.433668 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4cfb345e72457babc43037d8002d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.441921 9248 tablet_service.cc:1467] Processing CreateTablet for tablet e59ac8618ca64e09b1af2469745271f8 (DEFAULT_TABLE table=default.Table_46a114a9c79f44b7a5d27044b9cbeda1 [id=8288e9b611a84cd989a7760b50567892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.442977 10152 raft_consensus.cc:482] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.443121 10152 raft_consensus.cc:504] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.443696 10152 leader_election.cc:288] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.445781 9815 tablet_replica.cc:330] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:30.445943 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2e16a0f674114ac8b4520fbce2d383d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16a0f674114ac8b4520fbce2d383d8 already in progress: creating tablet
I20260928 14:50:30.445993 9815 raft_consensus.cc:2229] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.446141 9815 raft_consensus.cc:2258] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.447675 9815 ts_tablet_manager.cc:1905] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.451309 9855 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.451443 9855 ts_tablet_manager.cc:1397] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.214s user 0.008s sys 0.005s
I20260928 14:50:30.451478 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1738a95895914cc4936a38e1d189d538" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.452154 9497 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.452544 9855 raft_consensus.cc:348] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.452764 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59ac8618ca64e09b1af2469745271f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.452847 9855 raft_consensus.cc:374] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.453028 9855 raft_consensus.cc:729] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.453413 9855 consensus_queue.cc:260] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.456815 9851 tablet_bootstrap.cc:654] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.457167 9855 ts_tablet_manager.cc:1428] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260928 14:50:30.457453 9855 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.457743 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.460372 9855 tablet_bootstrap.cc:654] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.466805 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4a9a87d2f732492786e402d485c1dbf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.467422 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a9a87d2f732492786e402d485c1dbf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.471773 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9961b24814874d1aab1daecdf3ac19e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.472472 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9961b24814874d1aab1daecdf3ac19e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.474900 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_385d1004ec5649bc9b651ebcc4d95bd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.475546 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_385d1004ec5649bc9b651ebcc4d95bd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.480016 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d63761d56fb04de5af441abb8bf27540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.480580 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d63761d56fb04de5af441abb8bf27540 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.491158 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3f13997bc23f4c269c14e70a3f8765ed" } new_table_name: "default.Table_19caea08036943b0b17c5e53d8c486b3" modify_external_catalogs: true
I20260928 14:50:30.492439 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a8c275ee78b74930976e658a73224180" } new_table_name: "default.Table_38e8d8c399254d78ba45f973e9064285" modify_external_catalogs: true
I20260928 14:50:30.493954 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e2b36f27809f43e0950c5f002e20c7f6" } new_table_name: "default.Table_521fbf9f0ee74666a0707792d5a7d9e9" modify_external_catalogs: true
I20260928 14:50:30.494699 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_62f2b3da53c74c06893428d46c68d11c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.494987 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ed2b822b497a4466ba6ce258dbb3a135"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.495260 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62f2b3da53c74c06893428d46c68d11c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:30.495484 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed2b822b497a4466ba6ce258dbb3a135 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.496083 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.496555 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.497639 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8d78457546ab422d81de650938efde25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.498468 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d78457546ab422d81de650938efde25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.502209 9815 ts_tablet_manager.cc:1918] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.502637 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_385d1004ec5649bc9b651ebcc4d95bd2" } new_table_name: "default.Table_5558aed7f8954bb3b2a5c0891ef030a8" modify_external_catalogs: true
I20260928 14:50:30.503239 9855 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.507676 9815 log.cc:1196] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/852b70b1f7444ad2ab92d66d580a0db7
I20260928 14:50:30.507948 9855 ts_tablet_manager.cc:1397] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.000s
I20260928 14:50:30.508296 9815 ts_tablet_manager.cc:1939] T 852b70b1f7444ad2ab92d66d580a0db7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.509435 9855 raft_consensus.cc:348] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.509861 9855 raft_consensus.cc:374] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.509995 9855 raft_consensus.cc:729] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.510308 9855 consensus_queue.cc:260] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.511281 9855 ts_tablet_manager.cc:1428] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:30.511781 9855 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.513553 9855 tablet_bootstrap.cc:654] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.518298 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 852b70b1f7444ad2ab92d66d580a0db7 (table default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]) successfully deleted
I20260928 14:50:30.518721 9815 tablet_replica.cc:330] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.518980 9815 raft_consensus.cc:2229] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.519171 9815 raft_consensus.cc:2258] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.519731 9815 ts_tablet_manager.cc:1905] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.526829 9814 ts_tablet_manager.cc:1918] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.528476 9815 ts_tablet_manager.cc:1918] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.533325 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_03bb5b055caf49f080ec90feb2a90fd0" } modify_external_catalogs: true
I20260928 14:50:30.533825 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_03bb5b055caf49f080ec90feb2a90fd0" } modify_external_catalogs: true
I20260928 14:50:30.534540 9815 log.cc:1196] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:30.535032 9815 ts_tablet_manager.cc:1939] T 69e3c8ef3e20451dbf91b671655974e5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.530153 9855 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.535712 9855 ts_tablet_manager.cc:1397] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.003s
I20260928 14:50:30.536207 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 69e3c8ef3e20451dbf91b671655974e5 (table default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]) successfully deleted
I20260928 14:50:30.536574 9815 tablet_replica.cc:330] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.536859 9815 raft_consensus.cc:2229] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.536703 9855 raft_consensus.cc:348] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.537158 9855 raft_consensus.cc:374] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.537207 9815 raft_consensus.cc:2258] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.537417 9855 raft_consensus.cc:729] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.538008 9815 ts_tablet_manager.cc:1905] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.537968 9855 consensus_queue.cc:260] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.539220 9855 ts_tablet_manager.cc:1428] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:30.534550 10445 raft_consensus.cc:482] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.539876 9814 log.cc:1196] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e0ee1e19142b402f96056c387140b5ca
I20260928 14:50:30.539929 10445 raft_consensus.cc:504] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.540261 9814 ts_tablet_manager.cc:1939] T e0ee1e19142b402f96056c387140b5ca P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.540688 10445 leader_election.cc:288] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.538399 10386 raft_consensus.cc:482] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.541013 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 364) took 2971 ms. Trace:
I20260928 14:50:30.540920 10386 raft_consensus.cc:504] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.541118 9814 rpcz_store.cc:276] 0928 14:50:27.569479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.570888 (+ 1409us) service_pool.cc:227] Handling call
0928 14:50:30.255200 (+2684312us) ts_tablet_manager.cc:1145] Deleting tablet e0ee1e19142b402f96056c387140b5ca
0928 14:50:30.255211 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.427570 (+172359us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.526710 (+ 99140us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.540951 (+ 14241us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2684048}
I20260928 14:50:30.541503 10386 leader_election.cc:288] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:30.542407 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e0ee1e19142b402f96056c387140b5ca (table default.Table_c39546a03d024407aacb996e3b7dc3a0 [id=66ee384f66054b13b865c8bd6da3d498]) successfully deleted
I20260928 14:50:30.542573 9814 tablet_replica.cc:330] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.542872 9814 raft_consensus.cc:2229] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:30.542881 9219 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: def872f66b2541b9af6084e93d991ec2
I20260928 14:50:30.543231 9814 raft_consensus.cc:2258] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.543923 9814 ts_tablet_manager.cc:1905] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:30.548933 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2df12117111548beb5d570436e2d6de2 consensus state has no leader
I20260928 14:50:30.549860 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f98414a2078e42889dfadeb64bfb5506" } modify_external_catalogs: true
I20260928 14:50:30.550132 9855 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.550102 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f98414a2078e42889dfadeb64bfb5506" } modify_external_catalogs: true
I20260928 14:50:30.552117 9815 ts_tablet_manager.cc:1918] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.552567 9815 log.cc:1196] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:30.558035 9815 ts_tablet_manager.cc:1939] T dc8400fdb8d948b084733011b16df1b3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.559085 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet dc8400fdb8d948b084733011b16df1b3 (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:30.562906 9855 tablet_bootstrap.cc:654] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.563930 9813 ts_tablet_manager.cc:1905] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:30.564064 9360 leader_election.cc:341] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.565737 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1738a95895914cc4936a38e1d189d538" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.566372 9220 leader_election.cc:341] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: def872f66b2541b9af6084e93d991ec2
I20260928 14:50:30.566514 9220 leader_election.cc:302] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.566666 9814 ts_tablet_manager.cc:1918] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.566820 9814 log.cc:1196] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:30.566962 10386 raft_consensus.cc:2726] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.567384 9814 ts_tablet_manager.cc:1939] T 47ff819255f74f49a1ce0b5588aa03a1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.567831 9815 tablet_replica.cc:330] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.568276 9815 raft_consensus.cc:2229] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.569092 9815 raft_consensus.cc:2258] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.569303 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bdcddceb8844a9f80bdd9b0761a5433. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.569904 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea7b363d546c45ceb3efb9352cf184f4 consensus state has no leader
I20260928 14:50:30.571041 9815 ts_tablet_manager.cc:1905] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.570971 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf10326ec24b99ae2ab1ba8779d1a3" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.571029 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 366) took 3001 ms. Trace:
I20260928 14:50:30.571187 9426 raft_consensus.cc:2454] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:30.571393 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462da126db8e4027b042cb7933c87737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.571272 9814 rpcz_store.cc:276] 0928 14:50:27.569882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.571182 (+ 1300us) service_pool.cc:227] Handling call
0928 14:50:30.541402 (+2970220us) ts_tablet_manager.cc:1145] Deleting tablet 47ff819255f74f49a1ce0b5588aa03a1
0928 14:50:30.541412 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.558742 (+ 17330us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.566515 (+ 7773us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.570895 (+ 4380us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2970015}
I20260928 14:50:30.573064 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 47ff819255f74f49a1ce0b5588aa03a1 (table default.Table_973889bd0a494a95a0a088ba6e85c124 [id=16da29ef576a4730aff2c1e24942cafc]) successfully deleted
I20260928 14:50:30.573819 9814 tablet_replica.cc:330] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.574164 9814 raft_consensus.cc:2229] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.574354 9814 raft_consensus.cc:2258] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.574966 9814 ts_tablet_manager.cc:1905] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.578173 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bc56b27db3a9485ca73d987fdac482f8" } new_table_name: "default.Table_fc468e61b9734839b1bdaaf51c7f5cd5" modify_external_catalogs: true
I20260928 14:50:30.581768 9220 leader_election.cc:302] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:30.582073 10386 raft_consensus.cc:2781] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:30.582237 10386 raft_consensus.cc:482] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:30.582443 10386 raft_consensus.cc:3037] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:30.582615 9219 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:30.586591 10386 raft_consensus.cc:504] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.587689 10386 leader_election.cc:288] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:30.587854 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4cfb345e72457babc43037d8002d95 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.588694 9855 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.588833 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4cfb345e72457babc43037d8002d95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.588792 9219 leader_election.cc:341] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:30.588927 9855 ts_tablet_manager.cc:1397] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.003s
I20260928 14:50:30.589732 9855 raft_consensus.cc:348] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.590106 9855 raft_consensus.cc:374] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.590246 9855 raft_consensus.cc:729] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.590813 9855 consensus_queue.cc:260] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.591786 9855 ts_tablet_manager.cc:1428] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:30.592167 9393 tablet_service.cc:1467] Processing CreateTablet for tablet e59ac8618ca64e09b1af2469745271f8 (DEFAULT_TABLE table=default.Table_46a114a9c79f44b7a5d27044b9cbeda1 [id=8288e9b611a84cd989a7760b50567892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.592943 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59ac8618ca64e09b1af2469745271f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.593353 9855 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.595444 9815 ts_tablet_manager.cc:1918] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.596179 10368 raft_consensus.cc:482] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.587674 9360 leader_election.cc:302] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.596657 9814 ts_tablet_manager.cc:1918] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.596791 9814 log.cc:1196] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/def872f66b2541b9af6084e93d991ec2
I20260928 14:50:30.597244 9814 ts_tablet_manager.cc:1939] T def872f66b2541b9af6084e93d991ec2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:30.598431 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 158832us
I20260928 14:50:30.598801 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 365) took 3029 ms. Trace:
I20260928 14:50:30.598945 9814 rpcz_store.cc:276] 0928 14:50:27.569709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.571899 (+ 2190us) service_pool.cc:227] Handling call
0928 14:50:30.573479 (+3001580us) ts_tablet_manager.cc:1145] Deleting tablet def872f66b2541b9af6084e93d991ec2
0928 14:50:30.573505 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.579062 (+ 5557us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.596563 (+ 17501us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.598751 (+ 2188us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001386}
I20260928 14:50:30.599255 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf10326ec24b99ae2ab1ba8779d1a3" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:30.599750 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet def872f66b2541b9af6084e93d991ec2 (table default.Table_636fad71edff41c6a084cd4b40b2a02e [id=944b7f0777354b8d96d264eb858cfc93]) successfully deleted
I20260928 14:50:30.600252 9814 tablet_replica.cc:330] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.600467 9814 raft_consensus.cc:2229] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:30.598747 10368 raft_consensus.cc:504] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.600991 9815 log.cc:1196] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9a753aaf7f8c4498b6ba35fa27d8c537
I20260928 14:50:30.601647 9426 raft_consensus.cc:3037] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:30.602138 9855 tablet_bootstrap.cc:654] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:30.602437 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 consensus state has no leader
I20260928 14:50:30.603826 9815 ts_tablet_manager.cc:1939] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.602599 10461 raft_consensus.cc:2726] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.604959 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (table default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]) successfully deleted
W20260928 14:50:30.605331 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 42b9f78ecb674ae691d407615680ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42b9f78ecb674ae691d407615680ca56 already in progress: creating tablet
I20260928 14:50:30.605628 10368 leader_election.cc:288] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.605909 9815 tablet_replica.cc:330] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:30.605937 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 56151b288b634d6bb0bc7113afa5fbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56151b288b634d6bb0bc7113afa5fbaa already in progress: creating tablet
I20260928 14:50:30.606106 9815 raft_consensus.cc:2229] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:30.606194 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ad844de91e4040c3a8ae4873c0fa6ba4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad844de91e4040c3a8ae4873c0fa6ba4 already in progress: creating tablet
I20260928 14:50:30.606251 9815 raft_consensus.cc:2258] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.606086 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d2dee96e84524856a0cb33b444f35309"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.606724 9815 ts_tablet_manager.cc:1905] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:30.607161 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2dee96e84524856a0cb33b444f35309 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.612358 9815 ts_tablet_manager.cc:1918] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.612489 9815 log.cc:1196] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/767958659f4f450497eb5f2a3902993e
I20260928 14:50:30.612788 9815 ts_tablet_manager.cc:1939] T 767958659f4f450497eb5f2a3902993e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.613722 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 767958659f4f450497eb5f2a3902993e (table default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]) successfully deleted
I20260928 14:50:30.616113 9848 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:30.621140 9814 raft_consensus.cc:2258] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.623136 9814 ts_tablet_manager.cc:1905] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.625315 9848 ts_tablet_manager.cc:1397] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.776s user 0.018s sys 0.023s
I20260928 14:50:30.626809 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]). Expected version 1 got 0
I20260928 14:50:30.627664 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_39fb4e4216bf46188c6df0df4e908528" } modify_external_catalogs: true
I20260928 14:50:30.627969 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_39fb4e4216bf46188c6df0df4e908528" } modify_external_catalogs: true
I20260928 14:50:30.630451 9426 raft_consensus.cc:2454] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:30.630918 9220 leader_election.cc:302] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:30.631314 10386 raft_consensus.cc:2781] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:30.631459 10386 raft_consensus.cc:686] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:30.631721 10386 consensus_queue.cc:237] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.631920 9814 ts_tablet_manager.cc:1918] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:30.632067 9814 log.cc:1196] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2a30439ac5a8485a9b6ebbe1371087b1
W20260928 14:50:30.632898 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8a55156d0bf94b5fbd810d321e78b760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a55156d0bf94b5fbd810d321e78b760 already in progress: creating tablet
W20260928 14:50:30.633737 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d806161b858145e1a4fa946587ae1529 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d806161b858145e1a4fa946587ae1529 already in progress: creating tablet
I20260928 14:50:30.634277 9848 raft_consensus.cc:348] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.634572 9848 raft_consensus.cc:374] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:30.634600 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 76ad7685ece44665896f687697bddccf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76ad7685ece44665896f687697bddccf already in progress: creating tablet
I20260928 14:50:30.635159 9815 tablet_replica.cc:330] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.635463 9815 raft_consensus.cc:2229] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.635668 9815 raft_consensus.cc:2258] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.636458 9848 raft_consensus.cc:729] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.637472 9848 consensus_queue.cc:260] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.637787 9815 ts_tablet_manager.cc:1905] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.640797 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c17c1cbf98644dbbac8e9d0865546c51" } modify_external_catalogs: true
I20260928 14:50:30.641052 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c17c1cbf98644dbbac8e9d0865546c51" } modify_external_catalogs: true
I20260928 14:50:30.649334 9814 ts_tablet_manager.cc:1939] T 2a30439ac5a8485a9b6ebbe1371087b1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.650215 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 368) took 3052 ms. Trace:
I20260928 14:50:30.650410 9814 rpcz_store.cc:276] 0928 14:50:27.597553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.597823 (+ 270us) service_pool.cc:227] Handling call
0928 14:50:30.600158 (+3002335us) ts_tablet_manager.cc:1145] Deleting tablet 2a30439ac5a8485a9b6ebbe1371087b1
0928 14:50:30.600169 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.628516 (+ 28347us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.631732 (+ 3216us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.650170 (+ 18438us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3002134}
I20260928 14:50:30.650969 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2a30439ac5a8485a9b6ebbe1371087b1 (table default.Table_e3bb5d92feef4555b3d91bc699b0fedd [id=31b4fa881e5841b5ad0dbd225d065c30]) successfully deleted
I20260928 14:50:30.651877 9848 ts_tablet_manager.cc:1428] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 14:50:30.653733 9814 tablet_replica.cc:330] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.654006 9814 raft_consensus.cc:2229] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.654206 9814 raft_consensus.cc:2258] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.654871 9814 ts_tablet_manager.cc:1905] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.657346 9848 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:30.658735 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 60058.4us
I20260928 14:50:30.659544 9815 ts_tablet_manager.cc:1918] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.659693 9815 log.cc:1196] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1738a95895914cc4936a38e1d189d538
I20260928 14:50:30.660074 9815 ts_tablet_manager.cc:1939] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.660768 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1738a95895914cc4936a38e1d189d538 (table default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]) successfully deleted
I20260928 14:50:30.661099 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d004e52539cc49bc8a26f77e0bb182cc" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.662817 10152 raft_consensus.cc:482] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.663025 10152 raft_consensus.cc:504] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.663810 10152 leader_election.cc:288] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.664088 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca7fa45e25b0455e92412b844cd78cdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.664657 9497 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.665302 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6891077c78ef4f3d84e33283096ddf7a" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.666930 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 58bb9c7fc599425484fd3fc0b94f3a8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58bb9c7fc599425484fd3fc0b94f3a8c already in progress: creating tablet
I20260928 14:50:30.667456 9815 tablet_replica.cc:330] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.667654 9815 raft_consensus.cc:2229] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.667800 9815 raft_consensus.cc:2258] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.668309 9815 ts_tablet_manager.cc:1905] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.673983 10152 raft_consensus.cc:482] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.674139 10152 raft_consensus.cc:504] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.674773 10152 leader_election.cc:288] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.675511 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f348f9e962748a0992d85b9d3d72aeb" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.676090 9497 leader_election.cc:341] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.687876 9814 ts_tablet_manager.cc:1918] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.688047 9814 log.cc:1196] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/051b7f0b1d0f4f638f3e7a69a027196e
I20260928 14:50:30.688427 9814 ts_tablet_manager.cc:1939] T 051b7f0b1d0f4f638f3e7a69a027196e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.688657 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fc1ba1d4357b4f88865fb323d86d0bc4" } modify_external_catalogs: true
I20260928 14:50:30.688956 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fc1ba1d4357b4f88865fb323d86d0bc4" } modify_external_catalogs: true
I20260928 14:50:30.689175 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 369) took 3091 ms. Trace:
I20260928 14:50:30.689277 9814 rpcz_store.cc:276] 0928 14:50:27.597656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.598057 (+ 401us) service_pool.cc:227] Handling call
0928 14:50:30.653642 (+3055585us) ts_tablet_manager.cc:1145] Deleting tablet 051b7f0b1d0f4f638f3e7a69a027196e
0928 14:50:30.653655 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.673040 (+ 19385us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.687773 (+ 14733us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.689126 (+ 1353us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3055411}
I20260928 14:50:30.689754 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 051b7f0b1d0f4f638f3e7a69a027196e (table default.Table_f2bc85b7e0f64234b5f336348cb4e49d [id=f63e996c40074c18846443327eb6c36e]) successfully deleted
I20260928 14:50:30.691474 9814 tablet_replica.cc:330] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:30.691713 9814 raft_consensus.cc:2229] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:30.692001 9815 ts_tablet_manager.cc:1918] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.692163 9815 log.cc:1196] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:30.692476 9815 ts_tablet_manager.cc:1939] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.692564 9814 raft_consensus.cc:2258] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.693249 9814 ts_tablet_manager.cc:1905] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.693423 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (table default.Table_4f27adee7f5546bdacf1cf473d252a5b [id=290e5d7ef835430987ca8992b8142bf6]) successfully deleted
I20260928 14:50:30.695812 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_972cb5420d2d477c8ef6d9d095869ab2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.696420 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_972cb5420d2d477c8ef6d9d095869ab2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.701030 9815 tablet_replica.cc:330] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.701483 9815 raft_consensus.cc:2229] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.702090 9815 raft_consensus.cc:2258] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.702965 9815 ts_tablet_manager.cc:1905] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.706727 9814 ts_tablet_manager.cc:1918] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:30.717474 9851 tablet_bootstrap.cc:492] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:30.717675 9851 ts_tablet_manager.cc:1397] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.328s user 0.013s sys 0.002s
I20260928 14:50:30.718603 9851 raft_consensus.cc:348] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.718849 9851 raft_consensus.cc:374] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.718941 9851 raft_consensus.cc:729] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.719165 9851 consensus_queue.cc:260] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.721622 9814 log.cc:1196] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:30.722363 9814 ts_tablet_manager.cc:1939] T 8193754d28d34c18bfc38ae0abd05f4c P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.725566 9813 ts_tablet_manager.cc:1918] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.725756 9813 log.cc:1196] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4bd612753b914a079ccf89249b073018
I20260928 14:50:30.725706 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:30.726166 9360 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:30.726238 9815 ts_tablet_manager.cc:1918] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.726349 9815 log.cc:1196] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:30.727247 9815 ts_tablet_manager.cc:1939] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.727871 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5f348f9e962748a0992d85b9d3d72aeb (table default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:30.734943 9855 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.735062 9855 ts_tablet_manager.cc:1397] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.143s user 0.027s sys 0.010s
W20260928 14:50:30.736918 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aeab20d78f5b41b1b36c3bf379e2c797 has no consensus state
I20260928 14:50:30.737169 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:30.737399 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_29cdf12bddf84c999617ee6e6162abd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.737946 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29cdf12bddf84c999617ee6e6162abd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.737975 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2d5ce241c71f456e8f610e60eedd4b2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.738442 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d5ce241c71f456e8f610e60eedd4b2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.740657 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 9491547723a247b295fbb1444f0002b9 (DEFAULT_TABLE table=default.Table_9961b24814874d1aab1daecdf3ac19e2 [id=11bc2c3d781548cc8572c481bf281133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.741125 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9491547723a247b295fbb1444f0002b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:30.742538 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8237f7d97304a98889bde6817358eda consensus state has no leader
I20260928 14:50:30.744374 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ff761d86b200413d8b8152e64d348f9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.744882 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff761d86b200413d8b8152e64d348f9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:30.747104 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 45811us
W20260928 14:50:30.747287 9498 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.747395 9498 leader_election.cc:302] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:30.747536 9498 raft_consensus.cc:2670] T 1738a95895914cc4936a38e1d189d538 P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:30.748054 10448 log.cc:924] Time spent T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260928 14:50:30.748464 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 9491547723a247b295fbb1444f0002b9 (DEFAULT_TABLE table=default.Table_9961b24814874d1aab1daecdf3ac19e2 [id=11bc2c3d781548cc8572c481bf281133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.735723 9855 raft_consensus.cc:348] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.748849 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 9491547723a247b295fbb1444f0002b9 (DEFAULT_TABLE table=default.Table_9961b24814874d1aab1daecdf3ac19e2 [id=11bc2c3d781548cc8572c481bf281133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:30.748942 9855 raft_consensus.cc:374] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.749013 9855 raft_consensus.cc:729] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.749558 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9491547723a247b295fbb1444f0002b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.749222 9855 consensus_queue.cc:260] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.749959 9813 ts_tablet_manager.cc:1939] T 4bd612753b914a079ccf89249b073018 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:30.751330 9360 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:30.753098 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 370) took 3155 ms. Trace:
I20260928 14:50:30.758884 9848 tablet_bootstrap.cc:654] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.757272 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca7fa45e25b0455e92412b844cd78cdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.757390 9814 rpcz_store.cc:276] 0928 14:50:27.597776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.598256 (+ 480us) service_pool.cc:227] Handling call
0928 14:50:30.691315 (+3093059us) ts_tablet_manager.cc:1145] Deleting tablet 8193754d28d34c18bfc38ae0abd05f4c
0928 14:50:30.691326 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.699372 (+ 8046us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.706632 (+ 7260us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.752938 (+ 46306us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29720,"tablet-delete.queue_time_us":3092920}
I20260928 14:50:30.760766 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 367) took 3163 ms. Trace:
I20260928 14:50:30.761353 9567 raft_consensus.cc:1261] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer ae832871bd1142f7af10c084115ffc12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:30.761438 9855 ts_tablet_manager.cc:1428] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260928 14:50:30.761754 9855 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.764389 9855 tablet_bootstrap.cc:654] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.765194 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8193754d28d34c18bfc38ae0abd05f4c (table default.Table_67666bc5e90b44aab3b47c6d130d117f [id=649895f4721d4daf823b5e04843ae3ec]) successfully deleted
I20260928 14:50:30.765591 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f348f9e962748a0992d85b9d3d72aeb" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.765924 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 358) took 4280 ms. Trace:
I20260928 14:50:30.766296 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9491547723a247b295fbb1444f0002b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:30.767194 9814 rpcz_store.cc:276] 0928 14:50:27.597376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.598423 (+ 1047us) service_pool.cc:227] Handling call
0928 14:50:30.760605 (+3162182us) ts_tablet_manager.cc:1145] Deleting tablet d004e52539cc49bc8a26f77e0bb182cc
0928 14:50:30.760617 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.760730 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3162026}
I20260928 14:50:30.767514 9814 tablet_replica.cc:330] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:30.769827 9498 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.769958 9498 leader_election.cc:302] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:30.770344 9498 leader_election.cc:341] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.770422 9498 leader_election.cc:302] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:30.770547 9498 raft_consensus.cc:2670] T 5f348f9e962748a0992d85b9d3d72aeb P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:30.771242 10152 raft_consensus.cc:2726] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.771452 9814 raft_consensus.cc:2229] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.771663 9814 raft_consensus.cc:2258] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.771924 10473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.60:39777 every 8 connection(s)
I20260928 14:50:30.772696 10204 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.60:39777
W20260928 14:50:30.775146 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d004e52539cc49bc8a26f77e0bb182cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d004e52539cc49bc8a26f77e0bb182cc already in progress: creating tablet
I20260928 14:50:30.775563 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9f2c5afbdeda4ddfb82124031135e6cb
W20260928 14:50:30.776890 9360 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.777231 9360 leader_election.cc:302] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.777443 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_df41708f804a43f985a3b1e87e220d87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.777782 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet f095e4cbf95147d9afb83434ae1fd29f from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:30.778189 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df41708f804a43f985a3b1e87e220d87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.778328 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2101de57a5b547ada12b8fc77a1452c7" } new_table_name: "default.Table_c057e8b0272b426d8f23b17bc9c484b5" modify_external_catalogs: true
W20260928 14:50:30.779193 9360 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.779307 9360 leader_election.cc:302] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:30.780722 10204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-2/data/info.pb
I20260928 14:50:30.781018 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:30.781083 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.782289 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab3bd6d5c946451699ce00e5a839a2d0" } new_table_name: "default.Table_495e7c03dc714f76ae556f136f2a4006" modify_external_catalogs: true
I20260928 14:50:30.786110 9814 ts_tablet_manager.cc:1905] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.788175 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0d79a39b2543049506422432990617 with delete_type TABLET_DATA_DELETED (replaced by tablet f28a74dc0afe4f20b47139a703550ef6) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.788623 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.789281 9851 ts_tablet_manager.cc:1428] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.051s user 0.002s sys 0.000s
W20260928 14:50:30.789948 9219 consensus_peers.cc:487] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a50b4fe8d86464f933baec07478db25. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:30.790752 9851 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:30.790947 10152 raft_consensus.cc:482] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.791122 10152 raft_consensus.cc:504] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.791762 10152 leader_election.cc:288] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.780400 9813 rpcz_store.cc:276] 0928 14:50:26.484853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.484919 (+ 66us) service_pool.cc:227] Handling call
0928 14:50:30.416250 (+3931331us) ts_tablet_manager.cc:1145] Deleting tablet 4bd612753b914a079ccf89249b073018
0928 14:50:30.416259 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.622544 (+206285us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.676598 (+ 54054us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.756892 (+ 80294us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3928191}
I20260928 14:50:30.792068 10368 raft_consensus.cc:2726] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.792258 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.792419 9360 consensus_peers.cc:487] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:30.793133 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:30.793354 9851 tablet_bootstrap.cc:654] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:30.793411 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9f2c5afbdeda4ddfb82124031135e6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5afbdeda4ddfb82124031135e6cb already in progress: creating tablet
W20260928 14:50:30.794174 9497 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.794553 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.794930 9815 tablet_replica.cc:330] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.794822 10368 consensus_queue.cc:1035] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:30.795150 9815 raft_consensus.cc:2229] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.795396 9815 raft_consensus.cc:2258] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.796763 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 359) took 4308 ms. Trace:
I20260928 14:50:30.797278 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4bd612753b914a079ccf89249b073018 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]) successfully deleted
I20260928 14:50:30.797319 9815 ts_tablet_manager.cc:1905] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.798173 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.799948 9814 ts_tablet_manager.cc:1918] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:30.800096 9814 log.cc:1196] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/17d7539290064c2c9fda29a5f16d375b
I20260928 14:50:30.800474 9814 ts_tablet_manager.cc:1939] T 17d7539290064c2c9fda29a5f16d375b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:30.801206 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 371) took 3160 ms. Trace:
I20260928 14:50:30.801311 9814 rpcz_store.cc:276] 0928 14:50:27.640466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.640528 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:30.767456 (+3126928us) ts_tablet_manager.cc:1145] Deleting tablet 17d7539290064c2c9fda29a5f16d375b
0928 14:50:30.767466 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.796750 (+ 29284us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.799849 (+ 3099us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.801152 (+ 1303us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3126659}
I20260928 14:50:30.801685 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 17d7539290064c2c9fda29a5f16d375b (table default.Table_2f0e3191f82a4b09b6c82c8dc841b9a6 [id=f9f104fbe8e04cb0a7eb5c24dd8689fc]) successfully deleted
W20260928 14:50:30.801777 9498 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.801889 9498 leader_election.cc:302] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.802083 10152 raft_consensus.cc:2726] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.802331 9813 rpcz_store.cc:276] 0928 14:50:26.487939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.488000 (+ 61us) service_pool.cc:227] Handling call
0928 14:50:30.796620 (+4308620us) ts_tablet_manager.cc:1145] Deleting tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b
0928 14:50:30.796630 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.796723 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4302525}
I20260928 14:50:30.802631 9813 tablet_replica.cc:330] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:30.803038 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b already in progress: creating tablet
I20260928 14:50:30.803936 9813 raft_consensus.cc:2229] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:30.804239 9813 raft_consensus.cc:2258] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.804760 10467 raft_consensus.cc:2726] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.805163 9813 ts_tablet_manager.cc:1905] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.808889 9855 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.809057 9855 ts_tablet_manager.cc:1397] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.006s
I20260928 14:50:30.810060 9855 raft_consensus.cc:348] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.810245 9855 raft_consensus.cc:374] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.810295 9855 raft_consensus.cc:729] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.813308 9815 ts_tablet_manager.cc:1918] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.816248 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.820835 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bd9cedadc7184013a37857206bec2ff0
I20260928 14:50:30.821892 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9cedadc7184013a37857206bec2ff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.822867 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e314d6b2a6bb4dbcaa7c626dd204434d" } new_table_name: "default.Table_ee99ff1c771d463fa139847102145b47" modify_external_catalogs: true
I20260928 14:50:30.811605 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 394) took 2560 ms. Trace:
I20260928 14:50:30.827361 9814 rpcz_store.cc:276] 0928 14:50:28.251382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.254441 (+ 3059us) service_pool.cc:227] Handling call
0928 14:50:30.811449 (+2557008us) ts_tablet_manager.cc:1145] Deleting tablet 5f348f9e962748a0992d85b9d3d72aeb
0928 14:50:30.811460 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.811552 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2524161}
I20260928 14:50:30.828138 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 395) took 2551 ms. Trace:
W20260928 14:50:30.828722 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5f348f9e962748a0992d85b9d3d72aeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f348f9e962748a0992d85b9d3d72aeb already in progress: creating tablet
I20260928 14:50:30.814057 9855 consensus_queue.cc:260] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.823243 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9cedadc7184013a37857206bec2ff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.826277 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.831600 9815 log.cc:1196] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:30.831377 10152 raft_consensus.cc:482] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.831867 10152 raft_consensus.cc:504] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.832429 10152 leader_election.cc:288] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.831993 9815 ts_tablet_manager.cc:1939] T ca7fa45e25b0455e92412b844cd78cdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.834079 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ca7fa45e25b0455e92412b844cd78cdc (table default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]) successfully deleted
I20260928 14:50:30.835922 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 10204
I20260928 14:50:30.836705 9815 tablet_replica.cc:330] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.836934 9815 raft_consensus.cc:2229] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.837224 9815 raft_consensus.cc:2258] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.839821 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9cedadc7184013a37857206bec2ff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.841367 10152 raft_consensus.cc:482] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.841488 10152 raft_consensus.cc:504] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.842339 10152 leader_election.cc:288] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:30.843147 9855 ts_tablet_manager.cc:1428] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.034s user 0.001s sys 0.005s
I20260928 14:50:30.842337 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.844559 9498 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.845919 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.846385 9498 leader_election.cc:341] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.833124 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:30.850543 9814 rpcz_store.cc:276] 0928 14:50:28.276566 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.277394 (+ 828us) service_pool.cc:227] Handling call
0928 14:50:30.827870 (+2550476us) ts_tablet_manager.cc:1145] Deleting tablet 1c54cb0e8f2347d9b139c8766fb61ab1
0928 14:50:30.827881 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.828005 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2527960}
I20260928 14:50:30.843189 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.850960 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c54cb0e8f2347d9b139c8766fb61ab1 already in progress: creating tablet
W20260928 14:50:30.851321 9497 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.851419 9497 leader_election.cc:302] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.849244 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:30.852198 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_39aa0016dfa8463b94c3b945befd0d45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.852406 9815 ts_tablet_manager.cc:1905] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:30.852780 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39aa0016dfa8463b94c3b945befd0d45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.854426 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_00bd3ddea1be4fc6a7815385fa27f691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.854947 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00bd3ddea1be4fc6a7815385fa27f691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.855482 9813 ts_tablet_manager.cc:1918] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:30.855770 9813 log.cc:1196] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/dd70cf6ee2d343878c90ae4818f1eb8f
I20260928 14:50:30.856262 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 299ed0acd7cf46d3b78f4f4cea31858f
I20260928 14:50:30.856796 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet e760d7e556a54fda9dc91300b9968c68 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:30.857622 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.859818 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.861352 9813 ts_tablet_manager.cc:1939] T dd70cf6ee2d343878c90ae4818f1eb8f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:30.863816 9848 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:30.851591 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 393) took 2600 ms. Trace:
I20260928 14:50:30.864006 9814 rpcz_store.cc:276] 0928 14:50:28.251277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.251431 (+ 154us) service_pool.cc:227] Handling call
0928 14:50:30.851444 (+2600013us) ts_tablet_manager.cc:1145] Deleting tablet 62d6975813b744fb80dcc432cec61cb4
0928 14:50:30.851455 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.851540 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550877}
W20260928 14:50:30.864475 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 62d6975813b744fb80dcc432cec61cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62d6975813b744fb80dcc432cec61cb4 already in progress: creating tablet
I20260928 14:50:30.865126 9855 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.865249 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 397) took 2508 ms. Trace:
W20260928 14:50:30.865252 9497 leader_election.cc:341] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.865353 9497 leader_election.cc:302] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.865358 9814 rpcz_store.cc:276] 0928 14:50:28.356382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.356986 (+ 604us) service_pool.cc:227] Handling call
0928 14:50:30.865034 (+2508048us) ts_tablet_manager.cc:1145] Deleting tablet 8520b28899bc42b08e239502adb8fece
0928 14:50:30.865044 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.865166 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2487950}
W20260928 14:50:30.865809 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8520b28899bc42b08e239502adb8fece because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8520b28899bc42b08e239502adb8fece already in progress: creating tablet
I20260928 14:50:30.865937 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.866240 10152 raft_consensus.cc:2726] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.866374 10152 raft_consensus.cc:2726] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.869961 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 396) took 2514 ms. Trace:
I20260928 14:50:30.870065 9814 rpcz_store.cc:276] 0928 14:50:28.355379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.355424 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:30.869794 (+2514370us) ts_tablet_manager.cc:1145] Deleting tablet ab71087d034c4bedb06df9e5ccefad45
0928 14:50:30.869806 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.869909 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2484518}
I20260928 14:50:30.870244 9848 ts_tablet_manager.cc:1397] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.218s user 0.012s sys 0.000s
W20260928 14:50:30.870461 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ab71087d034c4bedb06df9e5ccefad45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab71087d034c4bedb06df9e5ccefad45 already in progress: creating tablet
I20260928 14:50:30.870481 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 357) took 4386 ms. Trace:
I20260928 14:50:30.870848 9813 rpcz_store.cc:276] 0928 14:50:26.475327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.493818 (+ 18491us) service_pool.cc:227] Handling call
0928 14:50:30.802576 (+4308758us) ts_tablet_manager.cc:1145] Deleting tablet dd70cf6ee2d343878c90ae4818f1eb8f
0928 14:50:30.802585 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.808143 (+ 5558us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.855372 (+ 47229us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.861753 (+ 6381us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4306077}
I20260928 14:50:30.872473 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet dd70cf6ee2d343878c90ae4818f1eb8f (table default.Table_0628bbb0b50640ff9da42eef50691d9d [id=0c7c9f38c5984b3597ba7b03c38113a4]) successfully deleted
I20260928 14:50:30.872411 10481 tablet.cc:1722] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:30.873014 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 360) took 4365 ms. Trace:
I20260928 14:50:30.873119 9813 rpcz_store.cc:276] 0928 14:50:26.507478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.531046 (+ 23568us) service_pool.cc:227] Handling call
0928 14:50:30.872669 (+4341623us) ts_tablet_manager.cc:1145] Deleting tablet f28a74dc0afe4f20b47139a703550ef6
0928 14:50:30.872679 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.872768 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4341186}
W20260928 14:50:30.873765 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f28a74dc0afe4f20b47139a703550ef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f28a74dc0afe4f20b47139a703550ef6 already in progress: creating tablet
I20260928 14:50:30.877012 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c163d657ec4f40598d7f4f3879e6d817
I20260928 14:50:30.873023 9848 raft_consensus.cc:348] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.878382 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a7be6013a04c4222ab34a19e77e48a37
I20260928 14:50:30.879375 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 361) took 4285 ms. Trace:
I20260928 14:50:30.879506 9813 rpcz_store.cc:276] 0928 14:50:26.587670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.587850 (+ 180us) service_pool.cc:227] Handling call
0928 14:50:30.873333 (+4285483us) ts_tablet_manager.cc:1145] Deleting tablet e89035a3d41a4af78a8e7afbdb89c7e0
0928 14:50:30.873343 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.873419 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4284985}
I20260928 14:50:30.879925 9813 tablet_replica.cc:330] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:30.880125 9813 raft_consensus.cc:2229] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.880195 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.880611 9813 raft_consensus.cc:2258] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.881067 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet c163d657ec4f40598d7f4f3879e6d817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.881183 9813 ts_tablet_manager.cc:1905] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.881456 9814 tablet_replica.cc:330] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:30.882445 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e89035a3d41a4af78a8e7afbdb89c7e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e89035a3d41a4af78a8e7afbdb89c7e0 already in progress: creating tablet
I20260928 14:50:30.882781 10477 sys_catalog.cc:263] Verifying existing consensus state
I20260928 14:50:30.882787 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet c163d657ec4f40598d7f4f3879e6d817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.883656 9851 tablet_bootstrap.cc:492] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:30.883934 9851 ts_tablet_manager.cc:1397] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.004s
I20260928 14:50:30.884800 9851 raft_consensus.cc:348] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.885951 9814 raft_consensus.cc:2229] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.886409 9814 raft_consensus.cc:2258] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.886912 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_47b65a11c8a840138ed5b134b3444f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.887504 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b65a11c8a840138ed5b134b3444f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.888744 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap starting.
I20260928 14:50:30.886554 9851 raft_consensus.cc:374] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.888931 9851 raft_consensus.cc:729] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.892141 9851 consensus_queue.cc:260] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.896899 9851 ts_tablet_manager.cc:1428] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 14:50:30.903949 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5bd55311d51a4e1c8bc422ce637cc3bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.904124 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.904306 9848 raft_consensus.cc:374] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.904393 9848 raft_consensus.cc:729] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:30.904507 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bd55311d51a4e1c8bc422ce637cc3bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.904685 9848 consensus_queue.cc:260] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:30.905269 9848 ts_tablet_manager.cc:1428] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260928 14:50:30.892784 9814 ts_tablet_manager.cc:1905] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.905833 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 03245f72e0aa496d895968d8e5715b56 with delete_type TABLET_DATA_DELETED (replaced by tablet 254ab608221e4fe2bc459f9d6fee925a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.911528 9851 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:30.913801 9848 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:30.915835 9848 tablet_bootstrap.cc:654] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.916028 10484 raft_consensus.cc:482] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.916186 10484 raft_consensus.cc:504] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:30.917363 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 727cb249723946578bc5bb086d6e6c40 consensus state has no leader
I20260928 14:50:30.920114 9813 ts_tablet_manager.cc:1918] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.920255 9813 log.cc:1196] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:30.920660 9813 ts_tablet_manager.cc:1939] T f3dee7ff6d5544908cdd9dbd45ce521a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:30.925062 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ca013d1c5b44730b7163e71dc408b04 consensus state has no leader
W20260928 14:50:30.931088 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71a94a7a6c81453c8e47149be3d6479e consensus state has no leader
I20260928 14:50:30.933125 9848 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:30.933281 9848 ts_tablet_manager.cc:1397] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260928 14:50:30.934888 9855 tablet_bootstrap.cc:654] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.935245 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet c163d657ec4f40598d7f4f3879e6d817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.935850 10483 tablet.cc:1722] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:30.936522 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.938292 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:30.947211 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_18b0ab4255ca4b42a4c0f4e3312292f2" } new_table_name: "default.Table_0452fe5fc0694c6485030fef808415e4" modify_external_catalogs: true
I20260928 14:50:30.948269 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 4 got 0
I20260928 14:50:30.948450 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d78457546ab422d81de650938efde25" } new_table_name: "default.Table_fd5a571ea1184352add2e0820dd66019" modify_external_catalogs: true
I20260928 14:50:30.950316 10484 leader_election.cc:288] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:30.951189 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:30.951793 9498 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.955399 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:30.955940 8955 catalog_manager.cc:6565] ReplaceTablet: tablet e760d7e556a54fda9dc91300b9968c68 deleted and replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007
I20260928 14:50:30.956256 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:30.956784 9815 ts_tablet_manager.cc:1918] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:30.956907 9815 log.cc:1196] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:30.957211 9815 ts_tablet_manager.cc:1939] T 4bea51859e0c4bc984288f94c2fcea2e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:30.958729 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.958748 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:30.963174 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4bea51859e0c4bc984288f94c2fcea2e (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
W20260928 14:50:30.964198 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bd9cedadc7184013a37857206bec2ff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd9cedadc7184013a37857206bec2ff0 already in progress: creating tablet
I20260928 14:50:30.964401 9815 tablet_replica.cc:330] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:30.964596 9815 raft_consensus.cc:2229] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.964726 9815 raft_consensus.cc:2258] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.968840 9855 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:30.969039 9855 ts_tablet_manager.cc:1397] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.005s
I20260928 14:50:30.969957 9855 raft_consensus.cc:348] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.970319 9855 raft_consensus.cc:374] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.970425 9855 raft_consensus.cc:729] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.970476 9815 ts_tablet_manager.cc:1905] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.971376 9855 consensus_queue.cc:260] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:30.972158 9855 ts_tablet_manager.cc:1428] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:30.972081 9848 raft_consensus.cc:348] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.972342 9848 raft_consensus.cc:374] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:30.972609 9855 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:30.972580 9848 raft_consensus.cc:729] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:30.972970 10481 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:30.973641 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:30.974323 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:30.977311 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:30.977610 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:30.978708 9497 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:30.978823 9497 leader_election.cc:302] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.979206 10484 raft_consensus.cc:2726] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.980804 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 362) took 4156 ms. Trace:
I20260928 14:50:30.981109 9813 rpcz_store.cc:276] 0928 14:50:26.818947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.819002 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:30.879717 (+4060715us) ts_tablet_manager.cc:1145] Deleting tablet f3dee7ff6d5544908cdd9dbd45ce521a
0928 14:50:30.879726 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.888088 (+ 8362us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.919988 (+ 31900us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:30.975407 (+ 55419us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060498}
I20260928 14:50:30.981814 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f3dee7ff6d5544908cdd9dbd45ce521a (table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]) successfully deleted
I20260928 14:50:30.982220 9813 tablet_replica.cc:330] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:30.982431 9813 raft_consensus.cc:2229] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:30.982605 9813 raft_consensus.cc:2258] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:30.982590 10386 raft_consensus.cc:482] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:30.982820 10386 raft_consensus.cc:504] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.983127 9813 ts_tablet_manager.cc:1905] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:30.984053 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_910b553832a74282801d23da9050185b" } modify_external_catalogs: true
I20260928 14:50:30.984258 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_910b553832a74282801d23da9050185b" } modify_external_catalogs: true
I20260928 14:50:30.984982 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_885f9ac0ea4c4c918834dd9e3fa63889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:30.986449 10386 leader_election.cc:288] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:30.986570 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_885f9ac0ea4c4c918834dd9e3fa63889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:30.986804 9220 leader_election.cc:341] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: ed0d79a39b2543049506422432990617
W20260928 14:50:30.988075 9219 leader_election.cc:341] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ed0d79a39b2543049506422432990617
I20260928 14:50:30.988349 9219 leader_election.cc:302] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:30.988840 10445 raft_consensus.cc:2726] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:30.989431 10445 consensus_queue.cc:1035] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:30.992182 9851 tablet_bootstrap.cc:654] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.972898 9848 consensus_queue.cc:260] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:30.994076 9848 ts_tablet_manager.cc:1428] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.061s user 0.001s sys 0.002s
I20260928 14:50:30.994135 10477 log.cc:824] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:30.994354 9848 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:30.996040 9848 tablet_bootstrap.cc:654] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:30.997951 9473 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:31.004079 9814 ts_tablet_manager.cc:1918] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.004429 9855 tablet_bootstrap.cc:654] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.007601 9815 ts_tablet_manager.cc:1918] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.007850 10483 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:31.009812 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 1b22c3f9578a464a96be0bac6127e56d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:31.011929 9814 log.cc:1196] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9d6dc266ab8248d381e4850179455795
I20260928 14:50:31.012780 9815 log.cc:1196] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:31.013012 9814 ts_tablet_manager.cc:1939] T 9d6dc266ab8248d381e4850179455795 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:31.013350 9815 ts_tablet_manager.cc:1939] T d199c65d3b4040388360fd8302d7cb8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.014420 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d199c65d3b4040388360fd8302d7cb8c (table default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]) successfully deleted
W20260928 14:50:31.015080 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 51939.3us
W20260928 14:50:31.016047 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 299ed0acd7cf46d3b78f4f4cea31858f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 299ed0acd7cf46d3b78f4f4cea31858f already in progress: creating tablet
W20260928 14:50:31.017120 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c163d657ec4f40598d7f4f3879e6d817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c163d657ec4f40598d7f4f3879e6d817 already in progress: creating tablet
W20260928 14:50:31.017951 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a7be6013a04c4222ab34a19e77e48a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7be6013a04c4222ab34a19e77e48a37 already in progress: creating tablet
W20260928 14:50:31.018778 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e760d7e556a54fda9dc91300b9968c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e760d7e556a54fda9dc91300b9968c68 already in progress: creating tablet
I20260928 14:50:31.019291 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 403) took 2543 ms. Trace:
I20260928 14:50:31.019349 9815 tablet_replica.cc:330] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.019513 9815 raft_consensus.cc:2229] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.020135 9815 raft_consensus.cc:2258] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.021891 9815 ts_tablet_manager.cc:1905] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.021867 9814 rpcz_store.cc:276] 0928 14:50:28.476042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.476095 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:30.881363 (+2405268us) ts_tablet_manager.cc:1145] Deleting tablet 9d6dc266ab8248d381e4850179455795
0928 14:50:30.881375 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:30.992674 (+111299us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.003928 (+ 11254us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.019253 (+ 15325us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2404275}
I20260928 14:50:31.022321 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9d6dc266ab8248d381e4850179455795 (table default.Table_95fe08d401ce4a5e84c4d8b47f0243ea [id=1c8087c2f05946b7aeb420ab7f693b00]) successfully deleted
I20260928 14:50:31.022215 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_052d438b7adf4ffdb7edf480ce30195f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.022877 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_052d438b7adf4ffdb7edf480ce30195f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.024806 9814 tablet_replica.cc:330] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:31.025012 9814 raft_consensus.cc:2229] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.026183 9814 raft_consensus.cc:2258] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:31.026469 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ae8348f77764a5e8787a33f657ca80d consensus state has no leader
I20260928 14:50:31.026970 9814 ts_tablet_manager.cc:1905] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:31.027097 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30c37b3409d84a6f847d6e3369d3e5ff has no consensus state
I20260928 14:50:31.028240 8953 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:31.033625 9815 ts_tablet_manager.cc:1918] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.033725 9815 log.cc:1196] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cbd9f9cb48a945d19420a8bdb9bb9576
I20260928 14:50:31.042428 10215 raft_consensus.cc:482] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.042593 10215 raft_consensus.cc:504] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.042749 9815 ts_tablet_manager.cc:1939] T cbd9f9cb48a945d19420a8bdb9bb9576 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.042841 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 30c37b3409d84a6f847d6e3369d3e5ff (DEFAULT_TABLE table=default.Table_fd5a571ea1184352add2e0820dd66019 [id=4eabefb7fd674f7ba600caa96215eb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.043205 10215 leader_election.cc:288] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:31.043268 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30c37b3409d84a6f847d6e3369d3e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:31.044164 9360 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:31.040170 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 30c37b3409d84a6f847d6e3369d3e5ff (DEFAULT_TABLE table=default.Table_fd5a571ea1184352add2e0820dd66019 [id=4eabefb7fd674f7ba600caa96215eb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.045859 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30c37b3409d84a6f847d6e3369d3e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.040369 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c (DEFAULT_TABLE table=default.Table_62f2b3da53c74c06893428d46c68d11c [id=17b8ee5a252847c5b153549d7d9abf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.050362 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.035418 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 77c9ac6b283e4711bcf46a68f7de37a5 (DEFAULT_TABLE table=default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7 [id=36eed33cf4f94fcc8ed64be7f2788f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.053383 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c9ac6b283e4711bcf46a68f7de37a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.035972 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 30c37b3409d84a6f847d6e3369d3e5ff (DEFAULT_TABLE table=default.Table_fd5a571ea1184352add2e0820dd66019 [id=4eabefb7fd674f7ba600caa96215eb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.040627 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 77c9ac6b283e4711bcf46a68f7de37a5 (DEFAULT_TABLE table=default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7 [id=36eed33cf4f94fcc8ed64be7f2788f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.053782 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30c37b3409d84a6f847d6e3369d3e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.053871 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c9ac6b283e4711bcf46a68f7de37a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.036453 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c (DEFAULT_TABLE table=default.Table_62f2b3da53c74c06893428d46c68d11c [id=17b8ee5a252847c5b153549d7d9abf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.040942 9542 tablet_service.cc:1467] Processing CreateTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 (DEFAULT_TABLE table=default.Table_5558aed7f8954bb3b2a5c0891ef030a8 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.057869 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeab20d78f5b41b1b36c3bf379e2c797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.057907 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.036921 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 873469257ed14808be231b92f3149642 (DEFAULT_TABLE table=default.Table_ed2b822b497a4466ba6ce258dbb3a135 [id=9453f5b66b854be1a820c24790b21d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.059973 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873469257ed14808be231b92f3149642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.061362 9848 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:31.037315 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 (DEFAULT_TABLE table=default.Table_4a9a87d2f732492786e402d485c1dbf1 [id=143a4a7ccd3b405c8308482ad4b06c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.061550 9848 ts_tablet_manager.cc:1397] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.004s
I20260928 14:50:31.037842 9253 tablet_service.cc:1467] Processing CreateTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 (DEFAULT_TABLE table=default.Table_5558aed7f8954bb3b2a5c0891ef030a8 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.041133 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 05a9e2d2794545eab75daf61d75272c6 (DEFAULT_TABLE table=default.Table_d63761d56fb04de5af441abb8bf27540 [id=4ea3c1c824ad40b5a3de47392417c348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.062001 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a9e2d2794545eab75daf61d75272c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.062321 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 010e4f56e85a44d6a1f7524217d3cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.041328 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 873469257ed14808be231b92f3149642 (DEFAULT_TABLE table=default.Table_ed2b822b497a4466ba6ce258dbb3a135 [id=9453f5b66b854be1a820c24790b21d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.065871 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873469257ed14808be231b92f3149642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.041503 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 (DEFAULT_TABLE table=default.Table_4a9a87d2f732492786e402d485c1dbf1 [id=143a4a7ccd3b405c8308482ad4b06c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.069934 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 010e4f56e85a44d6a1f7524217d3cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.071013 9848 raft_consensus.cc:348] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.071261 9848 raft_consensus.cc:374] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.071327 9848 raft_consensus.cc:729] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.071781 9813 ts_tablet_manager.cc:1918] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:31.072505 9848 consensus_queue.cc:260] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.072924 9813 log.cc:1196] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8193754d28d34c18bfc38ae0abd05f4c
I20260928 14:50:31.038307 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 05a9e2d2794545eab75daf61d75272c6 (DEFAULT_TABLE table=default.Table_d63761d56fb04de5af441abb8bf27540 [id=4ea3c1c824ad40b5a3de47392417c348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.044170 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad2124268994f04ae7153ea5aaeeab0" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:31.075546 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a9e2d2794545eab75daf61d75272c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:31.075692 9360 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.075939 9360 leader_election.cc:302] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:31.076231 10215 raft_consensus.cc:2726] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:31.077337 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeab20d78f5b41b1b36c3bf379e2c797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.079720 9848 ts_tablet_manager.cc:1428] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260928 14:50:31.080169 9813 ts_tablet_manager.cc:1939] T 8193754d28d34c18bfc38ae0abd05f4c P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.052739 9851 tablet_bootstrap.cc:492] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:31.087244 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 363) took 4135 ms. Trace:
I20260928 14:50:31.087360 9813 rpcz_store.cc:276] 0928 14:50:26.952086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:26.952143 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:30.982059 (+4029916us) ts_tablet_manager.cc:1145] Deleting tablet 8193754d28d34c18bfc38ae0abd05f4c
0928 14:50:30.982070 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.016273 (+ 34203us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.070574 (+ 54301us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.087184 (+ 16610us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4029702}
I20260928 14:50:31.087801 9848 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:31.089308 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cbd9f9cb48a945d19420a8bdb9bb9576 (table default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]) successfully deleted
I20260928 14:50:31.091013 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 364) took 4066 ms. Trace:
I20260928 14:50:31.091130 9813 rpcz_store.cc:276] 0928 14:50:27.024180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.024235 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:31.090851 (+4066616us) ts_tablet_manager.cc:1145] Deleting tablet 71b5f68b570e4fff8f8748e4c762ad78
0928 14:50:31.090861 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.090962 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4019896}
I20260928 14:50:31.098060 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 365) took 3819 ms. Trace:
I20260928 14:50:31.098160 9813 rpcz_store.cc:276] 0928 14:50:27.278390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.278444 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:31.097906 (+3819462us) ts_tablet_manager.cc:1145] Deleting tablet b9f843006a1e43a49f177433c7a3e1ea
0928 14:50:31.097916 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.098000 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3819201}
I20260928 14:50:31.099171 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 368) took 3645 ms. Trace:
I20260928 14:50:31.099273 9813 rpcz_store.cc:276] 0928 14:50:27.453616 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.455734 (+ 2118us) service_pool.cc:227] Handling call
0928 14:50:31.099018 (+3643284us) ts_tablet_manager.cc:1145] Deleting tablet 24b256211679481eb0e0309c56ff60c6
0928 14:50:31.099028 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.099118 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3643082}
I20260928 14:50:31.099658 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 369) took 3626 ms. Trace:
I20260928 14:50:31.099774 9813 rpcz_store.cc:276] 0928 14:50:27.473289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.475298 (+ 2009us) service_pool.cc:227] Handling call
0928 14:50:31.099484 (+3624186us) ts_tablet_manager.cc:1145] Deleting tablet 73bbcf31960d478087a0a91337c34ec8
0928 14:50:31.099492 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.099602 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623970}
I20260928 14:50:31.100351 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c (DEFAULT_TABLE table=default.Table_62f2b3da53c74c06893428d46c68d11c [id=17b8ee5a252847c5b153549d7d9abf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.100589 9848 tablet_bootstrap.cc:654] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.100955 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.103127 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 370) took 3599 ms. Trace:
I20260928 14:50:31.103322 9813 rpcz_store.cc:276] 0928 14:50:27.503407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.504916 (+ 1509us) service_pool.cc:227] Handling call
0928 14:50:31.099986 (+3595070us) ts_tablet_manager.cc:1145] Deleting tablet cadfdf093ab04b61af441cff6c9c510b
0928 14:50:31.099994 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.102906 (+ 2912us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3594896}
I20260928 14:50:31.103703 9813 tablet_replica.cc:330] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:31.103910 9813 raft_consensus.cc:2229] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.104090 9813 raft_consensus.cc:2258] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.104601 9813 ts_tablet_manager.cc:1905] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.110049 9848 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:31.110184 9848 ts_tablet_manager.cc:1397] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260928 14:50:31.114069 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 77c9ac6b283e4711bcf46a68f7de37a5 (DEFAULT_TABLE table=default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7 [id=36eed33cf4f94fcc8ed64be7f2788f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.114444 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c9ac6b283e4711bcf46a68f7de37a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.114758 9848 raft_consensus.cc:348] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.115079 9848 raft_consensus.cc:374] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.115296 9848 raft_consensus.cc:729] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.118775 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8193754d28d34c18bfc38ae0abd05f4c (table default.Table_67666bc5e90b44aab3b47c6d130d117f [id=649895f4721d4daf823b5e04843ae3ec]) successfully deleted
W20260928 14:50:31.119243 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 71b5f68b570e4fff8f8748e4c762ad78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71b5f68b570e4fff8f8748e4c762ad78 already in progress: creating tablet
W20260928 14:50:31.119683 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b9f843006a1e43a49f177433c7a3e1ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9f843006a1e43a49f177433c7a3e1ea already in progress: creating tablet
I20260928 14:50:31.119830 9402 tablet_service.cc:1467] Processing CreateTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 (DEFAULT_TABLE table=default.Table_5558aed7f8954bb3b2a5c0891ef030a8 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.120079 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 24b256211679481eb0e0309c56ff60c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24b256211679481eb0e0309c56ff60c6 already in progress: creating tablet
I20260928 14:50:31.120349 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 05a9e2d2794545eab75daf61d75272c6 (DEFAULT_TABLE table=default.Table_d63761d56fb04de5af441abb8bf27540 [id=4ea3c1c824ad40b5a3de47392417c348]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.120409 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 73bbcf31960d478087a0a91337c34ec8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73bbcf31960d478087a0a91337c34ec8 already in progress: creating tablet
I20260928 14:50:31.120924 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a9e2d2794545eab75daf61d75272c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.121014 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 873469257ed14808be231b92f3149642 (DEFAULT_TABLE table=default.Table_ed2b822b497a4466ba6ce258dbb3a135 [id=9453f5b66b854be1a820c24790b21d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.121364 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873469257ed14808be231b92f3149642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.122406 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeab20d78f5b41b1b36c3bf379e2c797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.115590 9848 consensus_queue.cc:260] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.117648 9851 ts_tablet_manager.cc:1397] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.176s user 0.001s sys 0.009s
I20260928 14:50:31.123558 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 (DEFAULT_TABLE table=default.Table_4a9a87d2f732492786e402d485c1dbf1 [id=143a4a7ccd3b405c8308482ad4b06c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.123947 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 010e4f56e85a44d6a1f7524217d3cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.125813 9851 raft_consensus.cc:348] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.126049 9851 raft_consensus.cc:374] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.126138 9851 raft_consensus.cc:729] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.127048 9851 consensus_queue.cc:260] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.129271 9855 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.129397 9855 ts_tablet_manager.cc:1397] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.157s user 0.003s sys 0.048s
W20260928 14:50:31.129703 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cadfdf093ab04b61af441cff6c9c510b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cadfdf093ab04b61af441cff6c9c510b already in progress: creating tablet
I20260928 14:50:31.130007 9855 raft_consensus.cc:348] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.130198 9855 raft_consensus.cc:374] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.130260 9855 raft_consensus.cc:729] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.130889 9851 ts_tablet_manager.cc:1428] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:31.131220 9851 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:31.132051 9855 consensus_queue.cc:260] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.138338 9855 ts_tablet_manager.cc:1428] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:31.139712 10215 raft_consensus.cc:482] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.144878 8955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98] alter complete (version 1)
I20260928 14:50:31.146131 9855 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.147617 9855 tablet_bootstrap.cc:654] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.149792 9855 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.149915 9855 ts_tablet_manager.cc:1397] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:31.150733 8953 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:31.150647 9855 raft_consensus.cc:348] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.150861 9855 raft_consensus.cc:374] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.150913 9855 raft_consensus.cc:729] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.151196 9855 consensus_queue.cc:260] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.152530 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fb3a35c7785c4d9688f871b588345ff6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.153112 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb3a35c7785c4d9688f871b588345ff6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.154637 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7a4bbe399d049febce65ba67480aa5b" } modify_external_catalogs: true
I20260928 14:50:31.154839 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7a4bbe399d049febce65ba67480aa5b" } modify_external_catalogs: true
I20260928 14:50:31.156262 9855 ts_tablet_manager.cc:1428] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:31.156492 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4a9a87d2f732492786e402d485c1dbf1" } modify_external_catalogs: true
I20260928 14:50:31.156682 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4a9a87d2f732492786e402d485c1dbf1" } modify_external_catalogs: true
I20260928 14:50:31.157182 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:31.160122 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e255f8403baa437f9a75d582b7d9a26a" } modify_external_catalogs: true
I20260928 14:50:31.160296 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_972cb5420d2d477c8ef6d9d095869ab2" } modify_external_catalogs: true
I20260928 14:50:31.160336 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e255f8403baa437f9a75d582b7d9a26a" } modify_external_catalogs: true
I20260928 14:50:31.160560 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_972cb5420d2d477c8ef6d9d095869ab2" } modify_external_catalogs: true
I20260928 14:50:31.162477 9855 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.163079 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_766e2c205c494d5695c1c6bd3e8a0dad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.163591 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_766e2c205c494d5695c1c6bd3e8a0dad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.163784 9855 tablet_bootstrap.cc:654] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.164041 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b47d891c9264a03ac11f50f2b56edad with delete_type TABLET_DATA_DELETED (replaced by tablet 2c88ccde6f7540d4aa7cf9b29aa3718d) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.171501 9855 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.171623 9855 ts_tablet_manager.cc:1397] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20260928 14:50:31.172475 9855 raft_consensus.cc:348] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.172672 9855 raft_consensus.cc:374] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.172726 9855 raft_consensus.cc:729] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.172926 9855 consensus_queue.cc:260] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.173663 10215 raft_consensus.cc:504] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.174084 9848 ts_tablet_manager.cc:1428] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260928 14:50:31.176337 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999aa56f1683464d9612a2ddbfbebbda" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:31.177513 9855 ts_tablet_manager.cc:1428] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:31.181669 9855 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.182924 9855 tablet_bootstrap.cc:654] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.184310 9851 tablet_bootstrap.cc:654] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.186990 9855 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.187122 9855 ts_tablet_manager.cc:1397] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260928 14:50:31.187711 9814 ts_tablet_manager.cc:1918] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.187753 9855 raft_consensus.cc:348] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.187958 9855 raft_consensus.cc:374] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.188022 9855 raft_consensus.cc:729] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.188244 9855 consensus_queue.cc:260] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.188587 9814 log.cc:1196] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8218bc963a9941a49e8329d0a04d8252
I20260928 14:50:31.192827 9855 ts_tablet_manager.cc:1428] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:31.193100 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_05d04a6e96fe450993476e530099d223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.193457 9814 ts_tablet_manager.cc:1939] T 8218bc963a9941a49e8329d0a04d8252 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:31.194315 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 404) took 2717 ms. Trace:
I20260928 14:50:31.194412 9814 rpcz_store.cc:276] 0928 14:50:28.477144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.477193 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:31.024740 (+2547547us) ts_tablet_manager.cc:1145] Deleting tablet 8218bc963a9941a49e8329d0a04d8252
0928 14:50:31.024752 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.116778 (+ 92026us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.187536 (+ 70758us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.194253 (+ 6717us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2537226}
I20260928 14:50:31.194808 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cbb232c73f014351b796a86180ffb660
I20260928 14:50:31.195258 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 410) took 2692 ms. Trace:
I20260928 14:50:31.195423 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5bd55311d51a4e1c8bc422ce637cc3bb" } new_table_name: "default.Table_1cce0e105c224511a8e0a5ca3eb55723" modify_external_catalogs: true
I20260928 14:50:31.195694 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8218bc963a9941a49e8329d0a04d8252 (table default.Table_52d13edfb61a4b7aa82f6a3997a78f2c [id=77614b71faa3420291481f6e7c502533]) successfully deleted
I20260928 14:50:31.196389 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.196990 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 010e4f56e85a44d6a1f7524217d3cc58
I20260928 14:50:31.197190 9855 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.197633 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6ed8ff8486eb431fb6b3a9389b206f83" } new_table_name: "default.Table_38b8fb0e45f647cd87ab318cd0df691c" modify_external_catalogs: true
I20260928 14:50:31.196085 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.198513 9814 rpcz_store.cc:276] 0928 14:50:28.502493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.505790 (+ 3297us) service_pool.cc:227] Handling call
0928 14:50:31.194839 (+2689049us) ts_tablet_manager.cc:1145] Deleting tablet dc5ee93708ea4f3fabdf93aa9c33c1c8
0928 14:50:31.194852 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.195104 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2679170}
I20260928 14:50:31.199162 9855 tablet_bootstrap.cc:654] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:31.199864 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 already in progress: creating tablet
I20260928 14:50:31.199896 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:31.200129 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cbb232c73f014351b796a86180ffb660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbb232c73f014351b796a86180ffb660 already in progress: creating tablet
I20260928 14:50:31.200094 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.200376 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 411) took 2683 ms. Trace:
I20260928 14:50:31.200580 9814 rpcz_store.cc:276] 0928 14:50:28.517180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.517432 (+ 252us) service_pool.cc:227] Handling call
0928 14:50:31.200146 (+2682714us) ts_tablet_manager.cc:1145] Deleting tablet cf9342e920ae48278ab3f3c6d639fc94
0928 14:50:31.200157 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.200269 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612380}
W20260928 14:50:31.201139 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 010e4f56e85a44d6a1f7524217d3cc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 010e4f56e85a44d6a1f7524217d3cc58 already in progress: creating tablet
I20260928 14:50:31.202481 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_97cf0529850e4562a081c0bffbef22af" } new_table_name: "default.Table_e01ee9de5cd04851ac4c3b43e61208c8" modify_external_catalogs: true
W20260928 14:50:31.202633 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cf9342e920ae48278ab3f3c6d639fc94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9342e920ae48278ab3f3c6d639fc94 already in progress: creating tablet
I20260928 14:50:31.202302 9851 tablet_bootstrap.cc:492] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:31.203018 9851 ts_tablet_manager.cc:1397] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.002s
I20260928 14:50:31.204110 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f
I20260928 14:50:31.204808 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8bd49281d920462e90ddcd6c29877c4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.205403 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bd49281d920462e90ddcd6c29877c4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.207084 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:31.207737 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05d04a6e96fe450993476e530099d223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.207782 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:31.208228 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f already in progress: creating tablet
I20260928 14:50:31.209025 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_df4e804ab47e43f090495eb55315ed06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.209178 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.209376 9815 tablet_replica.cc:330] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:31.209472 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df4e804ab47e43f090495eb55315ed06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.209570 9815 raft_consensus.cc:2229] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.209729 9815 raft_consensus.cc:2258] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.210114 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.210596 9815 ts_tablet_manager.cc:1905] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.212769 8953 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_25782fe77ad24ccfa43739f42a1a305c [id=c90173a37f6f4615a34f85216ec6d750] alter complete (version 4)
I20260928 14:50:31.213470 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 82a58b7387564863a2141a722003c5d1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:31.174369 10215 leader_election.cc:288] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:31.181247 9360 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.213866 9848 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:31.214044 9360 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:31.214129 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e022fb82787e46f99f941ed27d582d42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.214362 9360 leader_election.cc:302] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:31.200408 9813 ts_tablet_manager.cc:1918] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:31.214752 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e022fb82787e46f99f941ed27d582d42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.214973 9813 log.cc:1196] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/47ff819255f74f49a1ce0b5588aa03a1
I20260928 14:50:31.215935 10215 raft_consensus.cc:2726] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:31.207001 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.207247 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.207394 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 010e4f56e85a44d6a1f7524217d3cc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.219774 9815 ts_tablet_manager.cc:1918] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.220168 9815 log.cc:1196] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/63cf6b4c153f4fbdb4ffe16f5c91da7a
I20260928 14:50:31.220391 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.220541 9815 ts_tablet_manager.cc:1939] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.221688 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
I20260928 14:50:31.221975 9815 tablet_replica.cc:330] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.222026 9813 ts_tablet_manager.cc:1939] T 47ff819255f74f49a1ce0b5588aa03a1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.222157 9815 raft_consensus.cc:2229] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.222291 9815 raft_consensus.cc:2258] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.219964 9855 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.222518 9855 ts_tablet_manager.cc:1397] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260928 14:50:31.222967 9815 ts_tablet_manager.cc:1905] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.223135 9855 raft_consensus.cc:348] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.223345 9855 raft_consensus.cc:374] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.223403 9855 raft_consensus.cc:729] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.223589 9855 consensus_queue.cc:260] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.224112 9855 ts_tablet_manager.cc:1428] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:31.224311 9851 raft_consensus.cc:348] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.224560 9851 raft_consensus.cc:374] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.224640 9851 raft_consensus.cc:729] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.224979 9855 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.229782 9851 consensus_queue.cc:260] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.230367 9815 ts_tablet_manager.cc:1918] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.230510 9815 log.cc:1196] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:31.230578 9851 ts_tablet_manager.cc:1428] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260928 14:50:31.230895 9815 ts_tablet_manager.cc:1939] T afe58ef9809540cb942e3ec44296e36f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.231000 9851 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:31.232182 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet afe58ef9809540cb942e3ec44296e36f (table default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]) successfully deleted
I20260928 14:50:31.235229 9855 tablet_bootstrap.cc:654] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.236318 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 372) took 3657 ms. Trace:
I20260928 14:50:31.236773 9813 rpcz_store.cc:276] 0928 14:50:27.565126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.565602 (+ 476us) service_pool.cc:227] Handling call
0928 14:50:31.103556 (+3537954us) ts_tablet_manager.cc:1145] Deleting tablet 47ff819255f74f49a1ce0b5588aa03a1
0928 14:50:31.103566 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.197434 (+ 93868us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.200295 (+ 2861us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.222335 (+ 22040us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3535975}
I20260928 14:50:31.237458 9813 tablet_replica.cc:330] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:31.237985 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 47ff819255f74f49a1ce0b5588aa03a1 (table default.Table_973889bd0a494a95a0a088ba6e85c124 [id=16da29ef576a4730aff2c1e24942cafc]) successfully deleted
I20260928 14:50:31.240890 9813 raft_consensus.cc:2229] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.241151 9813 raft_consensus.cc:2258] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.243708 9813 ts_tablet_manager.cc:1905] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.247485 9855 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.247614 9855 ts_tablet_manager.cc:1397] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.003s
I20260928 14:50:31.248023 9814 tablet_replica.cc:330] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:31.248248 9814 raft_consensus.cc:2229] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.248863 9814 raft_consensus.cc:2258] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.249248 9332 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:31.250244 9814 ts_tablet_manager.cc:1905] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.253006 9851 tablet_bootstrap.cc:654] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.270220 10445 raft_consensus.cc:482] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.270383 10445 raft_consensus.cc:504] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.270960 10445 leader_election.cc:288] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:31.271816 9219 leader_election.cc:341] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7b47d891c9264a03ac11f50f2b56edad
I20260928 14:50:31.271940 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b47d891c9264a03ac11f50f2b56edad" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.272691 9220 leader_election.cc:302] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:31.273208 10445 raft_consensus.cc:2726] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:31.274466 9814 ts_tablet_manager.cc:1918] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.274755 9813 ts_tablet_manager.cc:1918] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:31.274926 9813 log.cc:1196] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6a50b4fe8d86464f933baec07478db25
I20260928 14:50:31.275133 9814 log.cc:1196] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:31.275364 9813 ts_tablet_manager.cc:1939] T 6a50b4fe8d86464f933baec07478db25 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.275764 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 373) took 3710 ms. Trace:
I20260928 14:50:31.275893 9813 rpcz_store.cc:276] 0928 14:50:27.565291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.565940 (+ 649us) service_pool.cc:227] Handling call
0928 14:50:31.237401 (+3671461us) ts_tablet_manager.cc:1145] Deleting tablet 6a50b4fe8d86464f933baec07478db25
0928 14:50:31.237412 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.265986 (+ 28574us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.274641 (+ 8655us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.275702 (+ 1061us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3669644}
I20260928 14:50:31.276381 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6a50b4fe8d86464f933baec07478db25 (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
I20260928 14:50:31.276563 9855 raft_consensus.cc:348] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.276777 9855 raft_consensus.cc:374] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.276834 9855 raft_consensus.cc:729] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.277017 9855 consensus_queue.cc:260] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.277864 9814 ts_tablet_manager.cc:1939] T 2f02364b809f4e1c8d558f121d4d88b9 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:31.278719 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 412) took 2698 ms. Trace:
I20260928 14:50:31.280364 9855 ts_tablet_manager.cc:1428] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260928 14:50:31.280963 9855 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.281442 8951 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 79b6ef88544840ceace2e23369dc94d7
I20260928 14:50:31.281682 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 846a96509f32416087ee4667458c367e
I20260928 14:50:31.284602 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 846a96509f32416087ee4667458c367e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.289695 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d0f78de508d94d71b22499683e9a1127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.290062 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9b2bb8161df24988895bf046bc6a1c44" } new_table_name: "default.Table_177966ee47784d7daa96d6d622777e77" modify_external_catalogs: true
W20260928 14:50:31.290354 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0f78de508d94d71b22499683e9a1127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:31.291428 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c394e5be225f41ad9ea26c87ba74400e has no consensus state
I20260928 14:50:31.291790 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a41dbf3f70674d78a5963e7f82f8680e" } new_table_name: "default.Table_33eda027747e4e11a7524698b14cd132" modify_external_catalogs: true
I20260928 14:50:31.293044 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 2f0b97883acb4adfa4091653545e894b from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:31.293152 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b08bce102125416fbcf446f12243ebe9 consensus state has no leader
W20260928 14:50:31.293704 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eff9afcc868244aeb830fae2735da28d consensus state has no leader
I20260928 14:50:31.314785 9848 tablet_bootstrap.cc:654] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.321830 9813 tablet_replica.cc:330] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:31.322319 9813 raft_consensus.cc:2229] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:31.322891 9813 pending_rounds.cc:62] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Trying to abort 1 pending ops.
I20260928 14:50:31.324626 9813 pending_rounds.cc:68] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326383586377728 op_type: NO_OP noop_request { }
I20260928 14:50:31.325469 9813 raft_consensus.cc:2866] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:31.325883 9813 raft_consensus.cc:2258] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.326567 9813 ts_tablet_manager.cc:1905] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.331262 9848 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:31.331542 9848 ts_tablet_manager.cc:1397] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.118s user 0.001s sys 0.004s
I20260928 14:50:31.334479 9848 raft_consensus.cc:348] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.338090 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 28ee844aa3c24336b4acb66dc43186e9 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:31.297655 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 846a96509f32416087ee4667458c367e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.299867 10445 raft_consensus.cc:482] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.338730 10445 raft_consensus.cc:504] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.339649 10445 leader_election.cc:288] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:31.340468 9814 rpcz_store.cc:276] 0928 14:50:28.588563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.589196 (+ 633us) service_pool.cc:227] Handling call
0928 14:50:31.231755 (+2642559us) ts_tablet_manager.cc:1145] Deleting tablet 2f02364b809f4e1c8d558f121d4d88b9
0928 14:50:31.246172 (+ 14417us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.259718 (+ 13546us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.274308 (+ 14590us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.278682 (+ 4374us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2636541}
I20260928 14:50:31.340458 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03245f72e0aa496d895968d8e5715b56" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.343323 9848 raft_consensus.cc:374] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.343386 9426 raft_consensus.cc:2454] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:31.343415 9848 raft_consensus.cc:729] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.343931 9848 consensus_queue.cc:260] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.294235 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 846a96509f32416087ee4667458c367e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.294415 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.346388 9815 tablet_replica.cc:330] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.346573 9815 raft_consensus.cc:2229] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.346714 9815 raft_consensus.cc:2258] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.295017 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.347249 9855 tablet_bootstrap.cc:654] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.347407 9815 ts_tablet_manager.cc:1905] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:31.347687 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 846a96509f32416087ee4667458c367e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846a96509f32416087ee4667458c367e already in progress: creating tablet
W20260928 14:50:31.340757 9219 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 03245f72e0aa496d895968d8e5715b56
I20260928 14:50:31.348562 9220 leader_election.cc:302] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:31.348606 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 413) took 2753 ms. Trace:
I20260928 14:50:31.348742 9814 rpcz_store.cc:276] 0928 14:50:28.595515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.595834 (+ 319us) service_pool.cc:227] Handling call
0928 14:50:31.348435 (+2752601us) ts_tablet_manager.cc:1145] Deleting tablet 8af72ac7bedb4cd7aed28cffda867c96
0928 14:50:31.348447 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.348565 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737937}
I20260928 14:50:31.349136 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 418) took 2726 ms. Trace:
I20260928 14:50:31.349241 9814 rpcz_store.cc:276] 0928 14:50:28.622457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.622549 (+ 92us) service_pool.cc:227] Handling call
0928 14:50:31.348984 (+2726435us) ts_tablet_manager.cc:1145] Deleting tablet 11f9b039838a430eac3fd422f0f4d087
0928 14:50:31.348994 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.349105 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2723210}
I20260928 14:50:31.349591 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 416) took 2731 ms. Trace:
I20260928 14:50:31.349691 9814 rpcz_store.cc:276] 0928 14:50:28.617820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.622733 (+ 4913us) service_pool.cc:227] Handling call
0928 14:50:31.349449 (+2726716us) ts_tablet_manager.cc:1145] Deleting tablet f1dacb0eef514609bcaf503ccc9845e3
0928 14:50:31.349458 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.349556 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720358}
I20260928 14:50:31.350000 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 415) took 2739 ms. Trace:
I20260928 14:50:31.305897 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.306036 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.350674 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_c90b633274d340ef940d83bcbe55c632 [id=24b463abfd834c8b9c6f579d967741b2]) successfully deleted
W20260928 14:50:31.350920 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8af72ac7bedb4cd7aed28cffda867c96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af72ac7bedb4cd7aed28cffda867c96 already in progress: creating tablet
I20260928 14:50:31.351558 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e5255bb38a7641a99bbebeb44410d860"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.351800 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 11f9b039838a430eac3fd422f0f4d087 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9b039838a430eac3fd422f0f4d087 already in progress: creating tablet
W20260928 14:50:31.352193 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f1dacb0eef514609bcaf503ccc9845e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1dacb0eef514609bcaf503ccc9845e3 already in progress: creating tablet
W20260928 14:50:31.352288 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5255bb38a7641a99bbebeb44410d860 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.357754 9815 ts_tablet_manager.cc:1918] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.357864 9815 log.cc:1196] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:31.358124 9815 ts_tablet_manager.cc:1939] T e89035a3d41a4af78a8e7afbdb89c7e0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.358949 9815 tablet_replica.cc:330] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.359090 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e89035a3d41a4af78a8e7afbdb89c7e0 (table default.Table_81ca6df5fc2849cab83083e994d3627a [id=23a200906c414328a1fdd9624c105637]) successfully deleted
I20260928 14:50:31.359114 9815 raft_consensus.cc:2229] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.359233 9815 raft_consensus.cc:2258] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.359920 9815 ts_tablet_manager.cc:1905] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.360605 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c45ecda044734949b5d172be3b0134d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.361157 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c45ecda044734949b5d172be3b0134d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.352502 10445 raft_consensus.cc:2781] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:31.365631 10445 raft_consensus.cc:482] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:31.365768 10445 raft_consensus.cc:3037] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:31.366125 9815 ts_tablet_manager.cc:1918] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.366214 9815 log.cc:1196] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d806161b858145e1a4fa946587ae1529
I20260928 14:50:31.366472 9815 ts_tablet_manager.cc:1939] T d806161b858145e1a4fa946587ae1529 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.368098 9848 ts_tablet_manager.cc:1428] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260928 14:50:31.368721 10445 raft_consensus.cc:504] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.370115 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03245f72e0aa496d895968d8e5715b56" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:31.370564 9426 raft_consensus.cc:3037] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:31.372501 10445 leader_election.cc:288] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:31.372766 9814 rpcz_store.cc:276] 0928 14:50:28.613900 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.614277 (+ 377us) service_pool.cc:227] Handling call
0928 14:50:31.349889 (+2735612us) ts_tablet_manager.cc:1145] Deleting tablet 82a58b7387564863a2141a722003c5d1
0928 14:50:31.349900 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.349972 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718697}
W20260928 14:50:31.373340 9219 leader_election.cc:341] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 03245f72e0aa496d895968d8e5715b56
I20260928 14:50:31.373445 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 417) took 2753 ms. Trace:
I20260928 14:50:31.374068 9426 raft_consensus.cc:2454] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:31.374123 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 82a58b7387564863a2141a722003c5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82a58b7387564863a2141a722003c5d1 already in progress: creating tablet
I20260928 14:50:31.374607 9220 leader_election.cc:302] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:31.375144 10445 raft_consensus.cc:2781] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:31.375425 10445 raft_consensus.cc:686] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:31.376209 10445 consensus_queue.cc:237] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.379748 9851 tablet_bootstrap.cc:492] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:31.379930 9851 ts_tablet_manager.cc:1397] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.008s
I20260928 14:50:31.380815 9851 raft_consensus.cc:348] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:31.381006 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bdcddceb8844a9f80bdd9b0761a5433 consensus state has no leader
I20260928 14:50:31.382074 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
W20260928 14:50:31.383255 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aff7eb9a7ff4ed79305806c30c30627 consensus state has no leader
I20260928 14:50:31.385448 9549 tablet_service.cc:1467] Processing CreateTablet for tablet c394e5be225f41ad9ea26c87ba74400e (DEFAULT_TABLE table=default.Table_1cce0e105c224511a8e0a5ca3eb55723 [id=b48cb97992b64de89ab4743fd03da653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.385830 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c394e5be225f41ad9ea26c87ba74400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.386888 9848 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:31.389674 9851 raft_consensus.cc:374] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.389755 9848 tablet_bootstrap.cc:654] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.389940 9851 raft_consensus.cc:729] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.390304 9851 consensus_queue.cc:260] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.390980 9541 tablet_service.cc:1467] Processing CreateTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 (DEFAULT_TABLE table=default.Table_47b65a11c8a840138ed5b134b3444f11 [id=c62b8f83f2754f4781df6a643d66cf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.391278 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf94be2def6043cb8d0d39da62dd7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.391355 9851 ts_tablet_manager.cc:1428] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260928 14:50:31.391642 9851 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:31.393443 9851 tablet_bootstrap.cc:654] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.393674 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.393993 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c394e5be225f41ad9ea26c87ba74400e (DEFAULT_TABLE table=default.Table_1cce0e105c224511a8e0a5ca3eb55723 [id=b48cb97992b64de89ab4743fd03da653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.395375 9855 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.395488 9855 ts_tablet_manager.cc:1397] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.001s
I20260928 14:50:31.396118 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 94c700979e29420080324d795dc02635 (DEFAULT_TABLE table=default.Table_39aa0016dfa8463b94c3b945befd0d45 [id=b958fd601d7642469d35f40f0602a484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.396101 9855 raft_consensus.cc:348] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.396283 9855 raft_consensus.cc:374] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.396335 9855 raft_consensus.cc:729] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.396478 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c700979e29420080324d795dc02635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.396510 9855 consensus_queue.cc:260] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.397104 9855 ts_tablet_manager.cc:1428] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:31.397326 9855 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.373621 9814 rpcz_store.cc:276] 0928 14:50:28.619869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.622771 (+ 2902us) service_pool.cc:227] Handling call
0928 14:50:31.373254 (+2750483us) ts_tablet_manager.cc:1145] Deleting tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b
0928 14:50:31.373266 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.373385 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2723371}
I20260928 14:50:31.397821 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 438) took 2487 ms. Trace:
I20260928 14:50:31.399098 9813 ts_tablet_manager.cc:1918] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:31.399217 9813 log.cc:1196] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7b47d891c9264a03ac11f50f2b56edad
I20260928 14:50:31.399592 9813 ts_tablet_manager.cc:1939] T 7b47d891c9264a03ac11f50f2b56edad P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.399667 9406 tablet_service.cc:1467] Processing CreateTablet for tablet f81dfe4d10424288b8b450c62d10a92e (DEFAULT_TABLE table=default.Table_00bd3ddea1be4fc6a7815385fa27f691 [id=aa3bc1a4fa864d0fb8b8ab71a83fe09c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.400082 9815 tablet_replica.cc:330] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.400066 9400 tablet_service.cc:1467] Processing CreateTablet for tablet f243e9fcce4d4b2396b96939250a8968 (DEFAULT_TABLE table=default.Table_2d5ce241c71f456e8f610e60eedd4b2b [id=ff65dae6e1994348a2154253946657e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.400231 9815 raft_consensus.cc:2229] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.400377 9815 raft_consensus.cc:2258] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.400434 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 2af9b5d62ff3446394272bb983025bfd (DEFAULT_TABLE table=default.Table_29cdf12bddf84c999617ee6e6162abd8 [id=2c1202d5ce734e19a648a7d5628be542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.401012 9815 ts_tablet_manager.cc:1905] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.406445 9397 tablet_service.cc:1467] Processing CreateTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 (DEFAULT_TABLE table=default.Table_47b65a11c8a840138ed5b134b3444f11 [id=c62b8f83f2754f4781df6a643d66cf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.406823 9815 ts_tablet_manager.cc:1918] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.406913 9815 log.cc:1196] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b9f843006a1e43a49f177433c7a3e1ea
I20260928 14:50:31.407205 9815 ts_tablet_manager.cc:1939] T b9f843006a1e43a49f177433c7a3e1ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.408237 9814 rpcz_store.cc:276] 0928 14:50:28.910594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.910696 (+ 102us) service_pool.cc:227] Handling call
0928 14:50:31.397691 (+2486995us) ts_tablet_manager.cc:1145] Deleting tablet 7a70f70162c2433aab5136514bd5fc03
0928 14:50:31.397701 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.397790 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480485}
I20260928 14:50:31.408556 9814 tablet_replica.cc:330] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:31.408756 9814 raft_consensus.cc:2229] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.408921 9814 raft_consensus.cc:2258] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.409474 9814 ts_tablet_manager.cc:1905] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.409772 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf94be2def6043cb8d0d39da62dd7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.410434 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c394e5be225f41ad9ea26c87ba74400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.414011 9855 tablet_bootstrap.cc:654] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.416328 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 374) took 3850 ms. Trace:
I20260928 14:50:31.416437 9813 rpcz_store.cc:276] 0928 14:50:27.565412 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.566226 (+ 814us) service_pool.cc:227] Handling call
0928 14:50:31.321741 (+3755515us) ts_tablet_manager.cc:1145] Deleting tablet 7b47d891c9264a03ac11f50f2b56edad
0928 14:50:31.321753 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.370113 (+ 48360us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.398993 (+ 28880us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.416263 (+ 17270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4864,"tablet-delete.queue_time_us":3749375}
I20260928 14:50:31.416610 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243e9fcce4d4b2396b96939250a8968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.416815 9813 tablet_replica.cc:330] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:31.416996 9813 raft_consensus.cc:2229] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.417387 9813 raft_consensus.cc:2258] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.418118 9813 ts_tablet_manager.cc:1905] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:31.421949 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b already in progress: creating tablet
W20260928 14:50:31.422221 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7a70f70162c2433aab5136514bd5fc03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a70f70162c2433aab5136514bd5fc03 already in progress: creating tablet
I20260928 14:50:31.422379 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d806161b858145e1a4fa946587ae1529 (table default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]) successfully deleted
I20260928 14:50:31.422542 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b9f843006a1e43a49f177433c7a3e1ea (table default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]) successfully deleted
I20260928 14:50:31.422760 9815 tablet_replica.cc:330] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.422925 9815 raft_consensus.cc:2229] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.423264 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d2dee96e84524856a0cb33b444f35309" } modify_external_catalogs: true
I20260928 14:50:31.423484 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d2dee96e84524856a0cb33b444f35309" } modify_external_catalogs: true
I20260928 14:50:31.424520 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 94c700979e29420080324d795dc02635 (DEFAULT_TABLE table=default.Table_39aa0016dfa8463b94c3b945befd0d45 [id=b958fd601d7642469d35f40f0602a484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.424854 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c700979e29420080324d795dc02635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.424959 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aa976d19165445859cf0a1d3b9c21d13" } modify_external_catalogs: true
I20260928 14:50:31.425127 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aa976d19165445859cf0a1d3b9c21d13" } modify_external_catalogs: true
I20260928 14:50:31.426420 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d556e749706d41b8a3fc1d2be554d938"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.426930 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d556e749706d41b8a3fc1d2be554d938 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.428269 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_052d438b7adf4ffdb7edf480ce30195f" } modify_external_catalogs: true
I20260928 14:50:31.428457 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_052d438b7adf4ffdb7edf480ce30195f" } modify_external_catalogs: true
I20260928 14:50:31.429816 9535 tablet_service.cc:1467] Processing CreateTablet for tablet f81dfe4d10424288b8b450c62d10a92e (DEFAULT_TABLE table=default.Table_00bd3ddea1be4fc6a7815385fa27f691 [id=aa3bc1a4fa864d0fb8b8ab71a83fe09c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.430166 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81dfe4d10424288b8b450c62d10a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.431021 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4ea3bb5f742c46d796696c0131b97e68
I20260928 14:50:31.432978 9542 tablet_service.cc:1467] Processing CreateTablet for tablet f243e9fcce4d4b2396b96939250a8968 (DEFAULT_TABLE table=default.Table_2d5ce241c71f456e8f610e60eedd4b2b [id=ff65dae6e1994348a2154253946657e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.433197 9815 raft_consensus.cc:2258] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.433286 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243e9fcce4d4b2396b96939250a8968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.434139 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 69239e1cc64f40e59f14c3716437de54
I20260928 14:50:31.437288 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 2af9b5d62ff3446394272bb983025bfd (DEFAULT_TABLE table=default.Table_29cdf12bddf84c999617ee6e6162abd8 [id=2c1202d5ce734e19a648a7d5628be542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.437975 9815 ts_tablet_manager.cc:1905] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.438593 8955 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8d6dd2c0b6f040e281514a70b91a5be0
W20260928 14:50:31.444877 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3bdcddceb8844a9f80bdd9b0761a5433 (table default.Table_177966ee47784d7daa96d6d622777e77 [id=622debe3283c4c1ab262274078f48100], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3bdcddceb8844a9f80bdd9b0761a5433 consensus state has no leader
I20260928 14:50:31.445863 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 (DEFAULT_TABLE table=default.Table_d2dee96e84524856a0cb33b444f35309 [id=6b5d03c5e23743e880d5db2df1e47ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.446822 9538 tablet_service.cc:1467] Processing CreateTablet for tablet ad549aa4257d497ab7f03b3cdd734968 (DEFAULT_TABLE table=default.Table_885f9ac0ea4c4c918834dd9e3fa63889 [id=7c0282899a97408db45b3d404796a971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.446429 9543 tablet_service.cc:1467] Processing CreateTablet for tablet b4bd833175cf469b96cf0eadf2939772 (DEFAULT_TABLE table=default.Table_df41708f804a43f985a3b1e87e220d87 [id=62cdbd5b7c904508a2634611373afba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.447465 9529 tablet_service.cc:1467] Processing CreateTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 (DEFAULT_TABLE table=default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6 [id=a5ae04f9fbce45dc9e33fe9e74480e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.448284 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af9b5d62ff3446394272bb983025bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.448299 9815 ts_tablet_manager.cc:1918] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.448396 9815 log.cc:1196] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f1dacb0eef514609bcaf503ccc9845e3
I20260928 14:50:31.448654 9815 ts_tablet_manager.cc:1939] T f1dacb0eef514609bcaf503ccc9845e3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.449693 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad549aa4257d497ab7f03b3cdd734968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.453675 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea3bb5f742c46d796696c0131b97e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.454252 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bd833175cf469b96cf0eadf2939772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.454600 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e53683279a0c4b41b9ea94e88a84cb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.465322 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7b47d891c9264a03ac11f50f2b56edad (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
I20260928 14:50:31.466161 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6795a92d851b46ac8d69afae687ac7da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.466683 9855 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.466799 9855 ts_tablet_manager.cc:1397] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
W20260928 14:50:31.466888 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6795a92d851b46ac8d69afae687ac7da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.467491 9855 raft_consensus.cc:348] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.467674 9855 raft_consensus.cc:374] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.467724 9855 raft_consensus.cc:729] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.467901 9855 consensus_queue.cc:260] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.468540 9855 ts_tablet_manager.cc:1428] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:31.469309 9855 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.478530 9855 tablet_bootstrap.cc:654] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.499089 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d" } modify_external_catalogs: true
I20260928 14:50:31.499369 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d" } modify_external_catalogs: true
I20260928 14:50:31.499953 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5325bfedb92641f799564a45fa0f40b6" } modify_external_catalogs: true
I20260928 14:50:31.501211 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5325bfedb92641f799564a45fa0f40b6" } modify_external_catalogs: true
I20260928 14:50:31.502043 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d267fa0a698437986feb52cd9c15cc1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:31.513365 10215 raft_consensus.cc:482] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 658e483a10314e8d93c2f6e9084f2a91)
I20260928 14:50:31.513592 10368 raft_consensus.cc:482] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.515491 9395 tablet_service.cc:1467] Processing CreateTablet for tablet b4bd833175cf469b96cf0eadf2939772 (DEFAULT_TABLE table=default.Table_df41708f804a43f985a3b1e87e220d87 [id=62cdbd5b7c904508a2634611373afba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.515753 9397 tablet_service.cc:1467] Processing CreateTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 (DEFAULT_TABLE table=default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6 [id=a5ae04f9fbce45dc9e33fe9e74480e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.521266 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81dfe4d10424288b8b450c62d10a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.522832 10215 raft_consensus.cc:504] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.523744 10484 raft_consensus.cc:482] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.499096 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f1dacb0eef514609bcaf503ccc9845e3 (table default.Table_495e7c03dc714f76ae556f136f2a4006 [id=406fbbcbe232457bbe03bfe66ec127f3]) successfully deleted
I20260928 14:50:31.523897 10484 raft_consensus.cc:504] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.524525 10484 leader_election.cc:288] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.526274 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9ba2afa5ed7b4c7ea59ef904512529e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.526713 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a6f653e4c8794146a3808ff8a255002d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.526794 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c3e5e40b33e0458082d8807a381f205a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.527575 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3e5e40b33e0458082d8807a381f205a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:31.527547 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f653e4c8794146a3808ff8a255002d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.528578 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b68f85996c674639a073b012b3e7668c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.529176 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b68f85996c674639a073b012b3e7668c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:31.527253 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ba2afa5ed7b4c7ea59ef904512529e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.532415 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_52f4944fc5ff419f9d917d898fd3ab51" } new_table_name: "default.Table_f1801703d3bc431788b7d33125736e7b" modify_external_catalogs: true
I20260928 14:50:31.532662 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c45ecda044734949b5d172be3b0134d7" } new_table_name: "default.Table_1d7f35af447d4b17a752c1d9b1f2b218" modify_external_catalogs: true
I20260928 14:50:31.533669 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_521fbf9f0ee74666a0707792d5a7d9e9" } new_table_name: "default.Table_a380394f52e94a7bab93d509467e5376" modify_external_catalogs: true
I20260928 14:50:31.536643 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e53683279a0c4b41b9ea94e88a84cb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.522650 10368 raft_consensus.cc:504] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.540120 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 (DEFAULT_TABLE table=default.Table_d2dee96e84524856a0cb33b444f35309 [id=6b5d03c5e23743e880d5db2df1e47ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.547856 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4001db9bc2b946be85c0c1767b203039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.548418 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4001db9bc2b946be85c0c1767b203039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.548986 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet ee16f4482a424538812f6356655acf77 with delete_type TABLET_DATA_DELETED (replaced by tablet 5f348f9e962748a0992d85b9d3d72aeb) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.550033 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6b0867466459ca14413559800ff64" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.550452 10368 leader_election.cc:288] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:31.550693 10215 leader_election.cc:288] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:31.551363 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bd833175cf469b96cf0eadf2939772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.553295 9266 tablet_service.cc:1467] Processing CreateTablet for tablet b4bd833175cf469b96cf0eadf2939772 (DEFAULT_TABLE table=default.Table_df41708f804a43f985a3b1e87e220d87 [id=62cdbd5b7c904508a2634611373afba1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.555037 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce402f07c965421dae73355892c328b3 has no consensus state
W20260928 14:50:31.555878 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bef0b52d178f4baeae621da769f6d518 consensus state has no leader
I20260928 14:50:31.556228 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 69239e1cc64f40e59f14c3716437de54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.556385 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:31.556674 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 (DEFAULT_TABLE table=default.Table_d2dee96e84524856a0cb33b444f35309 [id=6b5d03c5e23743e880d5db2df1e47ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.557674 9263 tablet_service.cc:1467] Processing CreateTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 (DEFAULT_TABLE table=default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6 [id=a5ae04f9fbce45dc9e33fe9e74480e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.558164 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e53683279a0c4b41b9ea94e88a84cb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.558991 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311e4286b2a943ee924ac1c25dc9ca46" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:31.559321 9253 tablet_service.cc:1467] Processing CreateTablet for tablet f81dfe4d10424288b8b450c62d10a92e (DEFAULT_TABLE table=default.Table_00bd3ddea1be4fc6a7815385fa27f691 [id=aa3bc1a4fa864d0fb8b8ab71a83fe09c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.560657 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 consensus state has no leader
I20260928 14:50:31.561300 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81dfe4d10424288b8b450c62d10a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.562040 9247 tablet_service.cc:1467] Processing CreateTablet for tablet a56b4c06e18e4d13adc5c1cfed6c2007 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.562599 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcb4029485e4f3eb57f9f4d28b68566 (DEFAULT_TABLE table=default.Table_ff761d86b200413d8b8152e64d348f9c [id=f505cc875277477486a0b4ed8950c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.563062 9257 tablet_service.cc:1467] Processing CreateTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 (DEFAULT_TABLE table=default.Table_47b65a11c8a840138ed5b134b3444f11 [id=c62b8f83f2754f4781df6a643d66cf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.561939 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 94c700979e29420080324d795dc02635 (DEFAULT_TABLE table=default.Table_39aa0016dfa8463b94c3b945befd0d45 [id=b958fd601d7642469d35f40f0602a484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.563828 9248 tablet_service.cc:1467] Processing CreateTablet for tablet f243e9fcce4d4b2396b96939250a8968 (DEFAULT_TABLE table=default.Table_2d5ce241c71f456e8f610e60eedd4b2b [id=ff65dae6e1994348a2154253946657e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.563200 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 2af9b5d62ff3446394272bb983025bfd (DEFAULT_TABLE table=default.Table_29cdf12bddf84c999617ee6e6162abd8 [id=2c1202d5ce734e19a648a7d5628be542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.553836 9254 tablet_service.cc:1467] Processing CreateTablet for tablet c394e5be225f41ad9ea26c87ba74400e (DEFAULT_TABLE table=default.Table_1cce0e105c224511a8e0a5ca3eb55723 [id=b48cb97992b64de89ab4743fd03da653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.565912 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a56b4c06e18e4d13adc5c1cfed6c2007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.567179 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf94be2def6043cb8d0d39da62dd7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.568567 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcb4029485e4f3eb57f9f4d28b68566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.569962 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea3bb5f742c46d796696c0131b97e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.570909 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243e9fcce4d4b2396b96939250a8968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.572136 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af9b5d62ff3446394272bb983025bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.573115 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c700979e29420080324d795dc02635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.573719 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c394e5be225f41ad9ea26c87ba74400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.574275 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4bd833175cf469b96cf0eadf2939772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.590714 9855 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:31.590863 9498 leader_election.cc:341] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.591151 9855 ts_tablet_manager.cc:1397] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.122s user 0.026s sys 0.028s
I20260928 14:50:31.592031 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.593652 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6b0867466459ca14413559800ff64" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:31.594197 9855 raft_consensus.cc:348] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.594713 9855 raft_consensus.cc:374] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.594907 9855 raft_consensus.cc:729] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.594959 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcb4029485e4f3eb57f9f4d28b68566 (DEFAULT_TABLE table=default.Table_ff761d86b200413d8b8152e64d348f9c [id=f505cc875277477486a0b4ed8950c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.595322 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcb4029485e4f3eb57f9f4d28b68566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.595342 9855 consensus_queue.cc:260] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.596830 9855 ts_tablet_manager.cc:1428] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:31.597455 9855 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:31.599079 9497 leader_election.cc:341] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.599189 9497 leader_election.cc:302] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:31.599560 10484 raft_consensus.cc:2726] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:31.600564 9543 tablet_service.cc:1467] Processing CreateTablet for tablet a56b4c06e18e4d13adc5c1cfed6c2007 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.600956 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a56b4c06e18e4d13adc5c1cfed6c2007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.601647 9855 tablet_bootstrap.cc:654] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.602504 10484 raft_consensus.cc:482] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.602680 10484 raft_consensus.cc:504] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.603472 10484 leader_election.cc:288] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.604470 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:31.605048 9497 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.605309 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 69239e1cc64f40e59f14c3716437de54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.617089 9855 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.617375 9855 ts_tablet_manager.cc:1397] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.010s
I20260928 14:50:31.619154 9855 raft_consensus.cc:348] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.619803 9855 raft_consensus.cc:374] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.619949 9855 raft_consensus.cc:729] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.620460 9855 consensus_queue.cc:260] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.622079 9855 ts_tablet_manager.cc:1428] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260928 14:50:31.622745 9855 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.626936 9855 tablet_bootstrap.cc:654] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.635327 9614 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:31.629508 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap replayed 1/1 log segments. Stats: ops{read=355 overwritten=6 applied=349 ignored=0} inserts{seen=317 ignored=0} mutations{seen=384 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 14:50:31.636384 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: Bootstrap complete.
I20260928 14:50:31.640640 9855 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.640919 9855 ts_tablet_manager.cc:1397] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.009s
I20260928 14:50:31.642587 9855 raft_consensus.cc:348] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.643070 9855 raft_consensus.cc:374] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.643260 9855 raft_consensus.cc:729] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.643695 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea3bb5f742c46d796696c0131b97e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.643700 9855 consensus_queue.cc:260] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:31.644601 9360 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.645068 9855 ts_tablet_manager.cc:1428] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:31.645805 9855 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.648078 9855 tablet_bootstrap.cc:654] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.648818 9388 tablet_service.cc:1467] Processing CreateTablet for tablet a56b4c06e18e4d13adc5c1cfed6c2007 (DEFAULT_TABLE table=default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.649295 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.649194 10477 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:31.650441 10477 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b99976d8024a79a0603523b9d32f29, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.649303 9390 tablet_service.cc:1467] Processing CreateTablet for tablet ad549aa4257d497ab7f03b3cdd734968 (DEFAULT_TABLE table=default.Table_885f9ac0ea4c4c918834dd9e3fa63889 [id=7c0282899a97408db45b3d404796a971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.651291 10477 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 349, Last appended: 4.349, Last appended by leader: 349, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
W20260928 14:50:31.651458 9498 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.651561 9498 leader_election.cc:302] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:31.652055 10484 raft_consensus.cc:2726] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:31.655345 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 84610.3us
W20260928 14:50:31.655598 9360 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:31.655726 10215 raft_consensus.cc:482] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.657220 9360 leader_election.cc:302] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:31.659695 9855 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.659821 10368 raft_consensus.cc:2726] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:31.659883 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 69239e1cc64f40e59f14c3716437de54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.659874 10215 raft_consensus.cc:504] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.660267 9855 ts_tablet_manager.cc:1397] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.007s
I20260928 14:50:31.661474 9855 raft_consensus.cc:348] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.661880 9855 raft_consensus.cc:374] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.662427 9855 raft_consensus.cc:729] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.662763 9855 consensus_queue.cc:260] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.663681 9855 ts_tablet_manager.cc:1428] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:31.664141 9855 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:31.665656 9360 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:31.666777 9855 tablet_bootstrap.cc:654] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.666719 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.667395 9815 tablet_replica.cc:330] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.667778 9815 raft_consensus.cc:2229] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.668112 9815 raft_consensus.cc:2258] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.668991 9815 ts_tablet_manager.cc:1905] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.676054 9815 ts_tablet_manager.cc:1918] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.676363 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 835ba6c803a34707b77bb8bc280b9e68
I20260928 14:50:31.677392 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f39c1da071164342aea8eab263d4eebb
I20260928 14:50:31.677624 9855 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.677506 9815 log.cc:1196] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c5c6b0867466459ca14413559800ff64
I20260928 14:50:31.677861 9855 ts_tablet_manager.cc:1397] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
I20260928 14:50:31.679071 9855 raft_consensus.cc:348] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.679419 9855 raft_consensus.cc:374] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.679615 10477 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 14:50:31.680460 9815 ts_tablet_manager.cc:1939] T c5c6b0867466459ca14413559800ff64 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.675782 10521 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:31.681702 10521 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:31.681756 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7d267fa0a698437986feb52cd9c15cc1
I20260928 14:50:31.683205 8956 catalog_manager.cc:6565] ReplaceTablet: tablet 7d267fa0a698437986feb52cd9c15cc1 deleted and replaced by tablet 2949cff5a7694015ad1708ed7fab3447
I20260928 14:50:31.687326 9855 raft_consensus.cc:729] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.687647 9855 consensus_queue.cc:260] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.688189 9855 ts_tablet_manager.cc:1428] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260928 14:50:31.691717 9855 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.694011 9855 tablet_bootstrap.cc:654] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.700691 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea3bb5f742c46d796696c0131b97e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.701349 9855 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.701591 9855 ts_tablet_manager.cc:1397] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260928 14:50:31.702521 9855 raft_consensus.cc:348] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.702716 9855 raft_consensus.cc:374] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.702803 9855 raft_consensus.cc:729] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.703006 9855 consensus_queue.cc:260] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.703531 9855 ts_tablet_manager.cc:1428] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:31.703789 9855 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.704409 10215 leader_election.cc:288] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:31.704507 9360 leader_election.cc:341] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:31.704727 9360 leader_election.cc:302] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:31.705180 9855 tablet_bootstrap.cc:654] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.705605 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:31.706151 9567 raft_consensus.cc:2454] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:31.706349 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:31.707283 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af9b5d62ff3446394272bb983025bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.708190 9813 ts_tablet_manager.cc:1918] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:31.708524 9813 log.cc:1196] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/595dccb9d03b4dd48698262aad630ac2
I20260928 14:50:31.710748 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.710714 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad549aa4257d497ab7f03b3cdd734968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.711302 10215 raft_consensus.cc:2726] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 14:50:31.711826 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a56b4c06e18e4d13adc5c1cfed6c2007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.710708 9360 leader_election.cc:302] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:31.713711 9813 ts_tablet_manager.cc:1939] T 595dccb9d03b4dd48698262aad630ac2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.715643 10215 raft_consensus.cc:2781] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:31.717869 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ad549aa4257d497ab7f03b3cdd734968 (DEFAULT_TABLE table=default.Table_885f9ac0ea4c4c918834dd9e3fa63889 [id=7c0282899a97408db45b3d404796a971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.718487 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad549aa4257d497ab7f03b3cdd734968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.724411 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 (DEFAULT_TABLE table=default.Table_e5255bb38a7641a99bbebeb44410d860 [id=2caeb3c75f56478a83e29d2d1fe7804a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.725020 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05342bec2afe44d3a6e21e19a16091a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.725847 9541 tablet_service.cc:1467] Processing CreateTablet for tablet ce402f07c965421dae73355892c328b3 (DEFAULT_TABLE table=default.Table_1d7f35af447d4b17a752c1d9b1f2b218 [id=879808f9b53640279d21be09a2e741ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.726264 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce402f07c965421dae73355892c328b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.733796 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1a29ecab514307b2ba7e832b3a2e02 (DEFAULT_TABLE table=default.Table_d556e749706d41b8a3fc1d2be554d938 [id=b9163baaf9764f7d945df9728ac4cb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.734244 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1a29ecab514307b2ba7e832b3a2e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.737088 9855 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.737249 9855 ts_tablet_manager.cc:1397] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.000s
I20260928 14:50:31.737349 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a06859c8dcc41d99d29365aae350afa from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:31.737982 9855 raft_consensus.cc:348] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.738209 9855 raft_consensus.cc:374] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.738283 9855 raft_consensus.cc:729] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.738503 9855 consensus_queue.cc:260] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.739018 9855 ts_tablet_manager.cc:1428] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:31.739348 9855 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.740935 9855 tablet_bootstrap.cc:654] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.741793 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1a29ecab514307b2ba7e832b3a2e02 (DEFAULT_TABLE table=default.Table_d556e749706d41b8a3fc1d2be554d938 [id=b9163baaf9764f7d945df9728ac4cb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.742192 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1a29ecab514307b2ba7e832b3a2e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.745442 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8a06859c8dcc41d99d29365aae350afa
I20260928 14:50:31.746126 8956 catalog_manager.cc:6565] ReplaceTablet: tablet 8a06859c8dcc41d99d29365aae350afa deleted and replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80
I20260928 14:50:31.753894 9855 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.754037 9855 ts_tablet_manager.cc:1397] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260928 14:50:31.754706 9259 tablet_service.cc:1467] Processing CreateTablet for tablet ce402f07c965421dae73355892c328b3 (DEFAULT_TABLE table=default.Table_1d7f35af447d4b17a752c1d9b1f2b218 [id=879808f9b53640279d21be09a2e741ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.754807 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 206b8b256a484760b4e8d97e5ef12ce9 (DEFAULT_TABLE table=default.Table_05d04a6e96fe450993476e530099d223 [id=03ff41d5d6c549518261f5af338676ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.755079 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce402f07c965421dae73355892c328b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.755129 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206b8b256a484760b4e8d97e5ef12ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.755012 9855 raft_consensus.cc:348] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.755236 9855 raft_consensus.cc:374] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.755333 9855 raft_consensus.cc:729] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.755541 9855 consensus_queue.cc:260] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.756054 9855 ts_tablet_manager.cc:1428] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:31.756321 9855 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.758298 9855 tablet_bootstrap.cc:654] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.761981 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 9e72d815a218451b884604a1f334d632 (DEFAULT_TABLE table=default.Table_766e2c205c494d5695c1c6bd3e8a0dad [id=afe8dd226bc74db39ce992a9a0dc6793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.762400 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e72d815a218451b884604a1f334d632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.767095 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 206b8b256a484760b4e8d97e5ef12ce9 (DEFAULT_TABLE table=default.Table_05d04a6e96fe450993476e530099d223 [id=03ff41d5d6c549518261f5af338676ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.762876 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 (DEFAULT_TABLE table=default.Table_e5255bb38a7641a99bbebeb44410d860 [id=2caeb3c75f56478a83e29d2d1fe7804a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.769379 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 96e5111ae94740feb9dd57c7f4f12b2c (DEFAULT_TABLE table=default.Table_fb3a35c7785c4d9688f871b588345ff6 [id=ffd31c3840404c75a7b7278e6ed3847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.769922 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e5111ae94740feb9dd57c7f4f12b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.773401 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206b8b256a484760b4e8d97e5ef12ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.775198 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 (DEFAULT_TABLE table=default.Table_df4e804ab47e43f090495eb55315ed06 [id=4ecd70c1ffd54dabb6850217d8a64717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.775566 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2ab53321d74f28aa5453729e12f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.777662 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05342bec2afe44d3a6e21e19a16091a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.781821 9534 tablet_service.cc:1467] Processing CreateTablet for tablet c11ca733238948d0b24cd37df99f1d6e (DEFAULT_TABLE table=default.Table_d0f78de508d94d71b22499683e9a1127 [id=df093614ba404d73a8d59df733f737a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.782234 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11ca733238948d0b24cd37df99f1d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.784349 10215 raft_consensus.cc:482] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:31.784566 9360 leader_election.cc:341] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.785625 10215 raft_consensus.cc:3037] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:31.784409 9408 tablet_service.cc:1467] Processing CreateTablet for tablet ce402f07c965421dae73355892c328b3 (DEFAULT_TABLE table=default.Table_1d7f35af447d4b17a752c1d9b1f2b218 [id=879808f9b53640279d21be09a2e741ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.785089 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 0dcb4029485e4f3eb57f9f4d28b68566 (DEFAULT_TABLE table=default.Table_ff761d86b200413d8b8152e64d348f9c [id=f505cc875277477486a0b4ed8950c1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.791419 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 371) took 4220 ms. Trace:
I20260928 14:50:31.793865 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 (DEFAULT_TABLE table=default.Table_e5255bb38a7641a99bbebeb44410d860 [id=2caeb3c75f56478a83e29d2d1fe7804a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.795245 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 72389.6us
I20260928 14:50:31.799818 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1a29ecab514307b2ba7e832b3a2e02 (DEFAULT_TABLE table=default.Table_d556e749706d41b8a3fc1d2be554d938 [id=b9163baaf9764f7d945df9728ac4cb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.800412 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 96e5111ae94740feb9dd57c7f4f12b2c (DEFAULT_TABLE table=default.Table_fb3a35c7785c4d9688f871b588345ff6 [id=ffd31c3840404c75a7b7278e6ed3847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.801869 10484 raft_consensus.cc:482] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.802158 9394 tablet_service.cc:1467] Processing CreateTablet for tablet c11ca733238948d0b24cd37df99f1d6e (DEFAULT_TABLE table=default.Table_d0f78de508d94d71b22499683e9a1127 [id=df093614ba404d73a8d59df733f737a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.802062 10484 raft_consensus.cc:504] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.802697 10484 leader_election.cc:288] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.801401 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 206b8b256a484760b4e8d97e5ef12ce9 (DEFAULT_TABLE table=default.Table_05d04a6e96fe450993476e530099d223 [id=03ff41d5d6c549518261f5af338676ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.803407 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 9e72d815a218451b884604a1f334d632 (DEFAULT_TABLE table=default.Table_766e2c205c494d5695c1c6bd3e8a0dad [id=afe8dd226bc74db39ce992a9a0dc6793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.804206 9537 tablet_service.cc:1467] Processing CreateTablet for tablet bb09b496476948e2a4f3652c75800e36 (DEFAULT_TABLE table=default.Table_e022fb82787e46f99f941ed27d582d42 [id=9997a2bcf9274d2195fcd251140420c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.804538 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb09b496476948e2a4f3652c75800e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.807679 9813 rpcz_store.cc:276] 0928 14:50:27.564964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.565462 (+ 498us) service_pool.cc:227] Handling call
0928 14:50:31.416739 (+3851277us) ts_tablet_manager.cc:1145] Deleting tablet 595dccb9d03b4dd48698262aad630ac2
0928 14:50:31.416749 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.551151 (+134402us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.686610 (+135459us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.784924 (+ 98314us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3844327}
I20260928 14:50:31.808003 9813 tablet_replica.cc:330] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:31.809995 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.810463 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet f39c1da071164342aea8eab263d4eebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.811187 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:31.812353 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4ea3bb5f742c46d796696c0131b97e68 because the tablet was not found. No further retry: Not found: Tablet not found: 4ea3bb5f742c46d796696c0131b97e68
I20260928 14:50:31.816764 10368 raft_consensus.cc:482] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:31.833853 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 69239e1cc64f40e59f14c3716437de54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69239e1cc64f40e59f14c3716437de54 already in progress: creating tablet
I20260928 14:50:31.834649 10215 raft_consensus.cc:504] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.834810 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c5c6b0867466459ca14413559800ff64 (table default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]) successfully deleted
W20260928 14:50:31.835218 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 835ba6c803a34707b77bb8bc280b9e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 835ba6c803a34707b77bb8bc280b9e68 already in progress: creating tablet
I20260928 14:50:31.835830 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:31.836176 9567 raft_consensus.cc:3037] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:31.838621 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet f39c1da071164342aea8eab263d4eebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.838868 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 24c45934c64642c2b171cb42544728bc (DEFAULT_TABLE table=default.Table_8bd49281d920462e90ddcd6c29877c4b [id=4a249bb006fb442da5b97463fa973855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.839435 9813 raft_consensus.cc:2229] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.841614 10484 raft_consensus.cc:482] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.841723 10484 raft_consensus.cc:504] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.842262 10484 leader_election.cc:288] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:31.845737 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f39c1da071164342aea8eab263d4eebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f39c1da071164342aea8eab263d4eebb already in progress: creating tablet
W20260928 14:50:31.846068 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7d267fa0a698437986feb52cd9c15cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d267fa0a698437986feb52cd9c15cc1 already in progress: creating tablet
I20260928 14:50:31.853757 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19995a0d8af4d3ca562bade80ce006f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.854187 9813 raft_consensus.cc:2258] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:31.854246 9498 leader_election.cc:341] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.854570 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.856024 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eefaf5e8e5f54ea080ce3f5e7ac7ec8b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.856354 9404 tablet_service.cc:1467] Processing CreateTablet for tablet bb09b496476948e2a4f3652c75800e36 (DEFAULT_TABLE table=default.Table_e022fb82787e46f99f941ed27d582d42 [id=9997a2bcf9274d2195fcd251140420c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:31.856485 9498 leader_election.cc:341] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.857074 10368 raft_consensus.cc:504] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.857651 10368 leader_election.cc:288] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:31.860713 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:31.860890 9568 raft_consensus.cc:2454] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:31.862674 10215 leader_election.cc:288] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:31.860647 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 (DEFAULT_TABLE table=default.Table_df4e804ab47e43f090495eb55315ed06 [id=4ecd70c1ffd54dabb6850217d8a64717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.862812 9360 leader_election.cc:302] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:31.870669 10215 raft_consensus.cc:2781] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:31.870975 10215 raft_consensus.cc:482] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:31.873114 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fef73768d74d4e4e88501663bd431a4e" } new_table_name: "default.Table_2378f0131076405ab6f9ad2247f22c2b" modify_external_catalogs: true
I20260928 14:50:31.873284 9855 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:31.873425 9855 ts_tablet_manager.cc:1397] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.117s user 0.020s sys 0.030s
I20260928 14:50:31.874181 9855 raft_consensus.cc:348] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.874400 9855 raft_consensus.cc:374] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.874452 9855 raft_consensus.cc:729] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.874631 9855 consensus_queue.cc:260] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.875141 9855 ts_tablet_manager.cc:1428] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:31.877578 9855 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:31.878962 9855 tablet_bootstrap.cc:654] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:31.879733 10484 raft_consensus.cc:482] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.879849 10484 raft_consensus.cc:504] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.880374 10484 leader_election.cc:288] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.881055 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:31.881686 9498 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:31.882242 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30d197a8ba8848d98ba0f03b2e83d3f6 consensus state has no leader
I20260928 14:50:31.887940 9473 heartbeater.cc:347] Connected to a master server at 127.8.181.60:39777
I20260928 14:50:31.889750 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_25782fe77ad24ccfa43739f42a1a305c" } new_table_name: "default.Table_a235a0c6603143439c7a545281e9754a" modify_external_catalogs: true
I20260928 14:50:31.893857 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7dbee54af11845d4b4ecf8bd3fe1e953"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.894474 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dbee54af11845d4b4ecf8bd3fe1e953 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.894934 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7d04d70ad3e447aba07ae7ac26a0204b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.895488 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d04d70ad3e447aba07ae7ac26a0204b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.898806 10215 raft_consensus.cc:3037] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:31.906759 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5d0fbca4e50f401d8c88395a7002e74d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.907305 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d0fbca4e50f401d8c88395a7002e74d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.912442 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.912657 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06859c8dcc41d99d29365aae350afa with delete_type TABLET_DATA_DELETED (replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.912798 9813 ts_tablet_manager.cc:1905] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.918586 9848 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:31.918520 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b3fa664a13f240a8ab876df02ff31cd3" } modify_external_catalogs: true
I20260928 14:50:31.918740 9848 ts_tablet_manager.cc:1397] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.547s user 0.111s sys 0.086s
I20260928 14:50:31.918716 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b3fa664a13f240a8ab876df02ff31cd3" } modify_external_catalogs: true
I20260928 14:50:31.918766 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7b0fb0bac48645b68ed77a4a2605c08b" } modify_external_catalogs: true
I20260928 14:50:31.918996 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7b0fb0bac48645b68ed77a4a2605c08b" } modify_external_catalogs: true
I20260928 14:50:31.919569 9848 raft_consensus.cc:348] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:31.919767 9848 raft_consensus.cc:374] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:31.919863 9848 raft_consensus.cc:729] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:31.920116 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c9b71ef1edaf42c2853cb149e0d5e469"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.920631 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9b71ef1edaf42c2853cb149e0d5e469 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.924623 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1eaafbd52e464862ae0f0d44ffae58cf
I20260928 14:50:31.926488 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.928690 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dcb4029485e4f3eb57f9f4d28b68566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.931982 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92d3b119492d4f65aa2b228040ac958f" } modify_external_catalogs: true
I20260928 14:50:31.932184 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92d3b119492d4f65aa2b228040ac958f" } modify_external_catalogs: true
I20260928 14:50:31.933248 10484 raft_consensus.cc:482] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.933390 10484 raft_consensus.cc:504] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:31.933774 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c45934c64642c2b171cb42544728bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.934003 10484 leader_election.cc:288] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.934442 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16a0f674114ac8b4520fbce2d383d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:31.934686 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.934922 9498 leader_election.cc:341] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:31.935222 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.935303 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e72d815a218451b884604a1f334d632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.935676 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce402f07c965421dae73355892c328b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.936094 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb09b496476948e2a4f3652c75800e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.936471 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11ca733238948d0b24cd37df99f1d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.936853 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2ab53321d74f28aa5453729e12f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.937225 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206b8b256a484760b4e8d97e5ef12ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.937628 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e5111ae94740feb9dd57c7f4f12b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.937994 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1a29ecab514307b2ba7e832b3a2e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.938369 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05342bec2afe44d3a6e21e19a16091a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.945513 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 504c0f61d8844bd18062a3b40cd6f8ce
I20260928 14:50:31.948626 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:31.949388 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d89af305177149bcb01720f55a1c349b" } new_table_name: "default.Table_505b9299e8c0438187bc0f61239bfae2" modify_external_catalogs: true
I20260928 14:50:31.954552 9813 ts_tablet_manager.cc:1918] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.954703 9813 log.cc:1196] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d004e52539cc49bc8a26f77e0bb182cc
W20260928 14:50:31.954895 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09f92d1f0e69409a8ef355d550cfb52c consensus state has no leader
I20260928 14:50:31.955111 9813 ts_tablet_manager.cc:1939] T d004e52539cc49bc8a26f77e0bb182cc P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:31.955426 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 375) took 4359 ms. Trace:
I20260928 14:50:31.955526 9813 rpcz_store.cc:276] 0928 14:50:27.595920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.595969 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:31.807953 (+4211984us) ts_tablet_manager.cc:1145] Deleting tablet d004e52539cc49bc8a26f77e0bb182cc
0928 14:50:31.807962 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:31.933260 (+125298us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.954446 (+ 21186us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:31.955380 (+ 934us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4211783}
I20260928 14:50:31.957067 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1f27f67005ab45f8a688c438160b9119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.957674 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f27f67005ab45f8a688c438160b9119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.960479 10484 raft_consensus.cc:482] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:31.960639 10484 raft_consensus.cc:504] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:31.961189 10484 leader_election.cc:288] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:31.961931 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc978ea3a194282aacc6ede22076c21" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:31.962435 9498 leader_election.cc:341] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:31.949043 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6d193edcfa684b8795b084f3106903c5
I20260928 14:50:31.963492 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84285a91b8754696889a5a145368f19d" } new_table_name: "default.Table_8a80cd47d41d45419b08ee3777bd0c49" modify_external_catalogs: true
I20260928 14:50:31.965817 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e1dc57786cab4958ad9086275ae478b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.966161 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c05963b71b12498faba8d80dab022b22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.966332 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1dc57786cab4958ad9086275ae478b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:31.966634 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c05963b71b12498faba8d80dab022b22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.968328 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_db508f1a3f4f4ed39e20f45108549f77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:31.968791 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db508f1a3f4f4ed39e20f45108549f77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.971170 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_33eda027747e4e11a7524698b14cd132" } new_table_name: "default.Table_05cd1ada5b9a44ebb16bfd31fe99a519" modify_external_catalogs: true
I20260928 14:50:31.975914 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e9f33f551fc94b99849f78d3bb8d5e33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:31.976274 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06859c8dcc41d99d29365aae350afa with delete_type TABLET_DATA_DELETED (replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:31.976378 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9f33f551fc94b99849f78d3bb8d5e33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:31.978600 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.978863 9815 tablet_replica.cc:330] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:31.979065 9815 raft_consensus.cc:2229] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:31.979189 9815 raft_consensus.cc:2258] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.979705 9815 ts_tablet_manager.cc:1905] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:31.979745 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.984417 9815 ts_tablet_manager.cc:1918] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:31.984485 9815 log.cc:1196] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:31.984673 9815 ts_tablet_manager.cc:1939] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:31.988332 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.990208 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d193edcfa684b8795b084f3106903c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:31.990945 9405 tablet_service.cc:1467] Processing CreateTablet for tablet a1fa3dda1beb4812b3e61e6a233f2aa5 (DEFAULT_TABLE table=default.Table_9ba2afa5ed7b4c7ea59ef904512529e9 [id=1374b5e68de746af9192fb1b5d3d99de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.991326 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1fa3dda1beb4812b3e61e6a233f2aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.992396 9534 tablet_service.cc:1467] Processing CreateTablet for tablet a1fa3dda1beb4812b3e61e6a233f2aa5 (DEFAULT_TABLE table=default.Table_9ba2afa5ed7b4c7ea59ef904512529e9 [id=1374b5e68de746af9192fb1b5d3d99de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.992708 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1fa3dda1beb4812b3e61e6a233f2aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:31.994493 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef7b4d3355f4b879060e9e40a3fd11a (DEFAULT_TABLE table=default.Table_a6f653e4c8794146a3808ff8a255002d [id=2cd484d974604c09bc9c25610d81c6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:31.994851 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef7b4d3355f4b879060e9e40a3fd11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.001381 9388 tablet_service.cc:1467] Processing CreateTablet for tablet df4eda5df67a401a84fa6f3e88a3ee9e (DEFAULT_TABLE table=default.Table_c3e5e40b33e0458082d8807a381f205a [id=f318398de47c487f83a2233e2780e776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.001549 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef7b4d3355f4b879060e9e40a3fd11a (DEFAULT_TABLE table=default.Table_a6f653e4c8794146a3808ff8a255002d [id=2cd484d974604c09bc9c25610d81c6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.001732 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df4eda5df67a401a84fa6f3e88a3ee9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.001866 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef7b4d3355f4b879060e9e40a3fd11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.002338 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8d84881afc441d9be2bfb5505c9156 (DEFAULT_TABLE table=default.Table_b68f85996c674639a073b012b3e7668c [id=cc3ccbebff95488abaf7d0a7034009ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.002447 9399 tablet_service.cc:1467] Processing CreateTablet for tablet f977693e429d4345b1156f879c4dd471 (DEFAULT_TABLE table=default.Table_6795a92d851b46ac8d69afae687ac7da [id=d016a71b141b4ad2860c445b98ef9a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.005434 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d004e52539cc49bc8a26f77e0bb182cc (table default.Table_c3faaac521464670a4b981a20d62e237 [id=d3062c0f64294b23abad7e06715e1fd9]) successfully deleted
I20260928 14:50:32.007843 9536 tablet_service.cc:1467] Processing CreateTablet for tablet f977693e429d4345b1156f879c4dd471 (DEFAULT_TABLE table=default.Table_6795a92d851b46ac8d69afae687ac7da [id=d016a71b141b4ad2860c445b98ef9a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.008136 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f977693e429d4345b1156f879c4dd471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.009887 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 (DEFAULT_TABLE table=default.Table_4001db9bc2b946be85c0c1767b203039 [id=b2eb0926dd8e4c1c9b89ed101dbcd3e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.011479 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef0426eb92482a83d9903e0d6153c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.012279 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 (DEFAULT_TABLE table=default.Table_4001db9bc2b946be85c0c1767b203039 [id=b2eb0926dd8e4c1c9b89ed101dbcd3e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.012629 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef0426eb92482a83d9903e0d6153c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.013556 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9e72d815a218451b884604a1f334d632 (DEFAULT_TABLE table=default.Table_766e2c205c494d5695c1c6bd3e8a0dad [id=afe8dd226bc74db39ce992a9a0dc6793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.014012 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:32.014362 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 96e5111ae94740feb9dd57c7f4f12b2c (DEFAULT_TABLE table=default.Table_fb3a35c7785c4d9688f871b588345ff6 [id=ffd31c3840404c75a7b7278e6ed3847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.016953 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8d84881afc441d9be2bfb5505c9156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.021670 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19995a0d8af4d3ca562bade80ce006f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.024902 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f977693e429d4345b1156f879c4dd471. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:32.029093 9360 leader_election.cc:341] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:32.030601 9497 leader_election.cc:341] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.030761 9497 leader_election.cc:302] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.030989 10484 raft_consensus.cc:2726] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.032387 9283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.033097 9534 tablet_service.cc:1467] Processing CreateTablet for tablet df4eda5df67a401a84fa6f3e88a3ee9e (DEFAULT_TABLE table=default.Table_c3e5e40b33e0458082d8807a381f205a [id=f318398de47c487f83a2233e2780e776]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:32.035988 9497 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.036589 9497 leader_election.cc:302] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.036931 10484 raft_consensus.cc:2726] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.039347 9262 tablet_service.cc:1467] Processing CreateTablet for tablet c11ca733238948d0b24cd37df99f1d6e (DEFAULT_TABLE table=default.Table_d0f78de508d94d71b22499683e9a1127 [id=df093614ba404d73a8d59df733f737a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.041426 9282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16a0f674114ac8b4520fbce2d383d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.042037 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 (DEFAULT_TABLE table=default.Table_df4e804ab47e43f090495eb55315ed06 [id=4ecd70c1ffd54dabb6850217d8a64717]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.041678 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df4eda5df67a401a84fa6f3e88a3ee9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.042627 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc978ea3a194282aacc6ede22076c21" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.043191 9497 leader_election.cc:341] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.043283 9497 leader_election.cc:302] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:32.043574 9497 leader_election.cc:341] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.043656 9497 leader_election.cc:302] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.043691 10484 raft_consensus.cc:2726] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.043807 10484 raft_consensus.cc:2726] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.037114 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eefaf5e8e5f54ea080ce3f5e7ac7ec8b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.045629 9497 leader_election.cc:341] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.045723 9497 leader_election.cc:302] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:32.045840 9497 raft_consensus.cc:2670] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:32.046888 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 24c45934c64642c2b171cb42544728bc (DEFAULT_TABLE table=default.Table_8bd49281d920462e90ddcd6c29877c4b [id=4a249bb006fb442da5b97463fa973855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.049654 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.050467 9360 leader_election.cc:341] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.054628 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e72d815a218451b884604a1f334d632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.059036 9256 tablet_service.cc:1467] Processing CreateTablet for tablet bb09b496476948e2a4f3652c75800e36 (DEFAULT_TABLE table=default.Table_e022fb82787e46f99f941ed27d582d42 [id=9997a2bcf9274d2195fcd251140420c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.061885 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c11ca733238948d0b24cd37df99f1d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.067198 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb09b496476948e2a4f3652c75800e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.067775 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2ab53321d74f28aa5453729e12f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.069491 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c45934c64642c2b171cb42544728bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.073352 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06859c8dcc41d99d29365aae350afa with delete_type TABLET_DATA_DELETED (replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.073858 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.074256 9259 tablet_service.cc:1514] Processing DeleteTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.074617 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.082221 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.082448 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e5111ae94740feb9dd57c7f4f12b2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:32.087910 9851 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.008s sys 0.000s
I20260928 14:50:32.089226 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet f39c1da071164342aea8eab263d4eebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.090137 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 24c45934c64642c2b171cb42544728bc (DEFAULT_TABLE table=default.Table_8bd49281d920462e90ddcd6c29877c4b [id=4a249bb006fb442da5b97463fa973855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.090633 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c45934c64642c2b171cb42544728bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.094296 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d193edcfa684b8795b084f3106903c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.104635 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef7b4d3355f4b879060e9e40a3fd11a (DEFAULT_TABLE table=default.Table_a6f653e4c8794146a3808ff8a255002d [id=2cd484d974604c09bc9c25610d81c6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.105036 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef7b4d3355f4b879060e9e40a3fd11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.105741 9813 tablet_replica.cc:330] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:32.106010 9813 raft_consensus.cc:2229] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.106287 9813 raft_consensus.cc:2258] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:31.922428 9848 consensus_queue.cc:260] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.109627 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8d84881afc441d9be2bfb5505c9156 (DEFAULT_TABLE table=default.Table_b68f85996c674639a073b012b3e7668c [id=cc3ccbebff95488abaf7d0a7034009ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.109992 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8d84881afc441d9be2bfb5505c9156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.117488 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d193edcfa684b8795b084f3106903c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.122020 9567 raft_consensus.cc:2454] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:32.132057 9249 tablet_service.cc:1467] Processing CreateTablet for tablet f977693e429d4345b1156f879c4dd471 (DEFAULT_TABLE table=default.Table_6795a92d851b46ac8d69afae687ac7da [id=d016a71b141b4ad2860c445b98ef9a4c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:32.110364 9851 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.520s user 0.009s sys 0.000s
I20260928 14:50:32.142503 9360 leader_election.cc:302] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.146700 9848 ts_tablet_manager.cc:1428] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.206s user 0.004s sys 0.000s
I20260928 14:50:32.150903 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f977693e429d4345b1156f879c4dd471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.151750 9848 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:32.156464 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 (DEFAULT_TABLE table=default.Table_4001db9bc2b946be85c0c1767b203039 [id=b2eb0926dd8e4c1c9b89ed101dbcd3e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.157943 10537 raft_consensus.cc:2781] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.164903 9264 tablet_service.cc:1467] Processing CreateTablet for tablet df4eda5df67a401a84fa6f3e88a3ee9e (DEFAULT_TABLE table=default.Table_c3e5e40b33e0458082d8807a381f205a [id=f318398de47c487f83a2233e2780e776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.162878 10215 raft_consensus.cc:504] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.170516 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:32.171088 9360 leader_election.cc:341] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.171765 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:32.171939 9567 raft_consensus.cc:3037] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.173019 10215 leader_election.cc:288] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.173601 9813 ts_tablet_manager.cc:1905] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.174518 9567 raft_consensus.cc:2454] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:32.174942 9360 leader_election.cc:302] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.176005 10368 raft_consensus.cc:2781] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.176229 10368 raft_consensus.cc:686] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:32.176532 10368 consensus_queue.cc:237] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.192584 10537 raft_consensus.cc:686] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:32.192982 10537 consensus_queue.cc:237] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.194486 9814 ts_tablet_manager.cc:1918] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.196540 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef0426eb92482a83d9903e0d6153c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.200274 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df4eda5df67a401a84fa6f3e88a3ee9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:32.201828 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8a06859c8dcc41d99d29365aae350afa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a06859c8dcc41d99d29365aae350afa already in progress: creating tablet
I20260928 14:50:32.202296 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (table default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]) successfully deleted
W20260928 14:50:32.202745 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1eaafbd52e464862ae0f0d44ffae58cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eaafbd52e464862ae0f0d44ffae58cf already in progress: creating tablet
W20260928 14:50:32.203088 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 504c0f61d8844bd18062a3b40cd6f8ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 504c0f61d8844bd18062a3b40cd6f8ce already in progress: creating tablet
W20260928 14:50:32.203435 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6d193edcfa684b8795b084f3106903c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d193edcfa684b8795b084f3106903c5 already in progress: creating tablet
W20260928 14:50:32.206787 9219 consensus_peers.cc:487] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebaf10326ec24b99ae2ab1ba8779d1a3. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:32.207109 10386 raft_consensus.cc:482] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.207262 10386 raft_consensus.cc:504] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.207890 10386 leader_election.cc:288] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:32.208922 9219 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee16f4482a424538812f6356655acf77
I20260928 14:50:32.209877 9267 tablet_service.cc:1467] Processing CreateTablet for tablet a1fa3dda1beb4812b3e61e6a233f2aa5 (DEFAULT_TABLE table=default.Table_9ba2afa5ed7b4c7ea59ef904512529e9 [id=1374b5e68de746af9192fb1b5d3d99de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.210777 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1fa3dda1beb4812b3e61e6a233f2aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.216944 9848 tablet_bootstrap.cc:654] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:32.225133 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aff7eb9a7ff4ed79305806c30c30627 consensus state has no leader
I20260928 14:50:32.225632 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]). Expected version 2 got 0
W20260928 14:50:32.225786 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd266b1e19c748f0b743840d44838958 consensus state has no leader
I20260928 14:50:32.225889 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 1f012857690f4f91a941a5f642b9c989 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]). Expected version 1 got 0
I20260928 14:50:32.226169 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:32.226410 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
W20260928 14:50:32.228127 8946 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1f012857690f4f91a941a5f642b9c989 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1f012857690f4f91a941a5f642b9c989 consensus state has no leader
I20260928 14:50:32.233683 10545 raft_consensus.cc:482] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.233834 10545 raft_consensus.cc:504] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.234292 9851 tablet_bootstrap.cc:492] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.234472 9851 ts_tablet_manager.cc:1397] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.843s user 0.012s sys 0.001s
I20260928 14:50:32.234460 10545 leader_election.cc:288] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.235266 9851 raft_consensus.cc:348] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.235529 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.236147 9497 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.217471 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 9e8d84881afc441d9be2bfb5505c9156 (DEFAULT_TABLE table=default.Table_b68f85996c674639a073b012b3e7668c [id=cc3ccbebff95488abaf7d0a7034009ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.240031 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e8d84881afc441d9be2bfb5505c9156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.240746 10386 raft_consensus.cc:482] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.240919 9814 log.cc:1196] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/dd70cf6ee2d343878c90ae4818f1eb8f
I20260928 14:50:32.240892 10386 raft_consensus.cc:504] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.241405 9814 ts_tablet_manager.cc:1939] T dd70cf6ee2d343878c90ae4818f1eb8f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.241555 10386 leader_election.cc:288] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.242167 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 437) took 3341 ms. Trace:
I20260928 14:50:32.242281 9814 rpcz_store.cc:276] 0928 14:50:28.900445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.901775 (+ 1330us) service_pool.cc:227] Handling call
0928 14:50:31.408497 (+2506722us) ts_tablet_manager.cc:1145] Deleting tablet dd70cf6ee2d343878c90ae4818f1eb8f
0928 14:50:31.408508 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.069597 (+661089us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.194382 (+124785us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.242116 (+ 47734us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485803}
I20260928 14:50:32.242667 9814 tablet_replica.cc:330] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:32.242690 9219 leader_election.cc:341] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:32.242882 9814 raft_consensus.cc:2229] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.243081 9814 raft_consensus.cc:2258] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.243211 9855 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.243346 9855 ts_tablet_manager.cc:1397] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.366s user 0.041s sys 0.110s
I20260928 14:50:32.243597 9814 ts_tablet_manager.cc:1905] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.244045 9855 raft_consensus.cc:348] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.244246 9855 raft_consensus.cc:374] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.244295 9855 raft_consensus.cc:729] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.244474 9855 consensus_queue.cc:260] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.245015 9855 ts_tablet_manager.cc:1428] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:32.245286 9855 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:32.246803 9855 tablet_bootstrap.cc:654] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.255788 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.256016 9815 tablet_replica.cc:330] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.256191 9815 raft_consensus.cc:2229] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.256325 9815 raft_consensus.cc:2258] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.256426 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.256799 9815 ts_tablet_manager.cc:1905] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.256858 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.259586 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.259828 9851 raft_consensus.cc:374] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.259994 9851 raft_consensus.cc:729] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.260319 9851 consensus_queue.cc:260] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.260890 9851 ts_tablet_manager.cc:1428] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s
I20260928 14:50:32.261698 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.262401 9815 ts_tablet_manager.cc:1918] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.262490 9815 log.cc:1196] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5b695c68118b49359f1899d30208b1b7
I20260928 14:50:32.262770 9815 ts_tablet_manager.cc:1939] T 5b695c68118b49359f1899d30208b1b7 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.264554 9815 tablet_replica.cc:330] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.264709 9815 raft_consensus.cc:2229] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.264828 9815 raft_consensus.cc:2258] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.265239 9815 ts_tablet_manager.cc:1905] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.277949 10546 raft_consensus.cc:482] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 658e483a10314e8d93c2f6e9084f2a91)
I20260928 14:50:32.281347 9815 ts_tablet_manager.cc:1918] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.281446 9815 log.cc:1196] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5fc978ea3a194282aacc6ede22076c21
I20260928 14:50:32.281790 9815 ts_tablet_manager.cc:1939] T 5fc978ea3a194282aacc6ede22076c21 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.282601 9815 tablet_replica.cc:330] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.282778 9815 raft_consensus.cc:2229] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.282914 9815 raft_consensus.cc:2258] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.283208 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]). Expected version 1 got 0
I20260928 14:50:32.283368 9815 ts_tablet_manager.cc:1905] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.286216 9851 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.287431 9814 ts_tablet_manager.cc:1918] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.287619 9814 log.cc:1196] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/bc3e689e2ffa4edb8ef1004287e40c99
I20260928 14:50:32.288121 9814 ts_tablet_manager.cc:1939] T bc3e689e2ffa4edb8ef1004287e40c99 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.288936 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 439) took 3371 ms. Trace:
I20260928 14:50:32.289225 9814 rpcz_store.cc:276] 0928 14:50:28.917305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.917503 (+ 198us) service_pool.cc:227] Handling call
0928 14:50:32.242584 (+3325081us) ts_tablet_manager.cc:1145] Deleting tablet bc3e689e2ffa4edb8ef1004287e40c99
0928 14:50:32.242594 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.282853 (+ 40259us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.287202 (+ 4349us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.288901 (+ 1699us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3318130}
I20260928 14:50:32.290855 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 440) took 3355 ms. Trace:
I20260928 14:50:32.291023 9814 rpcz_store.cc:276] 0928 14:50:28.935529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.936151 (+ 622us) service_pool.cc:227] Handling call
0928 14:50:32.290712 (+3354561us) ts_tablet_manager.cc:1145] Deleting tablet 9a753aaf7f8c4498b6ba35fa27d8c537
0928 14:50:32.290722 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.290824 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3344867}
I20260928 14:50:32.291373 9814 tablet_replica.cc:330] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.291602 9814 raft_consensus.cc:2229] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.291564 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.291807 9814 raft_consensus.cc:2258] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:32.292157 9498 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.292268 9498 leader_election.cc:302] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.292305 9814 ts_tablet_manager.cc:1905] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.292589 10545 raft_consensus.cc:2726] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:32.293313 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 114593us
I20260928 14:50:32.293639 10215 raft_consensus.cc:482] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 658e483a10314e8d93c2f6e9084f2a91)
I20260928 14:50:32.290575 9851 tablet_bootstrap.cc:654] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.293848 10215 raft_consensus.cc:504] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.294442 10215 leader_election.cc:288] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.294857 10552 raft_consensus.cc:482] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.295122 10552 raft_consensus.cc:504] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.296499 10552 leader_election.cc:288] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.296540 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:32.294598 10215 raft_consensus.cc:482] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.302760 10215 raft_consensus.cc:504] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.303272 10215 leader_election.cc:288] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.301159 9814 ts_tablet_manager.cc:1918] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.304102 9814 log.cc:1196] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:32.304759 9814 ts_tablet_manager.cc:1939] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.306056 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 441) took 3370 ms. Trace:
I20260928 14:50:32.306465 9814 rpcz_store.cc:276] 0928 14:50:28.935667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.937266 (+ 1599us) service_pool.cc:227] Handling call
0928 14:50:32.291319 (+3354053us) ts_tablet_manager.cc:1145] Deleting tablet 5e0b8288fc9b47ce8c70dec324dfecf0
0928 14:50:32.291328 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.298216 (+ 6888us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.301068 (+ 2852us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.305988 (+ 4920us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3338198}
I20260928 14:50:32.307132 9814 tablet_replica.cc:330] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.307581 9814 raft_consensus.cc:2229] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.310774 9815 ts_tablet_manager.cc:1918] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:32.315510 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 74723.6us
W20260928 14:50:32.315845 9220 consensus_peers.cc:487] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:32.316039 9814 raft_consensus.cc:2258] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:32.316100 9220 consensus_peers.cc:487] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a50b4fe8d86464f933baec07478db25. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:32.316589 9814 ts_tablet_manager.cc:1905] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.317708 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e0b8288fc9b47ce8c70dec324dfecf0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.317953 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bef7b73d24a42979fcb7a2e47e92919" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.318188 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee16f4482a424538812f6356655acf77" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.318377 9425 raft_consensus.cc:2454] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:32.318614 9220 leader_election.cc:302] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.318933 10386 raft_consensus.cc:2726] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.319217 9220 leader_election.cc:302] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:32.319521 10386 raft_consensus.cc:2781] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:32.319612 10386 raft_consensus.cc:482] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:32.319707 10386 raft_consensus.cc:3037] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.321676 9815 log.cc:1196] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2e16a0f674114ac8b4520fbce2d383d8
I20260928 14:50:32.321986 9815 ts_tablet_manager.cc:1939] T 2e16a0f674114ac8b4520fbce2d383d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.322184 10386 raft_consensus.cc:504] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.322785 10386 leader_election.cc:288] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.322898 9815 tablet_replica.cc:330] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.323076 9815 raft_consensus.cc:2229] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.323215 9815 raft_consensus.cc:2258] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.323699 9815 ts_tablet_manager.cc:1905] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.326229 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee16f4482a424538812f6356655acf77" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:32.326542 9219 leader_election.cc:341] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee16f4482a424538812f6356655acf77
I20260928 14:50:32.326768 9427 raft_consensus.cc:3037] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.329653 9855 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.329769 9855 ts_tablet_manager.cc:1397] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.085s user 0.006s sys 0.013s
I20260928 14:50:32.331017 9814 ts_tablet_manager.cc:1918] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 14:50:32.331265 9814 log.cc:1196] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3d27738fcfbc42f298e26149dfd28182
I20260928 14:50:32.331658 9855 raft_consensus.cc:348] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.331851 9855 raft_consensus.cc:374] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.331909 9855 raft_consensus.cc:729] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.332015 9814 ts_tablet_manager.cc:1939] T 3d27738fcfbc42f298e26149dfd28182 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.332154 9427 raft_consensus.cc:2454] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:32.332091 9855 consensus_queue.cc:260] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.332571 9855 ts_tablet_manager.cc:1428] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:32.333508 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 442) took 3391 ms. Trace:
I20260928 14:50:32.333647 9814 rpcz_store.cc:276] 0928 14:50:28.941581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.941630 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:32.307028 (+3365398us) ts_tablet_manager.cc:1145] Deleting tablet 3d27738fcfbc42f298e26149dfd28182
0928 14:50:32.307038 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.315782 (+ 8744us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x6170001f0508. stack: 00007fdd1550c66e 00007fdd1550c430 00007fdd145935ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fdd2094bea1 00007fdd209d75ec 00007fdd20a44130 00007fdd21ce85ec 00007fdd246772e6 00007fdd246a9404 00007fdd2468a870 00007fdd2468a5fd 00000000009edb7c 00007fdd15552344
0928 14:50:32.327732 (+ 11950us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.330902 (+ 3170us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.333473 (+ 2571us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17389440,"tablet-delete.queue_time_us":3317085}
I20260928 14:50:32.334075 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 443) took 3319 ms. Trace:
I20260928 14:50:32.334259 9814 rpcz_store.cc:276] 0928 14:50:29.015083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.015294 (+ 211us) service_pool.cc:227] Handling call
0928 14:50:32.333931 (+3318637us) ts_tablet_manager.cc:1145] Deleting tablet 5b695c68118b49359f1899d30208b1b7
0928 14:50:32.333941 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.334032 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3292470}
I20260928 14:50:32.334605 9814 tablet_replica.cc:330] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.334882 9814 raft_consensus.cc:2229] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.335165 9814 raft_consensus.cc:2258] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.335685 9814 ts_tablet_manager.cc:1905] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.338061 9855 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:32.339291 9855 tablet_bootstrap.cc:654] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.343214 10545 raft_consensus.cc:482] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.343326 10545 raft_consensus.cc:504] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.343847 10545 leader_election.cc:288] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.344990 9220 leader_election.cc:302] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:32.345300 10386 raft_consensus.cc:2781] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.345451 10386 raft_consensus.cc:686] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:32.345731 10386 consensus_queue.cc:237] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.278923 10546 raft_consensus.cc:504] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.348017 9814 ts_tablet_manager.cc:1918] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.348173 9814 log.cc:1196] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/89959226fd6247d4b89c54cc6ef4ede6
I20260928 14:50:32.348040 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.348372 10545 raft_consensus.cc:482] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.348483 10545 raft_consensus.cc:504] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.348955 10545 leader_election.cc:288] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.348989 9426 raft_consensus.cc:2379] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate 658e483a10314e8d93c2f6e9084f2a91 in this term.
W20260928 14:50:32.349512 9498 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.350147 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:32.350617 9498 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.350734 9815 ts_tablet_manager.cc:1918] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.351250 9814 ts_tablet_manager.cc:1939] T 89959226fd6247d4b89c54cc6ef4ede6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.351644 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 447) took 3275 ms. Trace:
I20260928 14:50:32.351783 9220 leader_election.cc:302] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.351749 9814 rpcz_store.cc:276] 0928 14:50:29.078660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.079124 (+ 464us) service_pool.cc:227] Handling call
0928 14:50:32.334486 (+3255362us) ts_tablet_manager.cc:1145] Deleting tablet 89959226fd6247d4b89c54cc6ef4ede6
0928 14:50:32.334495 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.341804 (+ 7309us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.347919 (+ 6115us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.351593 (+ 3674us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3250597}
I20260928 14:50:32.352415 9815 log.cc:1196] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/a19995a0d8af4d3ca562bade80ce006f
I20260928 14:50:32.352568 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 448) took 3143 ms. Trace:
W20260928 14:50:32.352643 9220 raft_consensus.cc:2670] T 5e0b8288fc9b47ce8c70dec324dfecf0 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:32.352717 9814 rpcz_store.cc:276] 0928 14:50:29.208760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.208816 (+ 56us) service_pool.cc:227] Handling call
0928 14:50:32.352411 (+3143595us) ts_tablet_manager.cc:1145] Deleting tablet 86f11c5ca3154bac934cae3842f16de4
0928 14:50:32.352422 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.352509 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3143356}
I20260928 14:50:32.352967 9815 ts_tablet_manager.cc:1939] T a19995a0d8af4d3ca562bade80ce006f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.353132 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 449) took 3142 ms. Trace:
I20260928 14:50:32.353229 9814 rpcz_store.cc:276] 0928 14:50:29.210516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.210694 (+ 178us) service_pool.cc:227] Handling call
0928 14:50:32.352958 (+3142264us) ts_tablet_manager.cc:1145] Deleting tablet 7ef356a4c9d34af4b300d38eab49a569
0928 14:50:32.352967 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.353073 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3142020}
I20260928 14:50:32.353487 9814 tablet_replica.cc:330] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.353708 9814 raft_consensus.cc:2229] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.353900 9814 raft_consensus.cc:2258] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.354467 9814 ts_tablet_manager.cc:1905] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.355964 9815 tablet_replica.cc:330] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.356451 9815 raft_consensus.cc:2229] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.356981 9815 raft_consensus.cc:2258] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.358137 9815 ts_tablet_manager.cc:1905] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.364068 9851 tablet_bootstrap.cc:492] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.364168 9815 ts_tablet_manager.cc:1918] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.364214 9851 ts_tablet_manager.cc:1397] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.009s
I20260928 14:50:32.364257 9815 log.cc:1196] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:32.364508 9815 ts_tablet_manager.cc:1939] T ba281355b2f44b77a4ff99d49c084162 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.364964 9851 raft_consensus.cc:348] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.365159 9851 raft_consensus.cc:374] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.365245 9851 raft_consensus.cc:729] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.365455 9851 consensus_queue.cc:260] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.365998 9851 ts_tablet_manager.cc:1428] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:32.366258 9851 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.367810 9851 tablet_bootstrap.cc:654] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.366006 10546 leader_election.cc:288] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.371318 9813 ts_tablet_manager.cc:1918] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.371450 9813 log.cc:1196] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:32.371956 9813 ts_tablet_manager.cc:1939] T ebaf10326ec24b99ae2ab1ba8779d1a3 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.372334 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 376) took 4730 ms. Trace:
I20260928 14:50:32.383445 10545 raft_consensus.cc:482] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.383581 10545 raft_consensus.cc:504] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.384148 10545 leader_election.cc:288] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.384961 10550 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c253b9f3f43c4b8ba7cd5c7d4edac656)
I20260928 14:50:32.385291 10550 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } }
I20260928 14:50:32.385365 10521 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253b9f3f43c4b8ba7cd5c7d4edac656. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:32.390432 10521 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 14:50:32.392941 10550 leader_election.cc:288] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c253b9f3f43c4b8ba7cd5c7d4edac656 (127.8.181.62:43149), 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417)
I20260928 14:50:32.394519 10005 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:32.394822 10005 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:32.401705 10545 raft_consensus.cc:482] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.401839 10545 raft_consensus.cc:504] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.402356 10545 leader_election.cc:288] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.418265 9814 ts_tablet_manager.cc:1918] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.418414 9814 log.cc:1196] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8948e45987b94ca69004c42e224ce93f
I20260928 14:50:32.418812 9814 ts_tablet_manager.cc:1939] T 8948e45987b94ca69004c42e224ce93f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.419178 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 451) took 3195 ms. Trace:
I20260928 14:50:32.419366 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.419989 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]). Expected version 1 got 0
I20260928 14:50:32.420074 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.420554 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.421272 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f012857690f4f91a941a5f642b9c989" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.421705 9497 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.421837 9497 leader_election.cc:302] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.422374 10545 raft_consensus.cc:2726] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:32.422772 9497 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.422875 9497 leader_election.cc:302] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.419302 9814 rpcz_store.cc:276] 0928 14:50:29.223911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.223966 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:32.353414 (+3129448us) ts_tablet_manager.cc:1145] Deleting tablet 8948e45987b94ca69004c42e224ce93f
0928 14:50:32.353423 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.357341 (+ 3918us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.418119 (+ 60778us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.419138 (+ 1019us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3128793}
I20260928 14:50:32.423465 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 454) took 3102 ms. Trace:
I20260928 14:50:32.423578 9814 rpcz_store.cc:276] 0928 14:50:29.320918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.321832 (+ 914us) service_pool.cc:227] Handling call
0928 14:50:32.423325 (+3101493us) ts_tablet_manager.cc:1145] Deleting tablet c6b4b4c775fe4eacaaa557d4daa2a600
0928 14:50:32.423336 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.423425 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3098550}
I20260928 14:50:32.423940 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 455) took 3064 ms. Trace:
I20260928 14:50:32.424041 9814 rpcz_store.cc:276] 0928 14:50:29.359788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.359862 (+ 74us) service_pool.cc:227] Handling call
0928 14:50:32.423794 (+3063932us) ts_tablet_manager.cc:1145] Deleting tablet 4744deca899b4e6caa57f70ce1df8a8d
0928 14:50:32.423804 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.423908 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3042903}
I20260928 14:50:32.424643 10545 raft_consensus.cc:2726] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:32.424998 9497 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:32.425573 9497 leader_election.cc:341] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.425962 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d9085bedbe34425b957fa044a6abcb21" } modify_external_catalogs: true
I20260928 14:50:32.426159 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d9085bedbe34425b957fa044a6abcb21" } modify_external_catalogs: true
I20260928 14:50:32.425395 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 456) took 3045 ms. Trace:
I20260928 14:50:32.426585 9814 rpcz_store.cc:276] 0928 14:50:29.379954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.380021 (+ 67us) service_pool.cc:227] Handling call
0928 14:50:32.424260 (+3044239us) ts_tablet_manager.cc:1145] Deleting tablet a303792e4c804844bc6037fabb425be4
0928 14:50:32.424269 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.425356 (+ 1087us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3042752}
I20260928 14:50:32.426923 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 457) took 3045 ms. Trace:
I20260928 14:50:32.426913 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6" } modify_external_catalogs: true
I20260928 14:50:32.427084 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d0d7c8b1fa87468d9eec4651d8bc94b6" } modify_external_catalogs: true
I20260928 14:50:32.427301 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_34ef5f5fa21143379cd2ba4997e77c8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:32.427721 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6e60e487cf1f4b219f698d44e4fdb1b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:32.428179 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b9e0d1da94af43e98734c49c00835d4c" } new_table_name: "default.Table_67d8c754b00c4bc083809df338bf770a" modify_external_catalogs: true
W20260928 14:50:32.428274 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.428419 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_759996584e7f451ba52a51c319bf3aad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:32.428910 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_759996584e7f451ba52a51c319bf3aad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.429302 9814 rpcz_store.cc:276] 0928 14:50:29.381730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.381797 (+ 67us) service_pool.cc:227] Handling call
0928 14:50:32.426810 (+3045013us) ts_tablet_manager.cc:1145] Deleting tablet be232889594147bdbe2d4825c3e8c7d0
0928 14:50:32.426818 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.426893 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3042576}
I20260928 14:50:32.429726 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 458) took 2965 ms. Trace:
I20260928 14:50:32.429903 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1bb9988e056b464d896de7d07c7dcb6b" } new_table_name: "default.Table_28471d752bd8446eb00cba5559e560f2" modify_external_catalogs: true
I20260928 14:50:32.430011 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b2bac03b494248629046df888411bf3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:32.430717 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2bac03b494248629046df888411bf3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.430711 9814 rpcz_store.cc:276] 0928 14:50:29.464670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.464872 (+ 202us) service_pool.cc:227] Handling call
0928 14:50:32.429610 (+2964738us) ts_tablet_manager.cc:1145] Deleting tablet dc8400fdb8d948b084733011b16df1b3
0928 14:50:32.429620 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.429696 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2960810}
I20260928 14:50:32.430976 9814 tablet_replica.cc:330] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.431187 9814 raft_consensus.cc:2229] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.431322 9814 pending_rounds.cc:62] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:32.431144 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_224b699f0cba4133a5ffb1e73d69d754"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:32.431388 9814 pending_rounds.cc:68] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326381180436480 op_type: NO_OP noop_request { }
I20260928 14:50:32.431499 9814 raft_consensus.cc:2866] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:32.431614 9814 raft_consensus.cc:2258] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:32.431846 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_224b699f0cba4133a5ffb1e73d69d754 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:32.427876 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34ef5f5fa21143379cd2ba4997e77c8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.437359 9814 ts_tablet_manager.cc:1905] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.437911 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5b695c68118b49359f1899d30208b1b7 (table default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]) successfully deleted
I20260928 14:50:32.438143 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5fc978ea3a194282aacc6ede22076c21 (table default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]) successfully deleted
I20260928 14:50:32.438320 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2e16a0f674114ac8b4520fbce2d383d8 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
I20260928 14:50:32.438499 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet a19995a0d8af4d3ca562bade80ce006f (table default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]) successfully deleted
I20260928 14:50:32.438675 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ba281355b2f44b77a4ff99d49c084162 (table default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]) successfully deleted
I20260928 14:50:32.439230 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet dd70cf6ee2d343878c90ae4818f1eb8f (table default.Table_0628bbb0b50640ff9da42eef50691d9d [id=0c7c9f38c5984b3597ba7b03c38113a4]) successfully deleted
I20260928 14:50:32.439306 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7d04d70ad3e447aba07ae7ac26a0204b" } modify_external_catalogs: true
I20260928 14:50:32.439457 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7d04d70ad3e447aba07ae7ac26a0204b" } modify_external_catalogs: true
I20260928 14:50:32.447751 9814 ts_tablet_manager.cc:1918] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.447882 9814 log.cc:1196] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9d5166a828e84d46af3112cdc7bb0a2a
I20260928 14:50:32.448328 9814 ts_tablet_manager.cc:1939] T 9d5166a828e84d46af3112cdc7bb0a2a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.449083 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 459) took 2964 ms. Trace:
I20260928 14:50:32.449205 9814 rpcz_store.cc:276] 0928 14:50:29.484153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.484208 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:32.430924 (+2946716us) ts_tablet_manager.cc:1145] Deleting tablet 9d5166a828e84d46af3112cdc7bb0a2a
0928 14:50:32.430933 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.440635 (+ 9702us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.447639 (+ 7004us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.449048 (+ 1409us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2935275}
W20260928 14:50:32.462752 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (table default.Table_2378f0131076405ab6f9ad2247f22c2b [id=74dcef243b8f4685bef322f403a2ebd2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 30d197a8ba8848d98ba0f03b2e83d3f6 consensus state has no leader
I20260928 14:50:32.470322 9814 tablet_replica.cc:330] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.471506 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05131db52e94d7c9f4856b0455246d2" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.479622 9814 raft_consensus.cc:2229] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.480048 9814 raft_consensus.cc:2258] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.480733 9814 ts_tablet_manager.cc:1905] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.482553 9855 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.482677 9855 ts_tablet_manager.cc:1397] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.027s
I20260928 14:50:32.483281 9855 raft_consensus.cc:348] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.483472 9855 raft_consensus.cc:374] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.483520 9855 raft_consensus.cc:729] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.483695 9855 consensus_queue.cc:260] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.484292 9855 ts_tablet_manager.cc:1428] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:32.484589 9855 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:32.486238 9855 tablet_bootstrap.cc:654] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.488531 9851 tablet_bootstrap.cc:492] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.489275 9851 ts_tablet_manager.cc:1397] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.123s user 0.012s sys 0.017s
I20260928 14:50:32.491215 9851 raft_consensus.cc:348] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.491508 9851 raft_consensus.cc:374] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.491626 9851 raft_consensus.cc:729] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.491895 9851 consensus_queue.cc:260] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.492516 9851 ts_tablet_manager.cc:1428] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:32.492908 9851 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.495806 9851 tablet_bootstrap.cc:654] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.497004 10545 raft_consensus.cc:482] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.497138 10545 raft_consensus.cc:504] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.497730 10545 leader_election.cc:288] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.498827 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.499495 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e53683279a0c4b41b9ea94e88a84cb94
I20260928 14:50:32.384948 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.403309 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f012857690f4f91a941a5f642b9c989" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:32.500566 9498 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.500661 9498 leader_election.cc:302] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:32.500955 9498 leader_election.cc:341] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.501024 9498 leader_election.cc:302] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.501304 10484 raft_consensus.cc:2726] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.501432 10484 raft_consensus.cc:2726] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:32.501757 9497 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:32.503276 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88015bcd867e40e5b9263930e820074a consensus state has no leader
I20260928 14:50:32.503652 9851 tablet_bootstrap.cc:492] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.503784 9851 ts_tablet_manager.cc:1397] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260928 14:50:32.503808 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e3a73ecfc16413ea124559696001ab6" } modify_external_catalogs: true
I20260928 14:50:32.504086 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e3a73ecfc16413ea124559696001ab6" } modify_external_catalogs: true
I20260928 14:50:32.504542 9851 raft_consensus.cc:348] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.505300 9855 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.505203 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.505456 9855 ts_tablet_manager.cc:1397] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.001s
W20260928 14:50:32.505793 9498 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.505903 9498 leader_election.cc:302] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.505848 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2c60594fff144e6fb1bcfacebce32be3" } new_table_name: "default.Table_6e3dd5704ce1494096b9810b983fc8a9" modify_external_catalogs: true
I20260928 14:50:32.506042 9855 raft_consensus.cc:348] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.506238 9855 raft_consensus.cc:374] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.506304 9855 raft_consensus.cc:729] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.506222 10545 raft_consensus.cc:2726] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.506476 9855 consensus_queue.cc:260] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.419410 9848 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:32.458947 9360 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: bc3e689e2ffa4edb8ef1004287e40c99
W20260928 14:50:32.506963 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 48022us
I20260928 14:50:32.507129 9848 ts_tablet_manager.cc:1397] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.355s user 0.003s sys 0.004s
W20260928 14:50:32.508519 9360 leader_election.cc:341] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: bc3e689e2ffa4edb8ef1004287e40c99
I20260928 14:50:32.508657 9360 leader_election.cc:302] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.508764 9848 raft_consensus.cc:348] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.509027 9848 raft_consensus.cc:374] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:32.509058 9360 leader_election.cc:341] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:32.509102 9848 raft_consensus.cc:729] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:32.509269 9360 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.509364 9848 consensus_queue.cc:260] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.506604 9813 rpcz_store.cc:276] 0928 14:50:27.642059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.642133 (+ 74us) service_pool.cc:227] Handling call
0928 14:50:32.105644 (+4463511us) ts_tablet_manager.cc:1145] Deleting tablet ebaf10326ec24b99ae2ab1ba8779d1a3
0928 14:50:32.105657 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.269447 (+163790us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.371196 (+101749us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.372292 (+ 1096us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66686,"tablet-delete.queue_time_us":4463261}
W20260928 14:50:32.511890 9360 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:32.512022 9360 leader_election.cc:302] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.465273 10556 raft_consensus.cc:482] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.483911 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.513115 9855 ts_tablet_manager.cc:1428] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 14:50:32.513458 9855 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:32.516299 9855 tablet_bootstrap.cc:654] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.516624 10546 raft_consensus.cc:2726] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.516870 10549 raft_consensus.cc:2726] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 14:50:32.517073 9360 leader_election.cc:341] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:32.517184 9360 leader_election.cc:302] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.517463 10549 raft_consensus.cc:2726] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 14:50:32.517946 9848 ts_tablet_manager.cc:1428] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260928 14:50:32.516498 10556 raft_consensus.cc:504] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.520653 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:32.520852 9360 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:32.521059 10556 leader_election.cc:288] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.521246 9813 tablet_replica.cc:330] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:32.524401 9848 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:32.439750 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]) successfully deleted
W20260928 14:50:32.525812 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 86041.7us
I20260928 14:50:32.526055 9848 tablet_bootstrap.cc:654] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:32.526196 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a753aaf7f8c4498b6ba35fa27d8c537 already in progress: creating tablet
I20260928 14:50:32.526446 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]) successfully deleted
I20260928 14:50:32.526768 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]) successfully deleted
W20260928 14:50:32.527125 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5b695c68118b49359f1899d30208b1b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b695c68118b49359f1899d30208b1b7 already in progress: creating tablet
I20260928 14:50:32.527469 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (table default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]) successfully deleted
I20260928 14:50:32.528338 9813 raft_consensus.cc:2229] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.528515 9813 raft_consensus.cc:2258] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.529027 9813 ts_tablet_manager.cc:1905] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.504838 9814 ts_tablet_manager.cc:1918] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.530757 9851 raft_consensus.cc:374] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.530838 9814 log.cc:1196] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6a50b4fe8d86464f933baec07478db25
I20260928 14:50:32.530879 9851 raft_consensus.cc:729] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.531123 9851 consensus_queue.cc:260] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.520859 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e56077833e41dbacf54c1757ba6a38" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.531706 9851 ts_tablet_manager.cc:1428] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260928 14:50:32.531284 9814 ts_tablet_manager.cc:1939] T 6a50b4fe8d86464f933baec07478db25 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.531993 9851 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.532553 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 460) took 2958 ms. Trace:
I20260928 14:50:32.532648 9814 rpcz_store.cc:276] 0928 14:50:29.573904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.573978 (+ 74us) service_pool.cc:227] Handling call
0928 14:50:32.452003 (+2878025us) ts_tablet_manager.cc:1145] Deleting tablet 6a50b4fe8d86464f933baec07478db25
0928 14:50:32.452013 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.494829 (+ 42816us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.504737 (+ 9908us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.532490 (+ 27753us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877702}
I20260928 14:50:32.533058 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 461) took 2847 ms. Trace:
I20260928 14:50:32.533147 9814 rpcz_store.cc:276] 0928 14:50:29.685413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.686006 (+ 593us) service_pool.cc:227] Handling call
0928 14:50:32.532907 (+2846901us) ts_tablet_manager.cc:1145] Deleting tablet 1b22c3f9578a464a96be0bac6127e56d
0928 14:50:32.532918 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.533008 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2846676}
W20260928 14:50:32.533689 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 622a7af04be44ddebc1af16fcc6325ae consensus state has no leader
W20260928 14:50:32.533746 9360 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.534094 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 470) took 2684 ms. Trace:
I20260928 14:50:32.535008 9360 leader_election.cc:302] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.534188 9814 rpcz_store.cc:276] 0928 14:50:29.849644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.849711 (+ 67us) service_pool.cc:227] Handling call
0928 14:50:32.533350 (+2683639us) ts_tablet_manager.cc:1145] Deleting tablet 79f4b20a5e784d909f7297cc7f1b05e6
0928 14:50:32.533359 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.534036 (+ 677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682921}
I20260928 14:50:32.535640 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 472) took 2680 ms. Trace:
I20260928 14:50:32.535730 9814 rpcz_store.cc:276] 0928 14:50:29.854839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.855384 (+ 545us) service_pool.cc:227] Handling call
0928 14:50:32.535484 (+2680100us) ts_tablet_manager.cc:1145] Deleting tablet 4684ba575d9d45f3bb059a15efdd936d
0928 14:50:32.535493 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.535592 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2677896}
I20260928 14:50:32.536046 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 471) took 2681 ms. Trace:
I20260928 14:50:32.536136 9814 rpcz_store.cc:276] 0928 14:50:29.854583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.855634 (+ 1051us) service_pool.cc:227] Handling call
0928 14:50:32.535915 (+2680281us) ts_tablet_manager.cc:1145] Deleting tablet 1016ad6219294ccd829fca9b264ab06f
0928 14:50:32.535924 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.536000 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2670935}
I20260928 14:50:32.536484 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 482) took 2614 ms. Trace:
I20260928 14:50:32.536589 9814 rpcz_store.cc:276] 0928 14:50:29.922250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.922298 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:32.536353 (+2614055us) ts_tablet_manager.cc:1145] Deleting tablet 4a14c0b50cad4954b5dc5666689810ba
0928 14:50:32.536362 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.536437 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2613039}
I20260928 14:50:32.536931 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 492) took 2540 ms. Trace:
I20260928 14:50:32.537225 9814 rpcz_store.cc:276] 0928 14:50:29.996207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.996281 (+ 74us) service_pool.cc:227] Handling call
0928 14:50:32.536786 (+2540505us) ts_tablet_manager.cc:1145] Deleting tablet 8f2898a032e1488b98c31b5e83371a71
0928 14:50:32.536795 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.536875 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2535278}
I20260928 14:50:32.537626 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 497) took 2511 ms. Trace:
I20260928 14:50:32.537709 9814 rpcz_store.cc:276] 0928 14:50:30.026233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.041415 (+ 15182us) service_pool.cc:227] Handling call
0928 14:50:32.537445 (+2496030us) ts_tablet_manager.cc:1145] Deleting tablet 2e16a0f674114ac8b4520fbce2d383d8
0928 14:50:32.537455 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.537573 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2472117}
I20260928 14:50:32.538002 10556 raft_consensus.cc:2726] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.538304 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 502) took 2382 ms. Trace:
I20260928 14:50:32.538386 9814 rpcz_store.cc:276] 0928 14:50:30.155747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.155805 (+ 58us) service_pool.cc:227] Handling call
0928 14:50:32.537905 (+2382100us) ts_tablet_manager.cc:1145] Deleting tablet ad844de91e4040c3a8ae4873c0fa6ba4
0928 14:50:32.538160 (+ 255us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.538253 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2381073}
I20260928 14:50:32.539937 9813 ts_tablet_manager.cc:1918] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.540073 9813 log.cc:1196] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/03245f72e0aa496d895968d8e5715b56
I20260928 14:50:32.540431 9813 ts_tablet_manager.cc:1939] T 03245f72e0aa496d895968d8e5715b56 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.540678 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 89959226fd6247d4b89c54cc6ef4ede6 (table default.Table_ac65cd1a54cf4ffc8d440ec0999a1f8b [id=abe01d8e1ae6470893f4d86a00f7d529]) successfully deleted
I20260928 14:50:32.541149 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 377) took 4898 ms. Trace:
I20260928 14:50:32.541242 9813 rpcz_store.cc:276] 0928 14:50:27.643055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:27.643253 (+ 198us) service_pool.cc:227] Handling call
0928 14:50:32.511146 (+4867893us) ts_tablet_manager.cc:1145] Deleting tablet 03245f72e0aa496d895968d8e5715b56
0928 14:50:32.511157 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.536944 (+ 25787us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.539843 (+ 2899us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.541095 (+ 1252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4867696}
I20260928 14:50:32.541942 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 501) took 2386 ms. Trace:
I20260928 14:50:32.542032 9814 rpcz_store.cc:276] 0928 14:50:30.155318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.157434 (+ 2116us) service_pool.cc:227] Handling call
0928 14:50:32.538592 (+2381158us) ts_tablet_manager.cc:1145] Deleting tablet 56151b288b634d6bb0bc7113afa5fbaa
0928 14:50:32.541796 (+ 3204us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.541894 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2379713}
I20260928 14:50:32.543385 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 500) took 2387 ms. Trace:
I20260928 14:50:32.543576 9814 rpcz_store.cc:276] 0928 14:50:30.155088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.157461 (+ 2373us) service_pool.cc:227] Handling call
0928 14:50:32.542237 (+2384776us) ts_tablet_manager.cc:1145] Deleting tablet 42b9f78ecb674ae691d407615680ca56
0928 14:50:32.542603 (+ 366us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.542691 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380566}
W20260928 14:50:32.544684 9219 consensus_peers.cc:487] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03245f72e0aa496d895968d8e5715b56. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:32.545042 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 511) took 2212 ms. Trace:
I20260928 14:50:32.548075 9814 rpcz_store.cc:276] 0928 14:50:30.332166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.332218 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:32.543904 (+2211686us) ts_tablet_manager.cc:1145] Deleting tablet 8f79fcac805b42ba8b66949fbdfeb8f6
0928 14:50:32.543915 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.544860 (+ 945us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210513}
W20260928 14:50:32.548172 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 86f11c5ca3154bac934cae3842f16de4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f11c5ca3154bac934cae3842f16de4 already in progress: creating tablet
W20260928 14:50:32.548441 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7ef356a4c9d34af4b300d38eab49a569 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef356a4c9d34af4b300d38eab49a569 already in progress: creating tablet
I20260928 14:50:32.548498 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 512) took 2203 ms. Trace:
I20260928 14:50:32.548645 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8948e45987b94ca69004c42e224ce93f (table default.Table_413d0798da2e4456aa361e47f8f118d0 [id=656cee3301f549be8bd2c3c2982564f8]) successfully deleted
W20260928 14:50:32.548833 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c6b4b4c775fe4eacaaa557d4daa2a600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b4b4c775fe4eacaaa557d4daa2a600 already in progress: creating tablet
I20260928 14:50:32.548594 9814 rpcz_store.cc:276] 0928 14:50:30.345223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.345292 (+ 69us) service_pool.cc:227] Handling call
0928 14:50:32.548321 (+2203029us) ts_tablet_manager.cc:1145] Deleting tablet 8a55156d0bf94b5fbd810d321e78b760
0928 14:50:32.548330 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.548407 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201384}
I20260928 14:50:32.549181 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 518) took 2155 ms. Trace:
I20260928 14:50:32.549307 9814 rpcz_store.cc:276] 0928 14:50:30.393711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.394182 (+ 471us) service_pool.cc:227] Handling call
0928 14:50:32.549002 (+2154820us) ts_tablet_manager.cc:1145] Deleting tablet 76ad7685ece44665896f687697bddccf
0928 14:50:32.549011 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.549102 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2154629}
I20260928 14:50:32.549713 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 519) took 2155 ms. Trace:
I20260928 14:50:32.549810 9814 rpcz_store.cc:276] 0928 14:50:30.393876 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.394410 (+ 534us) service_pool.cc:227] Handling call
0928 14:50:32.549546 (+2155136us) ts_tablet_manager.cc:1145] Deleting tablet 58bb9c7fc599425484fd3fc0b94f3a8c
0928 14:50:32.549556 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.549637 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2144537}
I20260928 14:50:32.550125 9814 tablet_replica.cc:330] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:32.549059 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4744deca899b4e6caa57f70ce1df8a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4744deca899b4e6caa57f70ce1df8a8d already in progress: creating tablet
W20260928 14:50:32.554607 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet be232889594147bdbe2d4825c3e8c7d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be232889594147bdbe2d4825c3e8c7d0 already in progress: creating tablet
W20260928 14:50:32.554795 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet dc8400fdb8d948b084733011b16df1b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc8400fdb8d948b084733011b16df1b3 already in progress: creating tablet
I20260928 14:50:32.554950 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9d5166a828e84d46af3112cdc7bb0a2a (table default.Table_a315096835a54e1a9682f8c89c4e165b [id=7a0021ba6b5b41809d01c7aa03f60bdc]) successfully deleted
I20260928 14:50:32.555114 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6a50b4fe8d86464f933baec07478db25 (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
W20260928 14:50:32.555264 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1b22c3f9578a464a96be0bac6127e56d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b22c3f9578a464a96be0bac6127e56d already in progress: creating tablet
W20260928 14:50:32.555431 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 79f4b20a5e784d909f7297cc7f1b05e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f4b20a5e784d909f7297cc7f1b05e6 already in progress: creating tablet
I20260928 14:50:32.555553 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 399) took 4307 ms. Trace:
W20260928 14:50:32.555572 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4684ba575d9d45f3bb059a15efdd936d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4684ba575d9d45f3bb059a15efdd936d already in progress: creating tablet
W20260928 14:50:32.555742 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1016ad6219294ccd829fca9b264ab06f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1016ad6219294ccd829fca9b264ab06f already in progress: creating tablet
I20260928 14:50:32.556174 9813 rpcz_store.cc:276] 0928 14:50:28.248457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.250295 (+ 1838us) service_pool.cc:227] Handling call
0928 14:50:32.541473 (+4291178us) ts_tablet_manager.cc:1145] Deleting tablet 62d6975813b744fb80dcc432cec61cb4
0928 14:50:32.541482 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.555500 (+ 14018us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4256036}
I20260928 14:50:32.554051 10402 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ae832871bd1142f7af10c084115ffc12" instance_seqno: 1790607017847513) as {username='slave'} at 127.8.181.2:41835; Asking this server to re-register.
I20260928 14:50:32.557700 9814 raft_consensus.cc:2229] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.557226 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 401) took 4306 ms. Trace:
I20260928 14:50:32.558007 9814 pending_rounds.cc:62] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:32.558081 9814 pending_rounds.cc:68] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326397501825024 op_type: NO_OP noop_request { }
I20260928 14:50:32.558269 9813 rpcz_store.cc:276] 0928 14:50:28.250371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.250427 (+ 56us) service_pool.cc:227] Handling call
0928 14:50:32.557050 (+4306623us) ts_tablet_manager.cc:1145] Deleting tablet 1c54cb0e8f2347d9b139c8766fb61ab1
0928 14:50:32.557062 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.557177 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4271543}
I20260928 14:50:32.558911 9814 raft_consensus.cc:2866] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:32.559039 9814 raft_consensus.cc:2258] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.559645 9473 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:32.547979 9851 tablet_bootstrap.cc:654] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.561825 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 400) took 4313 ms. Trace:
I20260928 14:50:32.562619 9813 rpcz_store.cc:276] 0928 14:50:28.248611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.251516 (+ 2905us) service_pool.cc:227] Handling call
0928 14:50:32.561665 (+4310149us) ts_tablet_manager.cc:1145] Deleting tablet 5f348f9e962748a0992d85b9d3d72aeb
0928 14:50:32.561676 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.561765 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4275373}
I20260928 14:50:32.563608 9814 ts_tablet_manager.cc:1905] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.564558 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 402) took 4234 ms. Trace:
I20260928 14:50:32.565006 9813 rpcz_store.cc:276] 0928 14:50:28.329420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.329483 (+ 63us) service_pool.cc:227] Handling call
0928 14:50:32.563441 (+4233958us) ts_tablet_manager.cc:1145] Deleting tablet ab71087d034c4bedb06df9e5ccefad45
0928 14:50:32.563450 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.563544 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4233675}
I20260928 14:50:32.566444 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 403) took 4223 ms. Trace:
I20260928 14:50:32.567619 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 03245f72e0aa496d895968d8e5715b56 (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:32.567579 9813 rpcz_store.cc:276] 0928 14:50:28.342948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.342998 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:32.566303 (+4223305us) ts_tablet_manager.cc:1145] Deleting tablet 8520b28899bc42b08e239502adb8fece
0928 14:50:32.566312 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.566393 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4223086}
I20260928 14:50:32.566740 10404 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" instance_seqno: 1790607017382411) as {username='slave'} at 127.8.181.1:48773; Asking this server to re-register.
I20260928 14:50:32.569686 9332 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:32.572031 9848 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:32.571650 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4a14c0b50cad4954b5dc5666689810ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a14c0b50cad4954b5dc5666689810ba already in progress: creating tablet
W20260928 14:50:32.576037 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 62d6975813b744fb80dcc432cec61cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62d6975813b744fb80dcc432cec61cb4 already in progress: creating tablet
W20260928 14:50:32.576223 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8f2898a032e1488b98c31b5e83371a71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f2898a032e1488b98c31b5e83371a71 already in progress: creating tablet
W20260928 14:50:32.576282 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c54cb0e8f2347d9b139c8766fb61ab1 already in progress: creating tablet
W20260928 14:50:32.576526 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5f348f9e962748a0992d85b9d3d72aeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f348f9e962748a0992d85b9d3d72aeb already in progress: creating tablet
W20260928 14:50:32.576534 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2e16a0f674114ac8b4520fbce2d383d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16a0f674114ac8b4520fbce2d383d8 already in progress: creating tablet
I20260928 14:50:32.576864 9851 tablet_bootstrap.cc:492] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:32.576996 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ad844de91e4040c3a8ae4873c0fa6ba4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad844de91e4040c3a8ae4873c0fa6ba4 already in progress: creating tablet
W20260928 14:50:32.577481 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 56151b288b634d6bb0bc7113afa5fbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56151b288b634d6bb0bc7113afa5fbaa already in progress: creating tablet
I20260928 14:50:32.578223 9851 ts_tablet_manager.cc:1397] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260928 14:50:32.579141 9851 raft_consensus.cc:348] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.579406 10404 ts_manager.cc:194] Registered new tserver with Master: 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.581619 9851 raft_consensus.cc:374] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.581640 10402 ts_manager.cc:194] Registered new tserver with Master: ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.582449 9848 ts_tablet_manager.cc:1397] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.012s
I20260928 14:50:32.582396 9038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 755 } } ignore_live_leader: false dest_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" is_pre_election: true
I20260928 14:50:32.582713 9851 raft_consensus.cc:729] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.583206 9848 raft_consensus.cc:348] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.583436 9848 raft_consensus.cc:374] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.583534 9848 raft_consensus.cc:729] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.583740 9848 consensus_queue.cc:260] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.583227 9851 consensus_queue.cc:260] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.582093 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 414) took 4041 ms. Trace:
I20260928 14:50:32.586783 9813 rpcz_store.cc:276] 0928 14:50:28.540757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.541449 (+ 692us) service_pool.cc:227] Handling call
0928 14:50:32.581023 (+4039574us) ts_tablet_manager.cc:1145] Deleting tablet dc5ee93708ea4f3fabdf93aa9c33c1c8
0928 14:50:32.581034 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.582027 (+ 993us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4035718}
W20260928 14:50:32.587203 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 42b9f78ecb674ae691d407615680ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42b9f78ecb674ae691d407615680ca56 already in progress: creating tablet
W20260928 14:50:32.587472 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f79fcac805b42ba8b66949fbdfeb8f6 already in progress: creating tablet
I20260928 14:50:32.587502 9813 tablet_replica.cc:330] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:32.587744 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8a55156d0bf94b5fbd810d321e78b760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a55156d0bf94b5fbd810d321e78b760 already in progress: creating tablet
W20260928 14:50:32.588047 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 76ad7685ece44665896f687697bddccf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76ad7685ece44665896f687697bddccf already in progress: creating tablet
W20260928 14:50:32.588311 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 58bb9c7fc599425484fd3fc0b94f3a8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58bb9c7fc599425484fd3fc0b94f3a8c already in progress: creating tablet
W20260928 14:50:32.576751 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ab71087d034c4bedb06df9e5ccefad45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab71087d034c4bedb06df9e5ccefad45 already in progress: creating tablet
I20260928 14:50:32.588536 9813 raft_consensus.cc:2229] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:32.588689 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8520b28899bc42b08e239502adb8fece because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8520b28899bc42b08e239502adb8fece already in progress: creating tablet
I20260928 14:50:32.588761 9813 raft_consensus.cc:2258] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:32.588970 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 already in progress: creating tablet
I20260928 14:50:32.589286 9813 ts_tablet_manager.cc:1905] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.589691 9851 ts_tablet_manager.cc:1428] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 14:50:32.589974 9851 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.591612 9851 tablet_bootstrap.cc:654] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.594889 9848 ts_tablet_manager.cc:1428] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260928 14:50:32.595187 9848 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:32.598841 9814 ts_tablet_manager.cc:1918] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.599149 9814 log.cc:1196] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ebaf10326ec24b99ae2ab1ba8779d1a3
I20260928 14:50:32.599318 10545 raft_consensus.cc:482] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.599434 10545 raft_consensus.cc:504] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.600041 10545 leader_election.cc:288] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.600638 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cadfdf093ab04b61af441cff6c9c510b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:32.601245 9497 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.601553 9814 ts_tablet_manager.cc:1939] T ebaf10326ec24b99ae2ab1ba8779d1a3 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.601886 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cadfdf093ab04b61af441cff6c9c510b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:32.602388 9498 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.602486 9498 leader_election.cc:302] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.602851 10545 raft_consensus.cc:2726] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.603008 10403 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" instance_seqno: 1790607018306793) as {username='slave'} at 127.8.181.3:60129; Asking this server to re-register.
I20260928 14:50:32.604643 9614 heartbeater.cc:464] Registering TS with master...
I20260928 14:50:32.608244 8965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6b99976d8024a79a0603523b9d32f29" candidate_term: 5 candidate_status { last_received { term: 4 index: 755 } } ignore_live_leader: false dest_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" is_pre_election: true
I20260928 14:50:32.612545 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 521) took 2210 ms. Trace:
I20260928 14:50:32.612756 9814 rpcz_store.cc:276] 0928 14:50:30.401612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.401659 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:32.550027 (+2148368us) ts_tablet_manager.cc:1145] Deleting tablet ebaf10326ec24b99ae2ab1ba8779d1a3
0928 14:50:32.550037 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.580478 (+ 30441us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.598714 (+ 18236us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.612494 (+ 13780us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2342,"tablet-delete.queue_time_us":2135741}
I20260928 14:50:32.614894 10402 ts_manager.cc:194] Registered new tserver with Master: 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.615934 10581 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:32.616357 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 520) took 2222 ms. Trace:
I20260928 14:50:32.616533 9814 rpcz_store.cc:276] 0928 14:50:30.394066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.394504 (+ 438us) service_pool.cc:227] Handling call
0928 14:50:32.616178 (+2221674us) ts_tablet_manager.cc:1145] Deleting tablet d806161b858145e1a4fa946587ae1529
0928 14:50:32.616190 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.616295 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2200001}
W20260928 14:50:32.616741 9220 consensus_peers.cc:487] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03245f72e0aa496d895968d8e5715b56. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:32.617354 9814 tablet_replica.cc:330] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.618207 9814 raft_consensus.cc:2229] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.618456 9814 raft_consensus.cc:2258] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.618878 9848 tablet_bootstrap.cc:654] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.617372 10363 leader_election.cc:302] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6b99976d8024a79a0603523b9d32f29; no voters: 8d70b1b045bd4ec4b74be2dc2364ecba, c253b9f3f43c4b8ba7cd5c7d4edac656
I20260928 14:50:32.619509 9814 ts_tablet_manager.cc:1905] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.623004 10550 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 14:50:32.628973 9813 ts_tablet_manager.cc:1918] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:32.631692 9813 log.cc:1196] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2f02364b809f4e1c8d558f121d4d88b9
I20260928 14:50:32.632789 9813 ts_tablet_manager.cc:1939] T 2f02364b809f4e1c8d558f121d4d88b9 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.632829 9851 tablet_bootstrap.cc:492] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.634732 9851 ts_tablet_manager.cc:1397] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.002s
I20260928 14:50:32.634840 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 416) took 4068 ms. Trace:
I20260928 14:50:32.635672 9851 raft_consensus.cc:348] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.636039 9851 raft_consensus.cc:374] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.636325 9851 raft_consensus.cc:729] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.636482 9813 rpcz_store.cc:276] 0928 14:50:28.566318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.567061 (+ 743us) service_pool.cc:227] Handling call
0928 14:50:32.587424 (+4020363us) ts_tablet_manager.cc:1145] Deleting tablet 2f02364b809f4e1c8d558f121d4d88b9
0928 14:50:32.587435 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.621551 (+ 34116us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.628778 (+ 7227us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.634806 (+ 6028us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":829,"tablet-delete.queue_time_us":4020069}
I20260928 14:50:32.636693 9851 consensus_queue.cc:260] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.638201 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2f02364b809f4e1c8d558f121d4d88b9 (table default.Table_c90b633274d340ef940d83bcbe55c632 [id=24b463abfd834c8b9c6f579d967741b2]) successfully deleted
W20260928 14:50:32.638312 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc47ae6fbfca4fc0b0b053d0134a49d0 consensus state has no leader
I20260928 14:50:32.638695 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f4fab128ab184dc0b574746a3df0aae3" } modify_external_catalogs: true
I20260928 14:50:32.638899 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f4fab128ab184dc0b574746a3df0aae3" } modify_external_catalogs: true
I20260928 14:50:32.638981 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 417) took 4072 ms. Trace:
I20260928 14:50:32.639181 9813 rpcz_store.cc:276] 0928 14:50:28.566465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.567393 (+ 928us) service_pool.cc:227] Handling call
0928 14:50:32.638584 (+4071191us) ts_tablet_manager.cc:1145] Deleting tablet 8af72ac7bedb4cd7aed28cffda867c96
0928 14:50:32.638596 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.638857 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4070812}
W20260928 14:50:32.639740 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8af72ac7bedb4cd7aed28cffda867c96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af72ac7bedb4cd7aed28cffda867c96 already in progress: creating tablet
I20260928 14:50:32.639715 10580 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:32.640926 9851 ts_tablet_manager.cc:1428] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260928 14:50:32.641585 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 53287us
I20260928 14:50:32.641979 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 418) took 4075 ms. Trace:
I20260928 14:50:32.642318 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.642577 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet e53683279a0c4b41b9ea94e88a84cb94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.644152 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet d004e52539cc49bc8a26f77e0bb182cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.642225 9813 rpcz_store.cc:276] 0928 14:50:28.566580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.567808 (+ 1228us) service_pool.cc:227] Handling call
0928 14:50:32.641754 (+4073946us) ts_tablet_manager.cc:1145] Deleting tablet 82a58b7387564863a2141a722003c5d1
0928 14:50:32.641764 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.641879 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4073728}
I20260928 14:50:32.644961 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 419) took 4078 ms. Trace:
I20260928 14:50:32.645381 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2dd699271542bd9b9604e746686c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.645782 9813 rpcz_store.cc:276] 0928 14:50:28.566673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.568057 (+ 1384us) service_pool.cc:227] Handling call
0928 14:50:32.644845 (+4076788us) ts_tablet_manager.cc:1145] Deleting tablet f1dacb0eef514609bcaf503ccc9845e3
0928 14:50:32.644854 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.644932 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4076595}
I20260928 14:50:32.646236 9851 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.646765 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 415) took 4080 ms. Trace:
I20260928 14:50:32.647053 9813 rpcz_store.cc:276] 0928 14:50:28.566145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.569049 (+ 2904us) service_pool.cc:227] Handling call
0928 14:50:32.646641 (+4077592us) ts_tablet_manager.cc:1145] Deleting tablet cf9342e920ae48278ab3f3c6d639fc94
0928 14:50:32.646650 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.646736 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4077410}
I20260928 14:50:32.647830 9855 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.647959 9851 tablet_bootstrap.cc:654] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.648056 9855 ts_tablet_manager.cc:1397] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.135s user 0.009s sys 0.015s
I20260928 14:50:32.649087 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_304c4f68873343d6a5f9e77b05c8dfcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:32.649012 9855 raft_consensus.cc:348] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.649737 9855 raft_consensus.cc:374] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.649852 9855 raft_consensus.cc:729] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.650106 9855 consensus_queue.cc:260] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.650756 9855 ts_tablet_manager.cc:1428] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:32.651343 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 422) took 4061 ms. Trace:
I20260928 14:50:32.651643 9813 rpcz_store.cc:276] 0928 14:50:28.590206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.590644 (+ 438us) service_pool.cc:227] Handling call
0928 14:50:32.651084 (+4060440us) ts_tablet_manager.cc:1145] Deleting tablet 11f9b039838a430eac3fd422f0f4d087
0928 14:50:32.651094 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.651240 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060225}
I20260928 14:50:32.653689 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 421) took 4062 ms. Trace:
I20260928 14:50:32.655994 9813 rpcz_store.cc:276] 0928 14:50:28.590088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.594627 (+ 4539us) service_pool.cc:227] Handling call
0928 14:50:32.652048 (+4057421us) ts_tablet_manager.cc:1145] Deleting tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b
0928 14:50:32.652058 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.652926 (+ 868us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4057216}
I20260928 14:50:32.656448 9813 tablet_replica.cc:330] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:32.656713 9813 raft_consensus.cc:2229] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.656929 9813 raft_consensus.cc:2258] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.657546 9813 ts_tablet_manager.cc:1905] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.659287 9848 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:32.659526 9848 ts_tablet_manager.cc:1397] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.011s
I20260928 14:50:32.660286 9848 raft_consensus.cc:348] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.660820 9855 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:32.662040 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_304c4f68873343d6a5f9e77b05c8dfcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.662885 9855 tablet_bootstrap.cc:654] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.663110 10563 catalog_manager.cc:1259] Loaded cluster ID: 35cf000337ef4ab2bbd96a43f6589cc7
I20260928 14:50:32.663079 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8ecaaab9b90044d8a46972af10da0676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:32.663249 10563 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: loading cluster ID for follower catalog manager: success
W20260928 14:50:32.663599 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ecaaab9b90044d8a46972af10da0676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.663866 9848 raft_consensus.cc:374] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.664026 9848 raft_consensus.cc:729] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.664577 9814 ts_tablet_manager.cc:1918] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.664459 9848 consensus_queue.cc:260] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.664831 9814 log.cc:1196] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ed0d79a39b2543049506422432990617
I20260928 14:50:32.665508 9814 ts_tablet_manager.cc:1939] T ed0d79a39b2543049506422432990617 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.666792 9851 tablet_bootstrap.cc:492] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.667093 9851 ts_tablet_manager.cc:1397] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20260928 14:50:32.667793 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:32.668473 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.669118 9848 ts_tablet_manager.cc:1428] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260928 14:50:32.668622 9851 raft_consensus.cc:348] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.671017 9851 raft_consensus.cc:374] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.671237 9851 raft_consensus.cc:729] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.671509 9848 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:32.671708 9851 consensus_queue.cc:260] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.677230 9851 ts_tablet_manager.cc:1428] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s
I20260928 14:50:32.679040 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 526) took 1891 ms. Trace:
I20260928 14:50:32.679919 9848 tablet_bootstrap.cc:654] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:32.680644 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 82a58b7387564863a2141a722003c5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82a58b7387564863a2141a722003c5d1 already in progress: creating tablet
W20260928 14:50:32.681694 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f1dacb0eef514609bcaf503ccc9845e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1dacb0eef514609bcaf503ccc9845e3 already in progress: creating tablet
W20260928 14:50:32.681996 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cf9342e920ae48278ab3f3c6d639fc94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf9342e920ae48278ab3f3c6d639fc94 already in progress: creating tablet
W20260928 14:50:32.682256 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 11f9b039838a430eac3fd422f0f4d087 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9b039838a430eac3fd422f0f4d087 already in progress: creating tablet
W20260928 14:50:32.682497 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b already in progress: creating tablet
I20260928 14:50:32.679301 9851 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.689563 9813 ts_tablet_manager.cc:1918] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.691833 9813 log.cc:1196] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ee16f4482a424538812f6356655acf77
I20260928 14:50:32.692337 9813 ts_tablet_manager.cc:1939] T ee16f4482a424538812f6356655acf77 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.692677 9851 tablet_bootstrap.cc:654] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.691697 9848 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:32.692833 9814 rpcz_store.cc:276] 0928 14:50:30.787732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.787787 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:32.617284 (+1829497us) ts_tablet_manager.cc:1145] Deleting tablet ed0d79a39b2543049506422432990617
0928 14:50:32.617294 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.629882 (+ 12588us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.664415 (+ 34533us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.679005 (+ 14590us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1828941}
I20260928 14:50:32.693698 9848 ts_tablet_manager.cc:1397] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.005s
I20260928 14:50:32.694185 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 525) took 1906 ms. Trace:
I20260928 14:50:32.694470 9814 rpcz_store.cc:276] 0928 14:50:30.787465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.787976 (+ 511us) service_pool.cc:227] Handling call
0928 14:50:32.693937 (+1905961us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5afbdeda4ddfb82124031135e6cb
0928 14:50:32.693948 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.694101 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1905193}
I20260928 14:50:32.694605 9848 raft_consensus.cc:348] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.695708 9848 raft_consensus.cc:374] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.695930 9848 raft_consensus.cc:729] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.696065 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 527) took 1873 ms. Trace:
I20260928 14:50:32.696275 9814 rpcz_store.cc:276] 0928 14:50:30.821748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.821806 (+ 58us) service_pool.cc:227] Handling call
0928 14:50:32.694844 (+1873038us) ts_tablet_manager.cc:1145] Deleting tablet bd9cedadc7184013a37857206bec2ff0
0928 14:50:32.694854 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.694967 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1872828}
I20260928 14:50:32.696251 9848 consensus_queue.cc:260] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.696825 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 528) took 1837 ms. Trace:
I20260928 14:50:32.696936 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 441) took 4033 ms. Trace:
I20260928 14:50:32.697022 9814 rpcz_store.cc:276] 0928 14:50:30.859643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.859696 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:32.696655 (+1836959us) ts_tablet_manager.cc:1145] Deleting tablet 299ed0acd7cf46d3b78f4f4cea31858f
0928 14:50:32.696664 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.696753 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1835456}
I20260928 14:50:32.697502 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 530) took 1817 ms. Trace:
I20260928 14:50:32.698913 9814 rpcz_store.cc:276] 0928 14:50:30.880071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.880124 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:32.697259 (+1817135us) ts_tablet_manager.cc:1145] Deleting tablet a7be6013a04c4222ab34a19e77e48a37
0928 14:50:32.697268 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.697400 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1816888}
I20260928 14:50:32.699290 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 529) took 1820 ms. Trace:
I20260928 14:50:32.699469 9814 rpcz_store.cc:276] 0928 14:50:30.879157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.880984 (+ 1827us) service_pool.cc:227] Handling call
0928 14:50:32.699145 (+1818161us) ts_tablet_manager.cc:1145] Deleting tablet c163d657ec4f40598d7f4f3879e6d817
0928 14:50:32.699155 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.699257 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817914}
I20260928 14:50:32.699752 9814 tablet_replica.cc:330] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.699950 9814 raft_consensus.cc:2229] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.700213 9814 pending_rounds.cc:62] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:32.700388 9814 pending_rounds.cc:68] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326400519770112 op_type: NO_OP noop_request { }
I20260928 14:50:32.700551 9814 raft_consensus.cc:2866] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:32.700661 9814 raft_consensus.cc:2258] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.701229 9814 ts_tablet_manager.cc:1905] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.697412 9813 rpcz_store.cc:276] 0928 14:50:28.660431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.730942 (+ 70511us) service_pool.cc:227] Handling call
0928 14:50:32.656396 (+3925454us) ts_tablet_manager.cc:1145] Deleting tablet ee16f4482a424538812f6356655acf77
0928 14:50:32.656405 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.681634 (+ 25229us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.689432 (+ 7798us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.693506 (+ 4074us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3925162}
I20260928 14:50:32.703806 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:32.704428 9813 tablet_replica.cc:330] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:32.704949 9813 raft_consensus.cc:2229] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.707180 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ee16f4482a424538812f6356655acf77 (table default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:32.707299 9284 raft_consensus.cc:3037] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.707824 9848 ts_tablet_manager.cc:1428] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 14:50:32.708130 9848 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:32.708419 9851 tablet_bootstrap.cc:492] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.708555 9851 ts_tablet_manager.cc:1397] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260928 14:50:32.709273 9851 raft_consensus.cc:348] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.709478 9851 raft_consensus.cc:374] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.709579 9851 raft_consensus.cc:729] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.709782 9848 tablet_bootstrap.cc:654] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.709884 9851 consensus_queue.cc:260] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.710340 9813 raft_consensus.cc:2258] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.710992 9813 ts_tablet_manager.cc:1905] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.712064 9851 ts_tablet_manager.cc:1428] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:32.712358 9851 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.714668 10545 raft_consensus.cc:482] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.714792 10545 raft_consensus.cc:504] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.715320 10545 leader_election.cc:288] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.716555 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.716817 9425 raft_consensus.cc:2454] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:32.714490 9851 tablet_bootstrap.cc:654] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.717355 9498 leader_election.cc:302] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:32.716172 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.719452 9814 ts_tablet_manager.cc:1918] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.719568 9814 log.cc:1196] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/03245f72e0aa496d895968d8e5715b56
W20260928 14:50:32.719846 9497 leader_election.cc:341] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.719990 9814 ts_tablet_manager.cc:1939] T 03245f72e0aa496d895968d8e5715b56 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.720297 10545 raft_consensus.cc:2781] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:32.720392 10545 raft_consensus.cc:482] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:32.720461 10545 raft_consensus.cc:3037] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.720682 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5a6755b697134b8e90e457b554b9599c
I20260928 14:50:32.720768 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 531) took 1817 ms. Trace:
I20260928 14:50:32.720849 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2949cff5a7694015ad1708ed7fab3447
I20260928 14:50:32.720906 9814 rpcz_store.cc:276] 0928 14:50:30.902875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.905736 (+ 2861us) service_pool.cc:227] Handling call
0928 14:50:32.699683 (+1793947us) ts_tablet_manager.cc:1145] Deleting tablet 03245f72e0aa496d895968d8e5715b56
0928 14:50:32.699708 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.704527 (+ 4819us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.719325 (+ 14798us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.720736 (+ 1411us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1790011}
I20260928 14:50:32.721570 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 157e807a962749028b1c8df00846295a
I20260928 14:50:32.722023 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1f012857690f4f91a941a5f642b9c989
I20260928 14:50:32.722874 10545 raft_consensus.cc:504] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.723886 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.724216 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.724435 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.724819 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f012857690f4f91a941a5f642b9c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.725553 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:32.726151 9497 leader_election.cc:341] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.726293 10592 tablet.cc:1722] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:32.726970 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:32.727228 9425 raft_consensus.cc:3037] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.727715 9170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 157e807a962749028b1c8df00846295a
I20260928 14:50:32.728084 9170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2949cff5a7694015ad1708ed7fab3447
I20260928 14:50:32.730728 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 532) took 1753 ms. Trace:
I20260928 14:50:32.730891 10545 leader_election.cc:288] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:32.730944 9814 rpcz_store.cc:276] 0928 14:50:30.977170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.977221 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:32.730537 (+1753316us) ts_tablet_manager.cc:1145] Deleting tablet e760d7e556a54fda9dc91300b9968c68
0928 14:50:32.730547 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.730631 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1753078}
I20260928 14:50:32.730727 9425 raft_consensus.cc:2454] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:32.731606 9498 leader_election.cc:302] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.732045 10545 raft_consensus.cc:2781] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.732156 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]). Expected version 1 got 0
I20260928 14:50:32.732355 10545 raft_consensus.cc:686] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:32.732787 10545 consensus_queue.cc:237] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:32.734284 9814 tablet_replica.cc:330] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.734504 9814 raft_consensus.cc:2229] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.734652 9814 raft_consensus.cc:2258] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.735127 9814 ts_tablet_manager.cc:1905] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.737576 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.737982 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.738668 9392 tablet_service.cc:1467] Processing CreateTablet for tablet cacb6cd51f3b4f238813e764818767c2 (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.739229 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacb6cd51f3b4f238813e764818767c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.739391 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 8766eb621974471c9c8c5850088f4b54 (DEFAULT_TABLE table=default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d [id=a0edecbcedf34c84aceda137e6062752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.739742 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8766eb621974471c9c8c5850088f4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.740201 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0e7323af5cb8442585fc497fd5029809" } new_table_name: "default.Table_1c52977bce7f4827a0f457d17e965e7b" modify_external_catalogs: true
I20260928 14:50:32.741793 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1a4386a2fcb74bed9056deabd39257e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:32.742340 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a4386a2fcb74bed9056deabd39257e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.742208 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 157e807a962749028b1c8df00846295a (DEFAULT_TABLE table=default.Table_7d04d70ad3e447aba07ae7ac26a0204b [id=e338d46ff6264d03b5599b0858a3f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.742815 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157e807a962749028b1c8df00846295a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.744800 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f338945deb424cb4b3e267df128a7786" } new_table_name: "default.Table_9c87471cc78542fbb74b4d96524b1144" modify_external_catalogs: true
I20260928 14:50:32.745930 9851 tablet_bootstrap.cc:492] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.745999 9393 tablet_service.cc:1467] Processing CreateTablet for tablet d604978c5289471a854c9b286d137f61 (DEFAULT_TABLE table=default.Table_7dbee54af11845d4b4ecf8bd3fe1e953 [id=1878405c00714b7888444ed8d5312d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.746207 9851 ts_tablet_manager.cc:1397] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.005s
I20260928 14:50:32.746359 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d604978c5289471a854c9b286d137f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.746805 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5bf215c87d4d499286d9824a4a711ea2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:32.747507 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bf215c87d4d499286d9824a4a711ea2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:32.747675 9851 raft_consensus.cc:348] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.747893 9851 raft_consensus.cc:374] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.747952 9851 raft_consensus.cc:729] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.748190 9851 consensus_queue.cc:260] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.749765 10386 raft_consensus.cc:482] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.749895 10386 raft_consensus.cc:504] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.750499 10386 leader_election.cc:288] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:32.751442 9219 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:32.751881 9851 ts_tablet_manager.cc:1428] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260928 14:50:32.753315 9851 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:32.758306 9220 leader_election.cc:341] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:32.758498 9220 leader_election.cc:302] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:32.758993 10386 raft_consensus.cc:2726] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:32.759622 9851 tablet_bootstrap.cc:654] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.759652 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 11f9b039838a430eac3fd422f0f4d087 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:32.760347 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 7a2f051a09e143b8bb0ba3be81406b98 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:32.763854 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efc95c0861c9489ab6df340fc53e310d consensus state has no leader
W20260928 14:50:32.767496 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5eb8907be064167a3739715d24c94e9 consensus state has no leader
I20260928 14:50:32.767935 9814 ts_tablet_manager.cc:1918] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.768060 9814 log.cc:1196] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7b47d891c9264a03ac11f50f2b56edad
I20260928 14:50:32.768337 9814 ts_tablet_manager.cc:1939] T 7b47d891c9264a03ac11f50f2b56edad P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.769025 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 540) took 1605 ms. Trace:
I20260928 14:50:32.769119 9814 rpcz_store.cc:276] 0928 14:50:31.163882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.163932 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:32.733862 (+1569930us) ts_tablet_manager.cc:1145] Deleting tablet 7b47d891c9264a03ac11f50f2b56edad
0928 14:50:32.733938 (+ 76us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.761944 (+ 28006us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.767849 (+ 5905us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.768979 (+ 1130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1569671}
I20260928 14:50:32.771018 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 8234670cb2604ba7b405ad7f70e03a2f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:32.772898 8946 catalog_manager.cc:5495] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:32.773435 8946 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:32.773773 8946 catalog_manager.cc:5495] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:32.774261 8946 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
I20260928 14:50:32.775918 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ebaf10326ec24b99ae2ab1ba8779d1a3 (table default.Table_7fef1dc0110344edb4f6e3ffb68382c0 [id=f0a8543b19844c25ab517cf52806c37f]) successfully deleted
W20260928 14:50:32.776194 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d806161b858145e1a4fa946587ae1529 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d806161b858145e1a4fa946587ae1529 already in progress: creating tablet
I20260928 14:50:32.776453 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ed0d79a39b2543049506422432990617 (table default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]) successfully deleted
W20260928 14:50:32.776729 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9f2c5afbdeda4ddfb82124031135e6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5afbdeda4ddfb82124031135e6cb already in progress: creating tablet
W20260928 14:50:32.776993 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet bd9cedadc7184013a37857206bec2ff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd9cedadc7184013a37857206bec2ff0 already in progress: creating tablet
W20260928 14:50:32.777216 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 299ed0acd7cf46d3b78f4f4cea31858f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 299ed0acd7cf46d3b78f4f4cea31858f already in progress: creating tablet
W20260928 14:50:32.777443 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a7be6013a04c4222ab34a19e77e48a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7be6013a04c4222ab34a19e77e48a37 already in progress: creating tablet
W20260928 14:50:32.777710 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c163d657ec4f40598d7f4f3879e6d817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c163d657ec4f40598d7f4f3879e6d817 already in progress: creating tablet
I20260928 14:50:32.782418 9851 tablet_bootstrap.cc:492] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.782552 9851 ts_tablet_manager.cc:1397] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260928 14:50:32.783294 9851 raft_consensus.cc:348] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.783525 9851 raft_consensus.cc:374] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.783627 9851 raft_consensus.cc:729] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.783650 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7a2f051a09e143b8bb0ba3be81406b98
I20260928 14:50:32.783881 9851 consensus_queue.cc:260] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.784265 8950 catalog_manager.cc:6565] ReplaceTablet: tablet 7a2f051a09e143b8bb0ba3be81406b98 deleted and replaced by tablet 167abd4bc50d43cb98d667be90ea278a
I20260928 14:50:32.784932 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 167abd4bc50d43cb98d667be90ea278a) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:32.786412 9813 ts_tablet_manager.cc:1918] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.786684 9851 ts_tablet_manager.cc:1428] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:32.786955 9851 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.788548 9851 tablet_bootstrap.cc:654] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.788550 9813 log.cc:1196] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/bc3e689e2ffa4edb8ef1004287e40c99
I20260928 14:50:32.789445 9813 ts_tablet_manager.cc:1939] T bc3e689e2ffa4edb8ef1004287e40c99 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.790186 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 541) took 1594 ms. Trace:
I20260928 14:50:32.790387 9814 rpcz_store.cc:276] 0928 14:50:31.195535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.195864 (+ 329us) service_pool.cc:227] Handling call
0928 14:50:32.789851 (+1593987us) ts_tablet_manager.cc:1145] Deleting tablet cbb232c73f014351b796a86180ffb660
0928 14:50:32.789860 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.790011 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1591394}
I20260928 14:50:32.791204 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 542) took 1591 ms. Trace:
I20260928 14:50:32.791332 9814 rpcz_store.cc:276] 0928 14:50:31.199775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.199819 (+ 44us) service_pool.cc:227] Handling call
0928 14:50:32.790910 (+1591091us) ts_tablet_manager.cc:1145] Deleting tablet 010e4f56e85a44d6a1f7524217d3cc58
0928 14:50:32.790942 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.791054 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1590907}
I20260928 14:50:32.792573 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 443) took 3937 ms. Trace:
I20260928 14:50:32.793551 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 543) took 1584 ms. Trace:
I20260928 14:50:32.793735 9814 rpcz_store.cc:276] 0928 14:50:31.207665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.207718 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:32.791674 (+1583956us) ts_tablet_manager.cc:1145] Deleting tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f
0928 14:50:32.791832 (+ 158us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.791929 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1583786}
I20260928 14:50:32.794400 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 544) took 1496 ms. Trace:
I20260928 14:50:32.794871 9814 rpcz_store.cc:276] 0928 14:50:31.297467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.297558 (+ 91us) service_pool.cc:227] Handling call
0928 14:50:32.794110 (+1496552us) ts_tablet_manager.cc:1145] Deleting tablet 846a96509f32416087ee4667458c367e
0928 14:50:32.794120 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.794233 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455650}
I20260928 14:50:32.794627 9813 rpcz_store.cc:276] 0928 14:50:28.855509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.857616 (+ 2107us) service_pool.cc:227] Handling call
0928 14:50:32.704342 (+3846726us) ts_tablet_manager.cc:1145] Deleting tablet bc3e689e2ffa4edb8ef1004287e40c99
0928 14:50:32.704355 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.715483 (+ 11128us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.786287 (+ 70804us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.792537 (+ 6250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3822595}
I20260928 14:50:32.795449 9814 tablet_replica.cc:330] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.795655 9814 raft_consensus.cc:2229] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.795897 9814 pending_rounds.cc:62] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:32.795965 9814 pending_rounds.cc:68] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326404490338304 op_type: NO_OP noop_request { }
I20260928 14:50:32.796195 9814 raft_consensus.cc:2866] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:32.796128 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet bc3e689e2ffa4edb8ef1004287e40c99 (table default.Table_74388823ef59495e8cc13452d0033e0c [id=011947823839453e80127487ef4562b9]) successfully deleted
I20260928 14:50:32.796309 9814 raft_consensus.cc:2258] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.796816 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 442) took 3950 ms. Trace:
I20260928 14:50:32.797859 9813 rpcz_store.cc:276] 0928 14:50:28.849368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:28.850223 (+ 855us) service_pool.cc:227] Handling call
0928 14:50:32.796671 (+3946448us) ts_tablet_manager.cc:1145] Deleting tablet 7a70f70162c2433aab5136514bd5fc03
0928 14:50:32.796682 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.796785 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3912018}
W20260928 14:50:32.798918 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7a70f70162c2433aab5136514bd5fc03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a70f70162c2433aab5136514bd5fc03 already in progress: creating tablet
I20260928 14:50:32.799538 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 447) took 3643 ms. Trace:
I20260928 14:50:32.799624 9814 ts_tablet_manager.cc:1905] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.800570 9813 rpcz_store.cc:276] 0928 14:50:29.156517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.156566 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:32.799414 (+3642848us) ts_tablet_manager.cc:1145] Deleting tablet 5b695c68118b49359f1899d30208b1b7
0928 14:50:32.799424 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.799509 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3634745}
I20260928 14:50:32.801268 9851 tablet_bootstrap.cc:492] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.801411 9851 ts_tablet_manager.cc:1397] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260928 14:50:32.800756 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 03245f72e0aa496d895968d8e5715b56 (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:32.801687 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 7abafb4f6c6948a4a27a1862a61f4a80 (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.802196 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abafb4f6c6948a4a27a1862a61f4a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.802152 9851 raft_consensus.cc:348] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.802367 9851 raft_consensus.cc:374] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.802439 9851 raft_consensus.cc:729] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.802695 9851 consensus_queue.cc:260] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:32.801883 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e760d7e556a54fda9dc91300b9968c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e760d7e556a54fda9dc91300b9968c68 already in progress: creating tablet
I20260928 14:50:32.803903 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7b47d891c9264a03ac11f50f2b56edad (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
W20260928 14:50:32.804076 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cbb232c73f014351b796a86180ffb660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbb232c73f014351b796a86180ffb660 already in progress: creating tablet
W20260928 14:50:32.804281 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 010e4f56e85a44d6a1f7524217d3cc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 010e4f56e85a44d6a1f7524217d3cc58 already in progress: creating tablet
W20260928 14:50:32.804471 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f already in progress: creating tablet
W20260928 14:50:32.804709 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 846a96509f32416087ee4667458c367e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846a96509f32416087ee4667458c367e already in progress: creating tablet
W20260928 14:50:32.805091 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5b695c68118b49359f1899d30208b1b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b695c68118b49359f1899d30208b1b7 already in progress: creating tablet
I20260928 14:50:32.805233 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc4c49a4962473699103528b64a1005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.805420 10386 raft_consensus.cc:482] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.805490 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 2949cff5a7694015ad1708ed7fab3447 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.805562 10386 raft_consensus.cc:504] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.805891 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2949cff5a7694015ad1708ed7fab3447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.806107 10386 leader_election.cc:288] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:32.807032 9219 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cf2dd699271542bd9b9604e746686c53
I20260928 14:50:32.812052 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2dd699271542bd9b9604e746686c53" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:32.812403 9425 raft_consensus.cc:2454] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:32.812870 9220 leader_election.cc:302] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:32.813294 10386 raft_consensus.cc:2781] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:32.813396 10386 raft_consensus.cc:482] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:32.813467 10386 raft_consensus.cc:3037] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.815023 9851 ts_tablet_manager.cc:1428] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 14:50:32.815536 9851 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.816721 10386 raft_consensus.cc:504] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.818413 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2dd699271542bd9b9604e746686c53" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:32.818746 9425 raft_consensus.cc:3037] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:32.819284 9219 leader_election.cc:341] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cf2dd699271542bd9b9604e746686c53
I20260928 14:50:32.820672 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
I20260928 14:50:32.822539 9425 raft_consensus.cc:2454] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:32.823042 9220 leader_election.cc:302] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:32.823653 10557 raft_consensus.cc:2781] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.823957 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 444) took 3667 ms. Trace:
I20260928 14:50:32.824301 9813 rpcz_store.cc:276] 0928 14:50:29.156223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.156714 (+ 491us) service_pool.cc:227] Handling call
0928 14:50:32.823614 (+3666900us) ts_tablet_manager.cc:1145] Deleting tablet 9a753aaf7f8c4498b6ba35fa27d8c537
0928 14:50:32.823723 (+ 109us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.823866 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3658758}
I20260928 14:50:32.824458 9851 tablet_bootstrap.cc:654] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:32.824816 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a753aaf7f8c4498b6ba35fa27d8c537 already in progress: creating tablet
I20260928 14:50:32.824447 10557 raft_consensus.cc:686] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:32.826042 10386 leader_election.cc:288] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.826510 10557 consensus_queue.cc:237] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.828320 9813 tablet_replica.cc:330] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:32.829623 9813 raft_consensus.cc:2229] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.830646 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
I20260928 14:50:32.831395 9813 raft_consensus.cc:2258] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.832139 9814 ts_tablet_manager.cc:1918] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:32.832402 9814 log.cc:1196] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ee16f4482a424538812f6356655acf77
I20260928 14:50:32.833019 9814 ts_tablet_manager.cc:1939] T ee16f4482a424538812f6356655acf77 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.833904 9813 ts_tablet_manager.cc:1905] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.839165 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 (DEFAULT_TABLE table=default.Table_5d0fbca4e50f401d8c88395a7002e74d [id=dfdfbc982a7e46f288280b6bb8daadfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.839289 10556 raft_consensus.cc:482] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.839476 10556 raft_consensus.cc:504] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.839913 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet f095e4cbf95147d9afb83434ae1fd29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.840029 10556 leader_election.cc:288] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.840098 9855 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:32.840648 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:32.840847 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fdb3daaea744a8b9170325440e81ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.841253 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet c9a7573c751d412aa8394d6277c28b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 764f0ee9d8a149e3a295fe790beb1019) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:32.841281 9360 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.842769 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 551) took 1298 ms. Trace:
I20260928 14:50:32.842954 9814 rpcz_store.cc:276] 0928 14:50:31.544417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.545917 (+ 1500us) service_pool.cc:227] Handling call
0928 14:50:32.795315 (+1249398us) ts_tablet_manager.cc:1145] Deleting tablet ee16f4482a424538812f6356655acf77
0928 14:50:32.795324 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.826398 (+ 31074us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.832032 (+ 5634us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.842572 (+ 10540us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246189}
I20260928 14:50:32.843312 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet f3dee7ff6d5544908cdd9dbd45ce521a with delete_type TABLET_DATA_DELETED (replaced by tablet f39c1da071164342aea8eab263d4eebb) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.848121 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 558) took 1302 ms. Trace:
I20260928 14:50:32.848316 9814 rpcz_store.cc:276] 0928 14:50:31.545167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.546059 (+ 892us) service_pool.cc:227] Handling call
0928 14:50:32.847385 (+1301326us) ts_tablet_manager.cc:1145] Deleting tablet 69239e1cc64f40e59f14c3716437de54
0928 14:50:32.847396 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.847574 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291019}
I20260928 14:50:32.840221 9855 ts_tablet_manager.cc:1397] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.179s user 0.010s sys 0.016s
I20260928 14:50:32.840538 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:32.849787 9568 raft_consensus.cc:2454] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:32.850339 9360 leader_election.cc:302] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters: 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:32.850867 10556 raft_consensus.cc:2781] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:32.851130 10556 raft_consensus.cc:482] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:32.851332 10556 raft_consensus.cc:3037] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.853405 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 557) took 1308 ms. Trace:
I20260928 14:50:32.854621 9814 rpcz_store.cc:276] 0928 14:50:31.545048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.546036 (+ 988us) service_pool.cc:227] Handling call
0928 14:50:32.852969 (+1306933us) ts_tablet_manager.cc:1145] Deleting tablet 4ea3bb5f742c46d796696c0131b97e68
0928 14:50:32.852979 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.853312 (+ 333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1296493}
I20260928 14:50:32.855085 10557 raft_consensus.cc:482] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:32.855223 10556 raft_consensus.cc:504] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.855358 10557 raft_consensus.cc:504] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.856703 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:32.856901 9568 raft_consensus.cc:3037] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.856922 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095e4cbf95147d9afb83434ae1fd29f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:32.857138 9219 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:32.857246 9425 raft_consensus.cc:2454] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:32.856786 10557 leader_election.cc:288] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.857963 9220 leader_election.cc:302] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:32.859251 10557 raft_consensus.cc:2781] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:32.859465 10557 raft_consensus.cc:482] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:32.859663 9568 raft_consensus.cc:2454] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:32.859862 10557 raft_consensus.cc:3037] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.859921 9851 tablet_bootstrap.cc:492] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:32.860069 9851 ts_tablet_manager.cc:1397] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.005s
I20260928 14:50:32.860721 9360 leader_election.cc:302] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:32.860833 9851 raft_consensus.cc:348] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.861150 10549 raft_consensus.cc:2781] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.861171 9851 raft_consensus.cc:374] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.861367 9851 raft_consensus.cc:729] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.861372 10549 raft_consensus.cc:686] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:32.861720 9851 consensus_queue.cc:260] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.862059 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.862196 10549 consensus_queue.cc:237] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.862799 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.863332 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.864463 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.865823 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.866576 10556 leader_election.cc:288] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:32.866642 9851 ts_tablet_manager.cc:1428] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260928 14:50:32.867849 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d27a357d905e463ba9507f74e575acb1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:32.868566 9360 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:32.868630 10563 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: acquiring CA information for follower catalog manager: success
I20260928 14:50:32.869853 9851 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:32.871344 10557 raft_consensus.cc:504] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.872316 9851 tablet_bootstrap.cc:654] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.872051 9814 tablet_replica.cc:330] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.872958 9814 raft_consensus.cc:2229] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.873211 9814 raft_consensus.cc:2258] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.873512 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095e4cbf95147d9afb83434ae1fd29f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:32.873930 9425 raft_consensus.cc:3037] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:32.874150 9814 ts_tablet_manager.cc:1905] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.877245 9425 raft_consensus.cc:2454] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:32.877784 9220 leader_election.cc:302] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:32.878208 10386 raft_consensus.cc:2781] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:32.878396 10386 raft_consensus.cc:686] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:32.878722 10386 consensus_queue.cc:237] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.890849 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.892231 9848 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:32.895865 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f012857690f4f91a941a5f642b9c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.896277 9815 tablet_replica.cc:330] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:32.896449 9815 raft_consensus.cc:2229] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:32.896615 9815 raft_consensus.cc:2258] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.897403 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.898006 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.898424 9848 ts_tablet_manager.cc:1397] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.190s user 0.009s sys 0.005s
I20260928 14:50:32.899175 9536 tablet_service.cc:1467] Processing CreateTablet for tablet cacb6cd51f3b4f238813e764818767c2 (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.899572 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacb6cd51f3b4f238813e764818767c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.899832 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 157e807a962749028b1c8df00846295a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.900712 9265 tablet_service.cc:1467] Processing CreateTablet for tablet cacb6cd51f3b4f238813e764818767c2 (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:32.901355 9219 leader_election.cc:341] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:32.901501 9814 ts_tablet_manager.cc:1918] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.901556 10557 leader_election.cc:288] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:32.901847 9814 log.cc:1196] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d004e52539cc49bc8a26f77e0bb182cc
I20260928 14:50:32.901906 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f012857690f4f91a941a5f642b9c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.902418 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacb6cd51f3b4f238813e764818767c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.902542 9814 ts_tablet_manager.cc:1939] T d004e52539cc49bc8a26f77e0bb182cc P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:32.903393 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 2949cff5a7694015ad1708ed7fab3447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.903888 9814 tablet_replica.cc:330] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:32.904284 9814 raft_consensus.cc:2229] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:32.904664 9814 pending_rounds.cc:62] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:32.904863 9814 pending_rounds.cc:68] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326406461526016 op_type: NO_OP noop_request { }
I20260928 14:50:32.905115 9814 raft_consensus.cc:2866] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:32.905325 9814 raft_consensus.cc:2258] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:32.907063 9267 tablet_service.cc:1467] Processing CreateTablet for tablet d604978c5289471a854c9b286d137f61 (DEFAULT_TABLE table=default.Table_7dbee54af11845d4b4ecf8bd3fe1e953 [id=1878405c00714b7888444ed8d5312d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.907770 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d604978c5289471a854c9b286d137f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.907866 9814 ts_tablet_manager.cc:1905] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.907858 9848 raft_consensus.cc:348] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.908131 9848 raft_consensus.cc:374] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.908209 9848 raft_consensus.cc:729] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.908987 9536 tablet_service.cc:1467] Processing CreateTablet for tablet d604978c5289471a854c9b286d137f61 (DEFAULT_TABLE table=default.Table_7dbee54af11845d4b4ecf8bd3fe1e953 [id=1878405c00714b7888444ed8d5312d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.909348 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d604978c5289471a854c9b286d137f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.912569 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 157e807a962749028b1c8df00846295a (DEFAULT_TABLE table=default.Table_7d04d70ad3e447aba07ae7ac26a0204b [id=e338d46ff6264d03b5599b0858a3f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.912897 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157e807a962749028b1c8df00846295a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.917352 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 167abd4bc50d43cb98d667be90ea278a) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:32.917976 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 8766eb621974471c9c8c5850088f4b54 (DEFAULT_TABLE table=default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d [id=a0edecbcedf34c84aceda137e6062752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.918370 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8766eb621974471c9c8c5850088f4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.926959 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 6891077c78ef4f3d84e33283096ddf7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.927925 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 157e807a962749028b1c8df00846295a (DEFAULT_TABLE table=default.Table_7d04d70ad3e447aba07ae7ac26a0204b [id=e338d46ff6264d03b5599b0858a3f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.928045 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet bad2124268994f04ae7153ea5aaeeab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.928627 9815 ts_tablet_manager.cc:1905] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:32.930824 9855 raft_consensus.cc:348] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.934944 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157e807a962749028b1c8df00846295a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.936158 9855 raft_consensus.cc:374] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:32.934655 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 7abafb4f6c6948a4a27a1862a61f4a80 (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.936419 9855 raft_consensus.cc:729] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:32.936753 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abafb4f6c6948a4a27a1862a61f4a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.936990 9855 consensus_queue.cc:260] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:32.938108 9855 ts_tablet_manager.cc:1428] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.089s user 0.002s sys 0.000s
I20260928 14:50:32.934333 9815 ts_tablet_manager.cc:1918] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:32.943032 9815 log.cc:1196] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1f012857690f4f91a941a5f642b9c989
I20260928 14:50:32.943380 9815 ts_tablet_manager.cc:1939] T 1f012857690f4f91a941a5f642b9c989 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:32.944737 9855 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:32.935866 9848 consensus_queue.cc:260] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:32.946297 9848 ts_tablet_manager.cc:1428] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260928 14:50:32.946353 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 8766eb621974471c9c8c5850088f4b54 (DEFAULT_TABLE table=default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d [id=a0edecbcedf34c84aceda137e6062752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.946818 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8766eb621974471c9c8c5850088f4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.946895 9848 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:32.949115 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e53683279a0c4b41b9ea94e88a84cb94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e53683279a0c4b41b9ea94e88a84cb94 already in progress: creating tablet
W20260928 14:50:32.949559 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5a6755b697134b8e90e457b554b9599c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a6755b697134b8e90e457b554b9599c already in progress: creating tablet
W20260928 14:50:32.949852 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because the tablet was not found. No further retry: Not found: Tablet not found: 2949cff5a7694015ad1708ed7fab3447
W20260928 14:50:32.950336 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 157e807a962749028b1c8df00846295a because the tablet was not found. No further retry: Not found: Tablet not found: 157e807a962749028b1c8df00846295a
I20260928 14:50:32.951731 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1f012857690f4f91a941a5f642b9c989 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
W20260928 14:50:32.951987 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 157e807a962749028b1c8df00846295a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157e807a962749028b1c8df00846295a already in progress: creating tablet
I20260928 14:50:32.952410 10557 raft_consensus.cc:482] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:32.953472 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because the tablet was not found. No further retry: Not found: Tablet not found: 2949cff5a7694015ad1708ed7fab3447
W20260928 14:50:32.953907 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7a2f051a09e143b8bb0ba3be81406b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2f051a09e143b8bb0ba3be81406b98 already in progress: creating tablet
I20260928 14:50:32.954721 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 167abd4bc50d43cb98d667be90ea278a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.955157 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 2949cff5a7694015ad1708ed7fab3447 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.955199 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.955358 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 7abafb4f6c6948a4a27a1862a61f4a80 (DEFAULT_TABLE table=default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.955703 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2949cff5a7694015ad1708ed7fab3447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.956431 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abafb4f6c6948a4a27a1862a61f4a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.957230 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 (DEFAULT_TABLE table=default.Table_5d0fbca4e50f401d8c88395a7002e74d [id=dfdfbc982a7e46f288280b6bb8daadfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.957792 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fdb3daaea744a8b9170325440e81ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.966094 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 (DEFAULT_TABLE table=default.Table_5d0fbca4e50f401d8c88395a7002e74d [id=dfdfbc982a7e46f288280b6bb8daadfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:32.966492 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fdb3daaea744a8b9170325440e81ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:32.972961 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 311e4286b2a943ee924ac1c25dc9ca46 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f9b6cbf2d949839216e807130b2eb9) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:32.978456 9848 tablet_bootstrap.cc:654] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:32.979537 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ee16f4482a424538812f6356655acf77 (table default.Table_f5bcc70b7720421fad8a94e37bbd663d [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
W20260928 14:50:32.979964 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 69239e1cc64f40e59f14c3716437de54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69239e1cc64f40e59f14c3716437de54 already in progress: creating tablet
W20260928 14:50:32.980386 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4ea3bb5f742c46d796696c0131b97e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ea3bb5f742c46d796696c0131b97e68 already in progress: creating tablet
W20260928 14:50:32.980746 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8a06859c8dcc41d99d29365aae350afa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a06859c8dcc41d99d29365aae350afa already in progress: creating tablet
W20260928 14:50:32.980942 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1eaafbd52e464862ae0f0d44ffae58cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eaafbd52e464862ae0f0d44ffae58cf already in progress: creating tablet
W20260928 14:50:32.981177 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 504c0f61d8844bd18062a3b40cd6f8ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 504c0f61d8844bd18062a3b40cd6f8ce already in progress: creating tablet
W20260928 14:50:32.981420 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 835ba6c803a34707b77bb8bc280b9e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 835ba6c803a34707b77bb8bc280b9e68 already in progress: creating tablet
W20260928 14:50:32.981633 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f39c1da071164342aea8eab263d4eebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f39c1da071164342aea8eab263d4eebb already in progress: creating tablet
W20260928 14:50:32.981832 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6d193edcfa684b8795b084f3106903c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d193edcfa684b8795b084f3106903c5 already in progress: creating tablet
W20260928 14:50:32.982012 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e53683279a0c4b41b9ea94e88a84cb94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e53683279a0c4b41b9ea94e88a84cb94 already in progress: creating tablet
I20260928 14:50:32.990111 9813 ts_tablet_manager.cc:1918] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 14:50:32.990939 9813 log.cc:1196] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/3d27738fcfbc42f298e26149dfd28182
I20260928 14:50:32.992365 9813 ts_tablet_manager.cc:1939] T 3d27738fcfbc42f298e26149dfd28182 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:32.993458 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 446) took 3836 ms. Trace:
I20260928 14:50:32.994122 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d004e52539cc49bc8a26f77e0bb182cc (table default.Table_c3faaac521464670a4b981a20d62e237 [id=d3062c0f64294b23abad7e06715e1fd9]) successfully deleted
I20260928 14:50:32.994604 9813 rpcz_store.cc:276] 0928 14:50:29.156445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.156760 (+ 315us) service_pool.cc:227] Handling call
0928 14:50:32.828164 (+3671404us) ts_tablet_manager.cc:1145] Deleting tablet 3d27738fcfbc42f298e26149dfd28182
0928 14:50:32.828175 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:32.977595 (+149420us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.990006 (+ 12411us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:32.993404 (+ 3398us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3663069}
I20260928 14:50:32.995224 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f98e79eee4ac4e55b37d2047d1e36684" } modify_external_catalogs: true
I20260928 14:50:32.995460 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f98e79eee4ac4e55b37d2047d1e36684" } modify_external_catalogs: true
I20260928 14:50:32.996968 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3b535897db044370b2eb23087fb0fb85" } new_table_name: "default.Table_d6786a7a8c4c4bfca78e8dfa802dee71" modify_external_catalogs: true
I20260928 14:50:33.001940 10552 raft_consensus.cc:482] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.002262 10552 raft_consensus.cc:504] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.002995 10552 leader_election.cc:288] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:33.004590 10545 raft_consensus.cc:482] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.004724 10545 raft_consensus.cc:504] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:33.005026 9219 leader_election.cc:341] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7cc4c49a4962473699103528b64a1005
I20260928 14:50:33.005656 10545 leader_election.cc:288] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.006088 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.006381 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 2949cff5a7694015ad1708ed7fab3447 (DEFAULT_TABLE table=default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.006700 9851 tablet_bootstrap.cc:492] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:33.006690 9497 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.006958 9851 ts_tablet_manager.cc:1397] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.139s user 0.011s sys 0.040s
I20260928 14:50:33.006968 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2949cff5a7694015ad1708ed7fab3447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.008147 10563 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6b99976d8024a79a0603523b9d32f29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 14:50:33.008317 9851 raft_consensus.cc:348] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.008605 9851 raft_consensus.cc:374] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.008697 9851 raft_consensus.cc:729] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.008953 9851 consensus_queue.cc:260] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.009580 9851 ts_tablet_manager.cc:1428] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:33.009869 9851 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:33.011696 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5b08f7c9a1e4fcab0951eb5d4cd059a consensus state has no leader
I20260928 14:50:33.013707 10557 raft_consensus.cc:504] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.014521 10557 leader_election.cc:288] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.016355 9814 ts_tablet_manager.cc:1918] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:33.016552 9814 log.cc:1196] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cf2dd699271542bd9b9604e746686c53
I20260928 14:50:33.017939 9814 ts_tablet_manager.cc:1939] T cf2dd699271542bd9b9604e746686c53 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.020012 9855 tablet_bootstrap.cc:654] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:33.021466 9219 leader_election.cc:341] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:33.024277 9814 tablet_replica.cc:330] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.024559 9814 raft_consensus.cc:2229] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.024760 9814 raft_consensus.cc:2258] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.024950 9851 tablet_bootstrap.cc:654] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.031350 10484 raft_consensus.cc:482] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.031476 10484 raft_consensus.cc:504] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.031997 10484 leader_election.cc:288] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.032096 10484 raft_consensus.cc:482] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.032171 10484 raft_consensus.cc:504] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.032316 9814 ts_tablet_manager.cc:1905] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.032625 10484 leader_election.cc:288] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.037585 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b2bac03b494248629046df888411bf3c" } new_table_name: "default.Table_f01f727f946f45d3978bfa5bda304b36" modify_external_catalogs: true
I20260928 14:50:33.039528 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 41b8584ba1914c3390aee99baaee289e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:33.040628 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4d63469070eb46579fb9741ec892598e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.041246 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d63469070eb46579fb9741ec892598e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.042341 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7a261ccd5aba4972bf333e1e56b99003"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.044047 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a261ccd5aba4972bf333e1e56b99003 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.040072 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d2b2abfb375d409f963b64c9da68bc03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.045356 9220 leader_election.cc:341] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:33.045480 9220 leader_election.cc:302] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.045717 9855 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.045786 10386 raft_consensus.cc:2726] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.045837 9855 ts_tablet_manager.cc:1397] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.000s
I20260928 14:50:33.046538 9855 raft_consensus.cc:348] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.046734 9855 raft_consensus.cc:374] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.046802 9855 raft_consensus.cc:729] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.046981 9855 consensus_queue.cc:260] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.047461 9855 ts_tablet_manager.cc:1428] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:33.047384 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf9342e920ae48278ab3f3c6d639fc94" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.047732 9855 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.047387 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ee844aa3c24336b4acb66dc43186e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.005987 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.010419 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc4c49a4962473699103528b64a1005" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.049141 9427 raft_consensus.cc:2454] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:33.049255 9855 tablet_bootstrap.cc:654] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.033717 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ee844aa3c24336b4acb66dc43186e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.034075 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf9342e920ae48278ab3f3c6d639fc94" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.036875 10556 consensus_queue.cc:1035] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:33.049664 9220 leader_election.cc:302] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:33.049850 9220 raft_consensus.cc:2670] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:33.050457 9498 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.050559 9498 leader_election.cc:302] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:33.050900 9498 leader_election.cc:341] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:33.051034 9498 leader_election.cc:341] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.051255 10484 raft_consensus.cc:2726] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:33.053035 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b2abfb375d409f963b64c9da68bc03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.040161 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6f038da6d97b4464a345085edf1bbe19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.054298 9497 leader_election.cc:341] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.054404 9497 leader_election.cc:302] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:33.054773 9497 leader_election.cc:341] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.054855 9497 leader_election.cc:302] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.055075 10484 raft_consensus.cc:2726] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.055157 10545 raft_consensus.cc:2726] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.058087 9814 ts_tablet_manager.cc:1918] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.058676 9855 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.058810 9855 ts_tablet_manager.cc:1397] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260928 14:50:33.059506 9855 raft_consensus.cc:348] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.059675 9855 raft_consensus.cc:374] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.059736 9855 raft_consensus.cc:729] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.059894 9855 consensus_queue.cc:260] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.060091 9814 log.cc:1196] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7cc4c49a4962473699103528b64a1005
I20260928 14:50:33.060354 9855 ts_tablet_manager.cc:1428] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:33.060572 9855 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.060575 9814 ts_tablet_manager.cc:1939] T 7cc4c49a4962473699103528b64a1005 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:33.061265 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f038da6d97b4464a345085edf1bbe19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.062003 9855 tablet_bootstrap.cc:654] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.064085 9814 tablet_replica.cc:330] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.064402 9814 raft_consensus.cc:2229] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:33.064819 9814 pending_rounds.cc:62] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:33.064966 9814 pending_rounds.cc:68] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326406674477056 op_type: NO_OP noop_request { }
I20260928 14:50:33.065217 9814 raft_consensus.cc:2866] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:33.065423 9814 raft_consensus.cc:2258] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.066253 9814 ts_tablet_manager.cc:1905] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.069459 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 3d27738fcfbc42f298e26149dfd28182 (table default.Table_327215c77105491289e905e60ba09b2c [id=8acf918c731f462a9bea00dc1e1a22ca]) successfully deleted
I20260928 14:50:33.072885 9851 tablet_bootstrap.cc:492] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.073112 9851 ts_tablet_manager.cc:1397] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.004s
I20260928 14:50:33.073968 9851 raft_consensus.cc:348] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.074179 9851 raft_consensus.cc:374] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.074267 9851 raft_consensus.cc:729] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.074501 9851 consensus_queue.cc:260] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.075098 9851 ts_tablet_manager.cc:1428] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:33.079981 9814 ts_tablet_manager.cc:1918] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:33.080137 9814 log.cc:1196] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:33.080510 9814 ts_tablet_manager.cc:1939] T f095e4cbf95147d9afb83434ae1fd29f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.081067 9851 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.081291 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4d4fc720b05f40a0844cf79a886abacc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.081897 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d4fc720b05f40a0844cf79a886abacc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.084519 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cefdcbcd585f4698a86a85904f5f2793" } new_table_name: "default.Table_8b65474a1b4b4d50bdce1171e7645814" modify_external_catalogs: true
W20260928 14:50:33.086537 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 080159d2e65a4550861f4c63fb22d02e has no consensus state
I20260928 14:50:33.101660 9851 tablet_bootstrap.cc:654] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:33.107192 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5cb151d58f545d9b1e6f652a0627ab9 consensus state has no leader
I20260928 14:50:33.110165 8946 catalog_manager.cc:5495] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:33.110713 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:33.115739 9814 tablet_replica.cc:330] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.115965 9814 raft_consensus.cc:2229] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.117031 9814 raft_consensus.cc:2258] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.118307 9851 tablet_bootstrap.cc:492] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.118517 9851 ts_tablet_manager.cc:1397] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20260928 14:50:33.119226 9851 raft_consensus.cc:348] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.119467 9851 raft_consensus.cc:374] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.119596 9851 raft_consensus.cc:729] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.119879 9851 consensus_queue.cc:260] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.120446 9851 ts_tablet_manager.cc:1428] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:33.120779 9851 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.122176 9814 ts_tablet_manager.cc:1905] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.136729 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b8738a1591f644758f44fc720fd694a3
I20260928 14:50:33.137159 9851 tablet_bootstrap.cc:654] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.138973 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 2967f173bf154bc79bd00e409122f16b (DEFAULT_TABLE table=default.Table_1a4386a2fcb74bed9056deabd39257e6 [id=3de15450fb064a389861a7aad235684c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.139381 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2967f173bf154bc79bd00e409122f16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.146597 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 2967f173bf154bc79bd00e409122f16b (DEFAULT_TABLE table=default.Table_1a4386a2fcb74bed9056deabd39257e6 [id=3de15450fb064a389861a7aad235684c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.146847 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 54b58ab7cd1d495c985d3e383159fe64 (DEFAULT_TABLE table=default.Table_8ecaaab9b90044d8a46972af10da0676 [id=bdbf801d3ad1477399f017945b2c4f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.147079 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2967f173bf154bc79bd00e409122f16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.147221 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b58ab7cd1d495c985d3e383159fe64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.148705 9814 ts_tablet_manager.cc:1918] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.148855 9814 log.cc:1196] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c9a7573c751d412aa8394d6277c28b7f
I20260928 14:50:33.148999 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_a235a0c6603143439c7a545281e9754a [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 5 got 0
I20260928 14:50:33.150338 9261 tablet_service.cc:1467] Processing CreateTablet for tablet fbcdd6d0f24d460493293693ea7c173c (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.150748 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbcdd6d0f24d460493293693ea7c173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.151531 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet c51f5944c6534e9492594c39ae9796b2 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:33.153854 9814 ts_tablet_manager.cc:1939] T c9a7573c751d412aa8394d6277c28b7f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.157685 9814 tablet_replica.cc:330] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.157894 9814 raft_consensus.cc:2229] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.157889 9536 tablet_service.cc:1467] Processing CreateTablet for tablet fbcdd6d0f24d460493293693ea7c173c (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.158116 9814 raft_consensus.cc:2258] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.158365 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbcdd6d0f24d460493293693ea7c173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.159483 8946 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_a235a0c6603143439c7a545281e9754a [id=c90173a37f6f4615a34f85216ec6d750] alter complete (version 5)
I20260928 14:50:33.160063 9851 tablet_bootstrap.cc:492] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.160187 9851 ts_tablet_manager.cc:1397] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20260928 14:50:33.161031 9851 raft_consensus.cc:348] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.161278 9851 raft_consensus.cc:374] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.161465 9851 raft_consensus.cc:729] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.161788 9851 consensus_queue.cc:260] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.162333 9534 tablet_service.cc:1467] Processing CreateTablet for tablet c073b27ed9d14c178caa3080ff0737ff (DEFAULT_TABLE table=default.Table_224b699f0cba4133a5ffb1e73d69d754 [id=6ca5dd6abbfe41388287dd72aeeeb26f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.162678 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c073b27ed9d14c178caa3080ff0737ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.162671 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 080159d2e65a4550861f4c63fb22d02e (DEFAULT_TABLE table=default.Table_f01f727f946f45d3978bfa5bda304b36 [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.163115 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080159d2e65a4550861f4c63fb22d02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.163316 10386 raft_consensus.cc:482] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.163448 10386 raft_consensus.cc:504] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.164397 10386 leader_election.cc:288] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:33.166903 9219 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:33.167037 9851 ts_tablet_manager.cc:1428] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 14:50:33.167567 9814 ts_tablet_manager.cc:1905] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.172755 9261 tablet_service.cc:1467] Processing CreateTablet for tablet c073b27ed9d14c178caa3080ff0737ff (DEFAULT_TABLE table=default.Table_224b699f0cba4133a5ffb1e73d69d754 [id=6ca5dd6abbfe41388287dd72aeeeb26f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.173169 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c073b27ed9d14c178caa3080ff0737ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.174096 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c51f5944c6534e9492594c39ae9796b2
I20260928 14:50:33.174513 8949 catalog_manager.cc:6565] ReplaceTablet: tablet c51f5944c6534e9492594c39ae9796b2 deleted and replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655
I20260928 14:50:33.176079 9851 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.181800 9851 tablet_bootstrap.cc:654] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.182152 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0a78989b9b455f9d74c84dd1131e44 (DEFAULT_TABLE table=default.Table_db508f1a3f4f4ed39e20f45108549f77 [id=2161d439818d457cb2aba4df4cd05d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.182670 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0a78989b9b455f9d74c84dd1131e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.188954 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 54b58ab7cd1d495c985d3e383159fe64 (DEFAULT_TABLE table=default.Table_8ecaaab9b90044d8a46972af10da0676 [id=bdbf801d3ad1477399f017945b2c4f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.189306 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b58ab7cd1d495c985d3e383159fe64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.189312 9814 ts_tablet_manager.cc:1918] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.189445 9814 log.cc:1196] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f3dee7ff6d5544908cdd9dbd45ce521a
I20260928 14:50:33.192227 10545 raft_consensus.cc:482] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.192395 10545 raft_consensus.cc:504] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.193732 10545 leader_election.cc:288] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.193718 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.194231 9497 leader_election.cc:341] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.194867 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0a78989b9b455f9d74c84dd1131e44 (DEFAULT_TABLE table=default.Table_db508f1a3f4f4ed39e20f45108549f77 [id=2161d439818d457cb2aba4df4cd05d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.195201 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0a78989b9b455f9d74c84dd1131e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.195185 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 301278ef2eed4a26b3f72a581027f828 (DEFAULT_TABLE table=default.Table_e1dc57786cab4958ad9086275ae478b1 [id=8ba1aaff1fb74d488f66e2a2037c5834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.195720 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301278ef2eed4a26b3f72a581027f828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.209101 9851 tablet_bootstrap.cc:492] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.209259 9851 ts_tablet_manager.cc:1397] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.004s
I20260928 14:50:33.209982 9851 raft_consensus.cc:348] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.210222 9851 raft_consensus.cc:374] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.210300 9851 raft_consensus.cc:729] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.210539 9851 consensus_queue.cc:260] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.211697 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cf2dd699271542bd9b9604e746686c53 (table default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]) successfully deleted
I20260928 14:50:33.211987 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7cc4c49a4962473699103528b64a1005 (table default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]) successfully deleted
I20260928 14:50:33.212302 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f095e4cbf95147d9afb83434ae1fd29f (table default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]) successfully deleted
I20260928 14:50:33.212576 8949 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:33.212736 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c9a7573c751d412aa8394d6277c28b7f (table default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]) successfully deleted
I20260928 14:50:33.213971 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3bfbefb06f584af6a1c10690384a4e85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.214756 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bfbefb06f584af6a1c10690384a4e85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.212910 8949 catalog_manager.cc:5495] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:33.216468 9851 ts_tablet_manager.cc:1428] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 14:50:33.215554 8949 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:33.217823 9851 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.218048 9814 ts_tablet_manager.cc:1939] T f3dee7ff6d5544908cdd9dbd45ce521a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.224852 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 080159d2e65a4550861f4c63fb22d02e (DEFAULT_TABLE table=default.Table_f01f727f946f45d3978bfa5bda304b36 [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.225591 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080159d2e65a4550861f4c63fb22d02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.254073 9855 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.256418 9855 ts_tablet_manager.cc:1397] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.196s user 0.003s sys 0.010s
I20260928 14:50:33.259496 10546 raft_consensus.cc:482] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.261220 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:33.261809 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 2967f173bf154bc79bd00e409122f16b (DEFAULT_TABLE table=default.Table_1a4386a2fcb74bed9056deabd39257e6 [id=3de15450fb064a389861a7aad235684c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.259402 10549 raft_consensus.cc:482] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.264489 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2967f173bf154bc79bd00e409122f16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.273063 9855 raft_consensus.cc:348] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.273329 9855 raft_consensus.cc:374] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.273638 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 54b58ab7cd1d495c985d3e383159fe64 (DEFAULT_TABLE table=default.Table_8ecaaab9b90044d8a46972af10da0676 [id=bdbf801d3ad1477399f017945b2c4f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.273463 9855 raft_consensus.cc:729] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.275305 9855 consensus_queue.cc:260] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.278223 9855 ts_tablet_manager.cc:1428] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260928 14:50:33.278543 9855 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.284391 10549 raft_consensus.cc:504] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.285104 10549 leader_election.cc:288] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:33.285327 10546 raft_consensus.cc:504] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.286578 9855 tablet_bootstrap.cc:654] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.287568 10546 leader_election.cc:288] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:33.288038 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b58ab7cd1d495c985d3e383159fe64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.296537 9855 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.296777 9855 ts_tablet_manager.cc:1397] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260928 14:50:33.297566 9855 raft_consensus.cc:348] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.297789 9855 raft_consensus.cc:374] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.297864 9855 raft_consensus.cc:729] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.298094 9855 consensus_queue.cc:260] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.298599 9855 ts_tablet_manager.cc:1428] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:33.301173 9855 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.302645 9855 tablet_bootstrap.cc:654] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.326066 9855 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.326213 9855 ts_tablet_manager.cc:1397] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260928 14:50:33.326903 9855 raft_consensus.cc:348] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.327119 9855 raft_consensus.cc:374] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.327210 9855 raft_consensus.cc:729] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.327407 9855 consensus_queue.cc:260] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.327922 9855 ts_tablet_manager.cc:1428] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:33.331965 9855 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.338546 9855 tablet_bootstrap.cc:654] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.342728 9855 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.342873 9855 ts_tablet_manager.cc:1397] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.002s
I20260928 14:50:33.344619 9851 tablet_bootstrap.cc:654] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.344487 9855 raft_consensus.cc:348] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.344739 9855 raft_consensus.cc:374] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.344849 9855 raft_consensus.cc:729] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.345183 9855 consensus_queue.cc:260] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.351467 9855 ts_tablet_manager.cc:1428] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260928 14:50:33.351776 9855 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.352475 10386 raft_consensus.cc:482] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.353144 10557 raft_consensus.cc:482] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.353299 10557 raft_consensus.cc:504] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.353474 9814 tablet_replica.cc:330] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.353957 10557 leader_election.cc:288] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.354319 10552 raft_consensus.cc:482] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.354386 9855 tablet_bootstrap.cc:654] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.354465 10552 raft_consensus.cc:504] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.354657 10386 raft_consensus.cc:504] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.355064 10552 leader_election.cc:288] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:33.355178 10386 leader_election.cc:288] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.356818 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:33.357806 9219 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:33.357823 9814 raft_consensus.cc:2229] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.358723 9814 raft_consensus.cc:2258] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.359215 9814 ts_tablet_manager.cc:1905] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.361104 10484 raft_consensus.cc:482] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.361250 10484 raft_consensus.cc:504] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.362025 10484 leader_election.cc:288] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.363606 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_74a626e855bc41ecb2d3684dae5c9346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.364272 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74a626e855bc41ecb2d3684dae5c9346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.364957 9855 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.365087 9855 ts_tablet_manager.cc:1397] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260928 14:50:33.366276 9855 raft_consensus.cc:348] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.366478 9855 raft_consensus.cc:374] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.366592 9855 raft_consensus.cc:729] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.366858 9855 consensus_queue.cc:260] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.366917 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5dc7dfd8d10d471b9360ab4188c1e1ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:33.367477 9855 ts_tablet_manager.cc:1428] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260928 14:50:33.367624 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dc7dfd8d10d471b9360ab4188c1e1ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.367837 9855 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.368765 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eba035915e264e878ed46dfadc6f379d" } modify_external_catalogs: true
I20260928 14:50:33.368976 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet b8738a1591f644758f44fc720fd694a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.368948 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eba035915e264e878ed46dfadc6f379d" } modify_external_catalogs: true
I20260928 14:50:33.369428 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.369729 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.369738 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3ae346f4e35f4daf82d04747a821694f" } modify_external_catalogs: true
I20260928 14:50:33.369815 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.369992 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3ae346f4e35f4daf82d04747a821694f" } modify_external_catalogs: true
I20260928 14:50:33.370575 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d63761d56fb04de5af441abb8bf27540" } modify_external_catalogs: true
I20260928 14:50:33.370914 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d63761d56fb04de5af441abb8bf27540" } modify_external_catalogs: true
I20260928 14:50:33.371083 9855 tablet_bootstrap.cc:654] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.371613 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1c2caec8b75342b2a381248db04f48c0" } new_table_name: "default.Table_8a378e8c5f20412facc0e20d8eb04869" modify_external_catalogs: true
I20260928 14:50:33.374100 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_00bd3ddea1be4fc6a7815385fa27f691" } modify_external_catalogs: true
I20260928 14:50:33.374464 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_00bd3ddea1be4fc6a7815385fa27f691" } modify_external_catalogs: true
I20260928 14:50:33.374938 9815 tablet_replica.cc:330] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.375296 9815 raft_consensus.cc:2229] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.375530 9815 raft_consensus.cc:2258] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.376163 9815 ts_tablet_manager.cc:1905] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.377434 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999aa56f1683464d9612a2ddbfbebbda" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.377713 9424 raft_consensus.cc:2454] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:33.378005 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1eb1ac72cc9d46e4948c87c000d87cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.378599 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eb1ac72cc9d46e4948c87c000d87cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.380065 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_29cdf12bddf84c999617ee6e6162abd8" } new_table_name: "default.Table_c92c44ab247f4107aadad24f568e9f3a" modify_external_catalogs: true
I20260928 14:50:33.382848 9393 tablet_service.cc:1467] Processing CreateTablet for tablet c073b27ed9d14c178caa3080ff0737ff (DEFAULT_TABLE table=default.Table_224b699f0cba4133a5ffb1e73d69d754 [id=6ca5dd6abbfe41388287dd72aeeeb26f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.383018 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 080159d2e65a4550861f4c63fb22d02e (DEFAULT_TABLE table=default.Table_f01f727f946f45d3978bfa5bda304b36 [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.383306 9392 tablet_service.cc:1467] Processing CreateTablet for tablet fbcdd6d0f24d460493293693ea7c173c (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.385737 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0a78989b9b455f9d74c84dd1131e44 (DEFAULT_TABLE table=default.Table_db508f1a3f4f4ed39e20f45108549f77 [id=2161d439818d457cb2aba4df4cd05d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.390174 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet c51f5944c6534e9492594c39ae9796b2 with delete_type TABLET_DATA_DELETED (replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.391563 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 301278ef2eed4a26b3f72a581027f828 (DEFAULT_TABLE table=default.Table_e1dc57786cab4958ad9086275ae478b1 [id=8ba1aaff1fb74d488f66e2a2037c5834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.392079 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301278ef2eed4a26b3f72a581027f828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.398315 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 6e4f703cc19c453cbc46432a4430a204 (DEFAULT_TABLE table=default.Table_1f27f67005ab45f8a688c438160b9119 [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.398705 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e4f703cc19c453cbc46432a4430a204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.402359 9542 tablet_service.cc:1467] Processing CreateTablet for tablet dba9ca8e0b0e444d83cdb68f94eb4b54 (DEFAULT_TABLE table=default.Table_c05963b71b12498faba8d80dab022b22 [id=346d08c001f64d21b5a23fb82a53fb4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.402783 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba9ca8e0b0e444d83cdb68f94eb4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.404457 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 2b230e43173849e1903a2871fa4b0f91 (DEFAULT_TABLE table=default.Table_34ef5f5fa21143379cd2ba4997e77c8b [id=b1b93f18afaa436aac38101c3f24e389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.404700 9538 tablet_service.cc:1467] Processing CreateTablet for tablet d6e0800aba3144c9979a09b959f5efc8 (DEFAULT_TABLE table=default.Table_5bf215c87d4d499286d9824a4a711ea2 [id=5a816c4c69a5474393d9a19de58970c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.404934 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b230e43173849e1903a2871fa4b0f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.405316 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6e0800aba3144c9979a09b959f5efc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.405764 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc (DEFAULT_TABLE table=default.Table_e9f33f551fc94b99849f78d3bb8d5e33 [id=7a1b4dd07f694f89bfb7a3251d3c90ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.406081 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f04bf1357148818ea60b32cfd5f9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.409968 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 (DEFAULT_TABLE table=default.Table_759996584e7f451ba52a51c319bf3aad [id=c4da137c9f654d90b3d90b161fca1c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.410378 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f79321ee2446f1aadebaaa79cf7247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.411885 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea (DEFAULT_TABLE table=default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd [id=98a1deb200644f37ab2515250a9a41d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.412334 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae9c6ae0c9546e6baa12f13668969ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.413853 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 287a1ca845fe440da98bf68aafa0e49c (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.414286 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287a1ca845fe440da98bf68aafa0e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.417429 9538 tablet_service.cc:1467] Processing CreateTablet for tablet e92b08254f4041e482e7fa1935dd7071 (DEFAULT_TABLE table=default.Table_4d4fc720b05f40a0844cf79a886abacc [id=56f5de6601584cf5b2018df58f7e9989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.417841 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92b08254f4041e482e7fa1935dd7071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.417815 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 167abd4bc50d43cb98d667be90ea278a (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.418085 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167abd4bc50d43cb98d667be90ea278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.419368 10484 raft_consensus.cc:482] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.419478 10484 raft_consensus.cc:504] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.420943 10484 leader_election.cc:288] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.422693 9815 ts_tablet_manager.cc:1918] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.422847 9815 log.cc:1196] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:33.423149 9815 ts_tablet_manager.cc:1939] T cadfdf093ab04b61af441cff6c9c510b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:33.423779 9219 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:33.424158 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 452) took 4207 ms. Trace:
I20260928 14:50:33.424368 9813 rpcz_store.cc:276] 0928 14:50:29.172547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.172721 (+ 174us) service_pool.cc:227] Handling call
0928 14:50:33.049093 (+3876372us) ts_tablet_manager.cc:1145] Deleting tablet 7ef356a4c9d34af4b300d38eab49a569
0928 14:50:33.049103 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:33.380004 (+330901us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3876187}
I20260928 14:50:33.424913 9813 tablet_replica.cc:330] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:33.424875 10386 raft_consensus.cc:482] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.425215 9813 raft_consensus.cc:2229] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.425159 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86f11c5ca3154bac934cae3842f16de4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.425556 9813 raft_consensus.cc:2258] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.425772 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c88ccde6f7540d4aa7cf9b29aa3718d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.425961 9497 leader_election.cc:341] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.426142 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311e4286b2a943ee924ac1c25dc9ca46" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.426303 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 59431.2us
I20260928 14:50:33.426340 9427 raft_consensus.cc:2454] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:33.426555 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet c51f5944c6534e9492594c39ae9796b2 with delete_type TABLET_DATA_DELETED (replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.426477 10386 raft_consensus.cc:504] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.426801 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c073b27ed9d14c178caa3080ff0737ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.427006 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05131db52e94d7c9f4856b0455246d2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.427237 9424 raft_consensus.cc:2454] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:33.427274 9220 leader_election.cc:302] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:33.427682 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.428709 10386 leader_election.cc:288] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.428916 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet c51f5944c6534e9492594c39ae9796b2 with delete_type TABLET_DATA_DELETED (replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.429046 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet b8738a1591f644758f44fc720fd694a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:33.428785 9497 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.429711 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86f11c5ca3154bac934cae3842f16de4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.429653 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:33.429821 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 6e4f703cc19c453cbc46432a4430a204 (DEFAULT_TABLE table=default.Table_1f27f67005ab45f8a688c438160b9119 [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:33.430176 9498 leader_election.cc:341] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.430267 9498 leader_election.cc:302] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.430298 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e4f703cc19c453cbc46432a4430a204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.430374 9568 raft_consensus.cc:2379] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b4626c584ad47ffaf346e81daff846b in current term 1: Already voted for candidate ae832871bd1142f7af10c084115ffc12 in this term.
I20260928 14:50:33.430627 10484 raft_consensus.cc:2726] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.431736 9815 tablet_replica.cc:330] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.432126 9815 raft_consensus.cc:2229] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.432386 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.433393 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bd612753b914a079ccf89249b073018 with delete_type TABLET_DATA_DELETED (replaced by tablet e3236b0fb0944dc0a1f0893eb8d8e3b4) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.433588 10552 raft_consensus.cc:2781] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 14:50:33.433184 9498 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.434094 9498 leader_election.cc:302] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.434212 9851 tablet_bootstrap.cc:492] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.434341 9851 ts_tablet_manager.cc:1397] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.217s user 0.006s sys 0.000s
I20260928 14:50:33.434490 10484 raft_consensus.cc:2726] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.434754 9815 raft_consensus.cc:2258] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.435197 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet b8738a1591f644758f44fc720fd694a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.435443 10552 raft_consensus.cc:482] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:33.435604 10552 raft_consensus.cc:3037] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.436347 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:33.436767 9815 ts_tablet_manager.cc:1905] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.433951 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet f05131db52e94d7c9f4856b0455246d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:21 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.440913 10552 raft_consensus.cc:504] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.441715 10552 leader_election.cc:288] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:33.443140 9219 leader_election.cc:341] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:33.443635 9815 ts_tablet_manager.cc:1918] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.443784 9815 log.cc:1196] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cf9342e920ae48278ab3f3c6d639fc94
I20260928 14:50:33.444162 9815 ts_tablet_manager.cc:1939] T cf9342e920ae48278ab3f3c6d639fc94 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:33.444682 9851 raft_consensus.cc:348] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.445276 9815 tablet_replica.cc:330] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.445384 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 (DEFAULT_TABLE table=default.Table_759996584e7f451ba52a51c319bf3aad [id=c4da137c9f654d90b3d90b161fca1c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.445487 9815 raft_consensus.cc:2229] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.445715 9815 raft_consensus.cc:2258] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.445902 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f79321ee2446f1aadebaaa79cf7247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.446326 9815 ts_tablet_manager.cc:1905] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.448379 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc (DEFAULT_TABLE table=default.Table_e9f33f551fc94b99849f78d3bb8d5e33 [id=7a1b4dd07f694f89bfb7a3251d3c90ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.448796 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f04bf1357148818ea60b32cfd5f9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.449455 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 167abd4bc50d43cb98d667be90ea278a (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.450508 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167abd4bc50d43cb98d667be90ea278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.451891 9815 ts_tablet_manager.cc:1918] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.452035 9815 log.cc:1196] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/28ee844aa3c24336b4acb66dc43186e9
I20260928 14:50:33.452358 9815 ts_tablet_manager.cc:1939] T 28ee844aa3c24336b4acb66dc43186e9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:33.453161 9851 raft_consensus.cc:374] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.454319 9253 tablet_service.cc:1467] Processing CreateTablet for tablet d6e0800aba3144c9979a09b959f5efc8 (DEFAULT_TABLE table=default.Table_5bf215c87d4d499286d9824a4a711ea2 [id=5a816c4c69a5474393d9a19de58970c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.454743 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6e0800aba3144c9979a09b959f5efc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.458853 10484 raft_consensus.cc:482] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.458971 10484 raft_consensus.cc:504] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.459306 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 287a1ca845fe440da98bf68aafa0e49c (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.459555 10484 leader_election.cc:288] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.459851 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287a1ca845fe440da98bf68aafa0e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.461298 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274ab65ebc2d41db9dc5d8a0139f9bc9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.461995 9497 leader_election.cc:341] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.465317 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 2b230e43173849e1903a2871fa4b0f91 (DEFAULT_TABLE table=default.Table_34ef5f5fa21143379cd2ba4997e77c8b [id=b1b93f18afaa436aac38101c3f24e389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.465709 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b230e43173849e1903a2871fa4b0f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.468446 9851 raft_consensus.cc:729] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.468984 9851 consensus_queue.cc:260] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.470281 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7005aebec4a34d70b546ead87e628c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.470901 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7005aebec4a34d70b546ead87e628c3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.472810 9855 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.472940 9855 ts_tablet_manager.cc:1397] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.105s user 0.010s sys 0.003s
I20260928 14:50:33.476537 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 6eec5384f8914b398de78f01bf52b9d9 (DEFAULT_TABLE table=default.Table_4d63469070eb46579fb9741ec892598e [id=49b90d3ebf0d437facb640018184883d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.477918 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eec5384f8914b398de78f01bf52b9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.474189 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 301278ef2eed4a26b3f72a581027f828 (DEFAULT_TABLE table=default.Table_e1dc57786cab4958ad9086275ae478b1 [id=8ba1aaff1fb74d488f66e2a2037c5834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.479327 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 (DEFAULT_TABLE table=default.Table_6f038da6d97b4464a345085edf1bbe19 [id=c04536119bc844399bfb4607413f69cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.479691 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b953b19dd54aaabf4dbefcd33600e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.480028 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a0970a2d63544b6da80d91d68a45226e" } new_table_name: "default.Table_0b822e5685d1472b8e5cb2ef43cd0f4d" modify_external_catalogs: true
I20260928 14:50:33.480564 9535 tablet_service.cc:1467] Processing CreateTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 (DEFAULT_TABLE table=default.Table_7a261ccd5aba4972bf333e1e56b99003 [id=61adfc5d5cf249b08619400554873c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.480878 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2f614f5c964581ba64d31f0564f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.485247 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 64f704e9088b4a37a514e7a9035627a2 (DEFAULT_TABLE table=default.Table_d2b2abfb375d409f963b64c9da68bc03 [id=c81d49c055a8447598dae58e1dd0a082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.485998 9537 tablet_service.cc:1467] Processing CreateTablet for tablet b42be57c0eeb40c4b1b25c9a0d285655 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.486382 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f704e9088b4a37a514e7a9035627a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.475334 9855 raft_consensus.cc:348] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.486718 9813 ts_tablet_manager.cc:1905] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.486774 9855 raft_consensus.cc:374] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.486841 9855 raft_consensus.cc:729] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.487054 9855 consensus_queue.cc:260] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.490768 9855 ts_tablet_manager.cc:1428] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260928 14:50:33.491036 9855 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.492027 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b42be57c0eeb40c4b1b25c9a0d285655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.492672 9855 tablet_bootstrap.cc:654] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.494498 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0a78989b9b455f9d74c84dd1131e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.496176 9404 tablet_service.cc:1467] Processing CreateTablet for tablet dba9ca8e0b0e444d83cdb68f94eb4b54 (DEFAULT_TABLE table=default.Table_c05963b71b12498faba8d80dab022b22 [id=346d08c001f64d21b5a23fb82a53fb4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.496424 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 6e4f703cc19c453cbc46432a4430a204 (DEFAULT_TABLE table=default.Table_1f27f67005ab45f8a688c438160b9119 [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.497401 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 999aa56f1683464d9612a2ddbfbebbda with delete_type TABLET_DATA_DELETED (replaced by tablet dc8400fdb8d948b084733011b16df1b3) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.498530 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea (DEFAULT_TABLE table=default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd [id=98a1deb200644f37ab2515250a9a41d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.499634 9848 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:33.499882 9848 ts_tablet_manager.cc:1397] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.553s user 0.011s sys 0.002s
I20260928 14:50:33.501725 9220 leader_election.cc:302] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:33.502851 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f385d804a10442e3b725a86e201dd6a5 consensus state has no leader
W20260928 14:50:33.503747 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2af9b5d62ff3446394272bb983025bfd consensus state has no leader
I20260928 14:50:33.496326 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.507236 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 6eec5384f8914b398de78f01bf52b9d9 (DEFAULT_TABLE table=default.Table_4d63469070eb46579fb9741ec892598e [id=49b90d3ebf0d437facb640018184883d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:33.507545 9498 leader_election.cc:341] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.507643 9498 leader_election.cc:302] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.507929 10484 raft_consensus.cc:2726] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.509394 10552 raft_consensus.cc:2726] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.509385 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_91e5170452f74c3faf4b1cb25ab48e7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.510071 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91e5170452f74c3faf4b1cb25ab48e7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.511209 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 (DEFAULT_TABLE table=default.Table_759996584e7f451ba52a51c319bf3aad [id=c4da137c9f654d90b3d90b161fca1c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.511785 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_759996584e7f451ba52a51c319bf3aad" } new_table_name: "default.Table_0fe9bb8edba0417cb944819486542aa8" modify_external_catalogs: true
I20260928 14:50:33.511916 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.511881 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_aac83c42b32f4807a59c6fd187ee04ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.512537 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aac83c42b32f4807a59c6fd187ee04ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.507046 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274ab65ebc2d41db9dc5d8a0139f9bc9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.514267 9498 leader_election.cc:341] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.514376 9498 leader_election.cc:302] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.514686 10484 raft_consensus.cc:2726] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.515517 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 148e81f8add349f2b233862a7049e54c
I20260928 14:50:33.515712 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 05a9e2d2794545eab75daf61d75272c6
I20260928 14:50:33.515904 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.517788 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d7844c3ccdc942cc8cd00e7cf31c0686"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.518417 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7844c3ccdc942cc8cd00e7cf31c0686 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.518702 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d6e0800aba3144c9979a09b959f5efc8 (DEFAULT_TABLE table=default.Table_5bf215c87d4d499286d9824a4a711ea2 [id=5a816c4c69a5474393d9a19de58970c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.519479 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e4f703cc19c453cbc46432a4430a204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.519866 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.520875 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 2b230e43173849e1903a2871fa4b0f91 (DEFAULT_TABLE table=default.Table_34ef5f5fa21143379cd2ba4997e77c8b [id=b1b93f18afaa436aac38101c3f24e389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.510459 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999aa56f1683464d9612a2ddbfbebbda" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:33.521200 9406 tablet_service.cc:1467] Processing CreateTablet for tablet e92b08254f4041e482e7fa1935dd7071 (DEFAULT_TABLE table=default.Table_4d4fc720b05f40a0844cf79a886abacc [id=56f5de6601584cf5b2018df58f7e9989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.521255 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 6eec5384f8914b398de78f01bf52b9d9 (DEFAULT_TABLE table=default.Table_4d63469070eb46579fb9741ec892598e [id=49b90d3ebf0d437facb640018184883d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.524607 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea (DEFAULT_TABLE table=default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd [id=98a1deb200644f37ab2515250a9a41d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.524415 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 64f704e9088b4a37a514e7a9035627a2 (DEFAULT_TABLE table=default.Table_d2b2abfb375d409f963b64c9da68bc03 [id=c81d49c055a8447598dae58e1dd0a082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.525537 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301278ef2eed4a26b3f72a581027f828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.526583 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_658d0d60d5d542cca24520229c3b736e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:33.526899 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727cb249723946578bc5bb086d6e6c40" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.527168 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_658d0d60d5d542cca24520229c3b736e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.527444 9388 tablet_service.cc:1467] Processing CreateTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 (DEFAULT_TABLE table=default.Table_7a261ccd5aba4972bf333e1e56b99003 [id=61adfc5d5cf249b08619400554873c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.528278 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 49d69e4ad9554da9871800c8b392851c
I20260928 14:50:33.528473 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 167abd4bc50d43cb98d667be90ea278a (DEFAULT_TABLE table=default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.531001 10484 raft_consensus.cc:482] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.528040 9851 ts_tablet_manager.cc:1428] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.035s user 0.003s sys 0.000s
I20260928 14:50:33.531123 10484 raft_consensus.cc:504] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.531423 9397 tablet_service.cc:1467] Processing CreateTablet for tablet b42be57c0eeb40c4b1b25c9a0d285655 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.531694 10484 leader_election.cc:288] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.532624 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 287a1ca845fe440da98bf68aafa0e49c (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.535066 9848 raft_consensus.cc:348] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.535418 9848 raft_consensus.cc:374] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.536471 9426 raft_consensus.cc:3037] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.538410 9848 raft_consensus.cc:729] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.538686 9848 consensus_queue.cc:260] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:33.541083 8939 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet efc95c0861c9489ab6df340fc53e310d (table default.Table_9c87471cc78542fbb74b4d96524b1144 [id=3a7c9a26ba574bb18b9d39af7084bba2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet efc95c0861c9489ab6df340fc53e310d consensus state has no leader
I20260928 14:50:33.542251 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7f5d7b2677654d9f90a269e23dc49186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.542713 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f5d7b2677654d9f90a269e23dc49186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.543510 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f81dfe4d10424288b8b450c62d10a92e
I20260928 14:50:33.546003 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc (DEFAULT_TABLE table=default.Table_e9f33f551fc94b99849f78d3bb8d5e33 [id=7a1b4dd07f694f89bfb7a3251d3c90ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.546416 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 (DEFAULT_TABLE table=default.Table_6f038da6d97b4464a345085edf1bbe19 [id=c04536119bc844399bfb4607413f69cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.546762 9855 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.546880 9855 ts_tablet_manager.cc:1397] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.056s user 0.000s sys 0.004s
I20260928 14:50:33.547757 9855 raft_consensus.cc:348] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.548079 9855 raft_consensus.cc:374] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.548172 9855 raft_consensus.cc:729] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.548413 9855 consensus_queue.cc:260] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.554621 9855 ts_tablet_manager.cc:1428] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 14:50:33.534243 9261 tablet_service.cc:1467] Processing CreateTablet for tablet dba9ca8e0b0e444d83cdb68f94eb4b54 (DEFAULT_TABLE table=default.Table_c05963b71b12498faba8d80dab022b22 [id=346d08c001f64d21b5a23fb82a53fb4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.557317 9251 tablet_service.cc:1467] Processing CreateTablet for tablet e92b08254f4041e482e7fa1935dd7071 (DEFAULT_TABLE table=default.Table_4d4fc720b05f40a0844cf79a886abacc [id=56f5de6601584cf5b2018df58f7e9989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.557616 9814 ts_tablet_manager.cc:1918] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.557816 9814 log.cc:1196] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:33.558627 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eec5384f8914b398de78f01bf52b9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.559589 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080159d2e65a4550861f4c63fb22d02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.560707 9855 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.561625 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.562083 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2f614f5c964581ba64d31f0564f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:33.562103 9497 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.562393 9855 tablet_bootstrap.cc:654] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.559855 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.562897 9498 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.562992 9498 leader_election.cc:302] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.559369 9220 leader_election.cc:302] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:33.563294 10484 raft_consensus.cc:2726] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.566116 10552 raft_consensus.cc:2781] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:33.567018 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae9c6ae0c9546e6baa12f13668969ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.567703 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbcdd6d0f24d460493293693ea7c173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.569788 10552 raft_consensus.cc:482] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:33.570000 10552 raft_consensus.cc:3037] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.571442 9814 ts_tablet_manager.cc:1939] T 6891077c78ef4f3d84e33283096ddf7a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.577132 10614 raft_consensus.cc:482] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.578538 9855 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.578718 9855 ts_tablet_manager.cc:1397] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260928 14:50:33.579350 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b230e43173849e1903a2871fa4b0f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.579685 10552 raft_consensus.cc:504] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.579739 9855 raft_consensus.cc:348] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.579914 9855 raft_consensus.cc:374] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.580017 9855 raft_consensus.cc:729] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.580252 9855 consensus_queue.cc:260] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.580405 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b953b19dd54aaabf4dbefcd33600e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.581019 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f704e9088b4a37a514e7a9035627a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:33.581429 9219 leader_election.cc:341] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:33.581861 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba9ca8e0b0e444d83cdb68f94eb4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.582278 9855 ts_tablet_manager.cc:1428] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:33.582367 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287a1ca845fe440da98bf68aafa0e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.582633 9855 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.583115 9848 ts_tablet_manager.cc:1428] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.047s user 0.001s sys 0.002s
I20260928 14:50:33.583178 10552 leader_election.cc:288] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.577287 10614 raft_consensus.cc:504] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.584381 9855 tablet_bootstrap.cc:654] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.584239 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f79321ee2446f1aadebaaa79cf7247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.588932 9848 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:33.572782 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 63561.7us
I20260928 14:50:33.588819 10614 leader_election.cc:288] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:33.592171 9220 leader_election.cc:302] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:33.592319 10484 consensus_queue.cc:1035] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:33.592756 9220 leader_election.cc:302] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.593926 10552 raft_consensus.cc:2781] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:33.594123 10552 raft_consensus.cc:482] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:33.596449 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7ef356a4c9d34af4b300d38eab49a569 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef356a4c9d34af4b300d38eab49a569 already in progress: creating tablet
I20260928 14:50:33.597225 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f04bf1357148818ea60b32cfd5f9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.597417 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c7744794790b441483591e21438133b5" } new_table_name: "default.Table_db83f8c905e54fbeb75b212120f77ba7" modify_external_catalogs: true
I20260928 14:50:33.597854 9855 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.598014 9855 ts_tablet_manager.cc:1397] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260928 14:50:33.598348 10386 raft_consensus.cc:3037] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.599633 9855 raft_consensus.cc:348] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.599882 9855 raft_consensus.cc:374] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.600087 10484 raft_consensus.cc:482] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.600188 10484 raft_consensus.cc:504] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.600708 10484 leader_election.cc:288] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.601255 9855 raft_consensus.cc:729] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.601469 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92b08254f4041e482e7fa1935dd7071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.601589 9855 consensus_queue.cc:260] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.603212 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b42be57c0eeb40c4b1b25c9a0d285655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.604773 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eec5384f8914b398de78f01bf52b9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.606455 9855 ts_tablet_manager.cc:1428] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260928 14:50:33.607093 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f3dee7ff6d5544908cdd9dbd45ce521a (table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]) successfully deleted
I20260928 14:50:33.610625 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d5a67ec9ce403d91ef1f6d52380b96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.611202 9497 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.611379 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92b08254f4041e482e7fa1935dd7071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.611830 9855 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.612250 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 (DEFAULT_TABLE table=default.Table_7a261ccd5aba4972bf333e1e56b99003 [id=61adfc5d5cf249b08619400554873c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.614902 9855 tablet_bootstrap.cc:654] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:33.615671 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6aa393b1fc2b40ebb87df86180717db8 consensus state has no leader
W20260928 14:50:33.615646 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 65998.3us
W20260928 14:50:33.617245 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5a6755b697134b8e90e457b554b9599c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a6755b697134b8e90e457b554b9599c already in progress: creating tablet
W20260928 14:50:33.617503 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2949cff5a7694015ad1708ed7fab3447 already in progress: creating tablet
W20260928 14:50:33.617722 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 157e807a962749028b1c8df00846295a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157e807a962749028b1c8df00846295a already in progress: creating tablet
W20260928 14:50:33.617949 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 157e807a962749028b1c8df00846295a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157e807a962749028b1c8df00846295a already in progress: creating tablet
I20260928 14:50:33.620687 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6e0800aba3144c9979a09b959f5efc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.621614 9851 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.622483 10552 raft_consensus.cc:3037] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:33.627532 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1f012857690f4f91a941a5f642b9c989 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f012857690f4f91a941a5f642b9c989 already in progress: creating tablet
I20260928 14:50:33.628922 9814 tablet_replica.cc:330] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:33.630291 10386 raft_consensus.cc:2726] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.630666 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba9ca8e0b0e444d83cdb68f94eb4b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.631616 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2f614f5c964581ba64d31f0564f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.635329 9814 raft_consensus.cc:2229] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.635499 9814 raft_consensus.cc:2258] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.637163 9814 ts_tablet_manager.cc:1905] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.638540 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 64f704e9088b4a37a514e7a9035627a2 (DEFAULT_TABLE table=default.Table_d2b2abfb375d409f963b64c9da68bc03 [id=c81d49c055a8447598dae58e1dd0a082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.648729 10484 raft_consensus.cc:482] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.648861 10484 raft_consensus.cc:504] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.649462 10484 leader_election.cc:288] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:33.614734 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d5a67ec9ce403d91ef1f6d52380b96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.656059 9498 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.656170 9498 leader_election.cc:302] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.656519 10386 raft_consensus.cc:482] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.656553 10484 raft_consensus.cc:2726] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.656687 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 (DEFAULT_TABLE table=default.Table_6f038da6d97b4464a345085edf1bbe19 [id=c04536119bc844399bfb4607413f69cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.657323 10386 raft_consensus.cc:504] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.658211 10386 leader_election.cc:288] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:33.658496 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:33.659195 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae9c6ae0c9546e6baa12f13668969ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.659570 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f704e9088b4a37a514e7a9035627a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.660348 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88015bcd867e40e5b9263930e820074a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.660879 9497 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.661075 9263 tablet_service.cc:1467] Processing CreateTablet for tablet b42be57c0eeb40c4b1b25c9a0d285655 (DEFAULT_TABLE table=default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.662940 10552 raft_consensus.cc:504] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:33.649185 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 666de9dd64734708b35738605204ed7d consensus state has no leader
W20260928 14:50:33.656848 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69f79321ee2446f1aadebaaa79cf7247 consensus state has no leader
W20260928 14:50:33.677744 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 59423.8us
W20260928 14:50:33.678068 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2949cff5a7694015ad1708ed7fab3447 already in progress: creating tablet
I20260928 14:50:33.678846 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6891077c78ef4f3d84e33283096ddf7a (table default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]) successfully deleted
I20260928 14:50:33.666172 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b953b19dd54aaabf4dbefcd33600e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.671773 9287 raft_consensus.cc:3037] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.673127 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a828130854b4e4e8c44b2b45260e50e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.681175 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd24e60a0e944f6086ff9c9fbe2e8180" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.681392 9284 raft_consensus.cc:2454] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:33.682706 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b42be57c0eeb40c4b1b25c9a0d285655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.687153 9284 raft_consensus.cc:3037] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:33.687371 9219 leader_election.cc:341] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f05131db52e94d7c9f4856b0455246d2
W20260928 14:50:33.689620 9360 leader_election.cc:341] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.675796 10386 raft_consensus.cc:482] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.690936 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88015bcd867e40e5b9263930e820074a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:33.691642 9498 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.691759 9498 leader_election.cc:302] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.691959 10484 raft_consensus.cc:2726] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.692320 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311e4286b2a943ee924ac1c25dc9ca46" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:33.692579 9424 raft_consensus.cc:3037] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:33.693392 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.697053 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.698279 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.697821 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4729fc718bf540ecb501c2cac3966bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.702823 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a9e2d2794545eab75daf61d75272c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.706607 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d69e4ad9554da9871800c8b392851c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.706897 9360 leader_election.cc:302] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:33.708689 10549 consensus_queue.cc:1035] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:33.709273 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet f81dfe4d10424288b8b450c62d10a92e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:33.709939 9360 leader_election.cc:341] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6a828130854b4e4e8c44b2b45260e50e
I20260928 14:50:33.710448 9360 leader_election.cc:302] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:33.710825 10549 raft_consensus.cc:2726] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.711738 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a9e2d2794545eab75daf61d75272c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:33.711771 9360 leader_election.cc:341] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:33.712150 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d69e4ad9554da9871800c8b392851c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.713760 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 3348f5a55ef34af88611077aab447f83 (DEFAULT_TABLE table=default.Table_74a626e855bc41ecb2d3684dae5c9346 [id=75d5b862c2804a409d82b2b2b33afda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.714363 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3348f5a55ef34af88611077aab447f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.714679 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167abd4bc50d43cb98d667be90ea278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.719923 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7535e922d06d4529856d59f1e12de3d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.720494 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7535e922d06d4529856d59f1e12de3d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.720932 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ca8c415e575244b4a42d5d0ca9dd5d53" } modify_external_catalogs: true
I20260928 14:50:33.723246 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "066df778654449bda96f68b5035c4d73" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.724514 10556 raft_consensus.cc:2781] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 14:50:33.725004 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b8738a1591f644758f44fc720fd694a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8738a1591f644758f44fc720fd694a3 already in progress: creating tablet
I20260928 14:50:33.729879 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cadfdf093ab04b61af441cff6c9c510b (table default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]) successfully deleted
I20260928 14:50:33.731419 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ca8c415e575244b4a42d5d0ca9dd5d53" } modify_external_catalogs: true
I20260928 14:50:33.733384 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:33.733623 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:33.736116 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cf9342e920ae48278ab3f3c6d639fc94 (table default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]) successfully deleted
I20260928 14:50:33.736797 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 28ee844aa3c24336b4acb66dc43186e9 (table default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f [id=544d8d04f58f4aee9d4b04c45d9f9cd8]) successfully deleted
W20260928 14:50:33.739068 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c51f5944c6534e9492594c39ae9796b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51f5944c6534e9492594c39ae9796b2 already in progress: creating tablet
I20260928 14:50:33.744156 9855 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.744279 9855 ts_tablet_manager.cc:1397] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.133s user 0.016s sys 0.037s
I20260928 14:50:33.744980 9855 raft_consensus.cc:348] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.745175 9855 raft_consensus.cc:374] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.745229 9855 raft_consensus.cc:729] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.745383 9855 consensus_queue.cc:260] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.745648 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:33.746598 10552 leader_election.cc:288] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.748977 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.749269 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a9e2d2794545eab75daf61d75272c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.749372 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet fd24e60a0e944f6086ff9c9fbe2e8180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.749500 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d69e4ad9554da9871800c8b392851c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.749716 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet f81dfe4d10424288b8b450c62d10a92e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:33.749352 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 148e81f8add349f2b233862a7049e54c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148e81f8add349f2b233862a7049e54c already in progress: creating tablet
W20260928 14:50:33.750746 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 05a9e2d2794545eab75daf61d75272c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05a9e2d2794545eab75daf61d75272c6 already in progress: creating tablet
W20260928 14:50:33.751833 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 49d69e4ad9554da9871800c8b392851c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49d69e4ad9554da9871800c8b392851c already in progress: creating tablet
I20260928 14:50:33.752089 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:33.752975 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f81dfe4d10424288b8b450c62d10a92e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f81dfe4d10424288b8b450c62d10a92e already in progress: creating tablet
I20260928 14:50:33.748374 10386 raft_consensus.cc:504] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.753985 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4729fc718bf540ecb501c2cac3966bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.756645 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 3233b0dcc6734abfb7bf17260f14fa1f (DEFAULT_TABLE table=default.Table_91e5170452f74c3faf4b1cb25ab48e7e [id=4ef2ed75244f497592eb44a0328a275c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.756826 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 3348f5a55ef34af88611077aab447f83 (DEFAULT_TABLE table=default.Table_74a626e855bc41ecb2d3684dae5c9346 [id=75d5b862c2804a409d82b2b2b33afda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.757153 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3348f5a55ef34af88611077aab447f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.757314 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3233b0dcc6734abfb7bf17260f14fa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.759367 9855 ts_tablet_manager.cc:1428] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.015s user 0.003s sys 0.003s
I20260928 14:50:33.759825 9855 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.761902 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 3233b0dcc6734abfb7bf17260f14fa1f (DEFAULT_TABLE table=default.Table_91e5170452f74c3faf4b1cb25ab48e7e [id=4ef2ed75244f497592eb44a0328a275c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.762272 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3233b0dcc6734abfb7bf17260f14fa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.764246 9256 tablet_service.cc:1467] Processing CreateTablet for tablet d935c6fb85354cb6b0131cc17490bf5c (DEFAULT_TABLE table=default.Table_5dc7dfd8d10d471b9360ab4188c1e1ee [id=a8f47c1a6ff14f63a0931e657d0f69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.764883 9529 tablet_service.cc:1467] Processing CreateTablet for tablet d935c6fb85354cb6b0131cc17490bf5c (DEFAULT_TABLE table=default.Table_5dc7dfd8d10d471b9360ab4188c1e1ee [id=a8f47c1a6ff14f63a0931e657d0f69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.764985 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d935c6fb85354cb6b0131cc17490bf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.765615 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d935c6fb85354cb6b0131cc17490bf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.767256 9855 tablet_bootstrap.cc:654] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.770221 9851 tablet_bootstrap.cc:654] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.773687 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 86bf3a9ff1474e609dbafd7ffb9130a6 (DEFAULT_TABLE table=default.Table_7005aebec4a34d70b546ead87e628c3b [id=480652d955504f2480e04e219b027f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.774040 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86bf3a9ff1474e609dbafd7ffb9130a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.778162 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 86bf3a9ff1474e609dbafd7ffb9130a6 (DEFAULT_TABLE table=default.Table_7005aebec4a34d70b546ead87e628c3b [id=480652d955504f2480e04e219b027f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.779074 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86bf3a9ff1474e609dbafd7ffb9130a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.781857 9814 ts_tablet_manager.cc:1918] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.782837 9814 log.cc:1196] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:33.784219 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 598523e862d74ed982f2fa7757f95619 (DEFAULT_TABLE table=default.Table_1eb1ac72cc9d46e4948c87c000d87cb6 [id=b6d9f1a345544451b5284a7f124d7846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.784922 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 598523e862d74ed982f2fa7757f95619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.785207 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 598523e862d74ed982f2fa7757f95619 (DEFAULT_TABLE table=default.Table_1eb1ac72cc9d46e4948c87c000d87cb6 [id=b6d9f1a345544451b5284a7f124d7846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.785655 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 9a1a6f397cee4b54ac2a39d19b132b23 (DEFAULT_TABLE table=default.Table_aac83c42b32f4807a59c6fd187ee04ac [id=ff7f5bbad8624fa38ffe79cf93218d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.786645 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 598523e862d74ed982f2fa7757f95619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.787683 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.787895 9815 tablet_replica.cc:330] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.788060 9815 raft_consensus.cc:2229] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.788228 9815 raft_consensus.cc:2258] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.788947 9815 ts_tablet_manager.cc:1905] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.789467 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.790529 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.791393 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.792335 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.795032 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.795257 9815 ts_tablet_manager.cc:1918] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.795397 9815 log.cc:1196] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:33.795905 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 9a1a6f397cee4b54ac2a39d19b132b23 (DEFAULT_TABLE table=default.Table_aac83c42b32f4807a59c6fd187ee04ac [id=ff7f5bbad8624fa38ffe79cf93218d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.796255 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a1a6f397cee4b54ac2a39d19b132b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.796689 9815 ts_tablet_manager.cc:1939] T 86f11c5ca3154bac934cae3842f16de4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:33.797348 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.801364 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a1a6f397cee4b54ac2a39d19b132b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.802022 9815 tablet_replica.cc:330] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.802124 9814 ts_tablet_manager.cc:1939] T bad2124268994f04ae7153ea5aaeeab0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:33.802312 9815 raft_consensus.cc:2229] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.802484 9815 raft_consensus.cc:2258] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.803603 9814 tablet_replica.cc:330] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:33.803959 9497 consensus_peers.cc:487] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:33.804945 9815 ts_tablet_manager.cc:1905] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.805577 9814 raft_consensus.cc:2229] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.805788 9814 raft_consensus.cc:2258] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.809285 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet bad2124268994f04ae7153ea5aaeeab0 (table default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]) successfully deleted
W20260928 14:50:33.811520 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7a2f051a09e143b8bb0ba3be81406b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2f051a09e143b8bb0ba3be81406b98 already in progress: creating tablet
I20260928 14:50:33.814424 10631 raft_consensus.cc:482] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.814551 10631 raft_consensus.cc:504] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.815091 10631 leader_election.cc:288] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.819165 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 86f11c5ca3154bac934cae3842f16de4 (table default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]) successfully deleted
I20260928 14:50:33.824908 9855 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.825142 9855 ts_tablet_manager.cc:1397] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.004s
I20260928 14:50:33.817734 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:33.827638 9855 raft_consensus.cc:348] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.827929 9855 raft_consensus.cc:374] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.828040 9855 raft_consensus.cc:729] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.828349 9855 consensus_queue.cc:260] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.829319 9855 ts_tablet_manager.cc:1428] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:33.830505 9855 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:33.833069 9497 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.847949 9855 tablet_bootstrap.cc:654] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.850967 9815 ts_tablet_manager.cc:1918] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.851505 9815 log.cc:1196] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7ef356a4c9d34af4b300d38eab49a569
I20260928 14:50:33.852715 10631 raft_consensus.cc:482] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.852828 10631 raft_consensus.cc:504] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.853398 10631 leader_election.cc:288] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.854522 9815 ts_tablet_manager.cc:1939] T 7ef356a4c9d34af4b300d38eab49a569 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:33.854746 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b1df25948af14998a26b36bb5b466a1e (table default.Table_84280ea01fa6441ebb483c2c09cb42db [id=37f211d75f004ca08ff659cd19d592e9]). Expected version 1 got 0
I20260928 14:50:33.855147 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:33.859556 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05131db52e94d7c9f4856b0455246d2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:33.860536 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7ef356a4c9d34af4b300d38eab49a569 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
I20260928 14:50:33.860529 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.860893 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.861198 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.861712 9815 tablet_replica.cc:330] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.862071 9815 raft_consensus.cc:2229] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.862370 9815 raft_consensus.cc:2258] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.863265 9815 ts_tablet_manager.cc:1905] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:33.863559 9219 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:33.863958 10386 leader_election.cc:288] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.864931 9814 ts_tablet_manager.cc:1905] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.865914 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4729fc718bf540ecb501c2cac3966bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:33.851660 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 3348f5a55ef34af88611077aab447f83 (DEFAULT_TABLE table=default.Table_74a626e855bc41ecb2d3684dae5c9346 [id=75d5b862c2804a409d82b2b2b33afda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:33.869812 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ffc5bee62845519a4b7ee8c914e70d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.870401 9497 leader_election.cc:341] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.872797 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet f81dfe4d10424288b8b450c62d10a92e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:33.883692 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 3233b0dcc6734abfb7bf17260f14fa1f (DEFAULT_TABLE table=default.Table_91e5170452f74c3faf4b1cb25ab48e7e [id=4ef2ed75244f497592eb44a0328a275c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:33.875571 9360 leader_election.cc:341] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 066df778654449bda96f68b5035c4d73
W20260928 14:50:33.884781 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 160481us
I20260928 14:50:33.885681 10546 raft_consensus.cc:482] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.885841 10614 raft_consensus.cc:482] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.881052 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c20a70834344c7937f96ab5fae2049" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:33.889225 9220 leader_election.cc:302] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:33.903674 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e3dd5704ce1494096b9810b983fc8a9" } modify_external_catalogs: true
I20260928 14:50:33.903908 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e3dd5704ce1494096b9810b983fc8a9" } modify_external_catalogs: true
I20260928 14:50:33.908088 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_40809d57eacb44dea6a88cd21516512a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.908895 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40809d57eacb44dea6a88cd21516512a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.920360 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8bd49281d920462e90ddcd6c29877c4b" } modify_external_catalogs: true
I20260928 14:50:33.920763 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a809f55fc9f74186ac02d15951aeff1e" } new_table_name: "default.Table_75c33bec6a9447f98f1bab145ed54509" modify_external_catalogs: true
I20260928 14:50:33.923512 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_22f2a27e142e4b97a331706f380ad184"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.924167 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22f2a27e142e4b97a331706f380ad184 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.925290 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7dd5d5888c7d425ab48023cafda7fa64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.925870 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dd5d5888c7d425ab48023cafda7fa64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.926400 9851 tablet_bootstrap.cc:492] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:33.926837 9851 ts_tablet_manager.cc:1397] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.320s user 0.012s sys 0.015s
I20260928 14:50:33.926977 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_18bf397043f247ce852099afb93bb980"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.927603 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18bf397043f247ce852099afb93bb980 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.928223 9851 raft_consensus.cc:348] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.928702 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:33.928740 9851 raft_consensus.cc:374] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.929157 9851 raft_consensus.cc:729] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.929296 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.929440 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f17ae9239f804baeb39a1a48f4dd7cd0" } modify_external_catalogs: true
I20260928 14:50:33.929833 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f17ae9239f804baeb39a1a48f4dd7cd0" } modify_external_catalogs: true
I20260928 14:50:33.930354 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:33.930974 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_19caea08036943b0b17c5e53d8c486b3" } modify_external_catalogs: true
I20260928 14:50:33.931236 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_19caea08036943b0b17c5e53d8c486b3" } modify_external_catalogs: true
I20260928 14:50:33.930248 9851 consensus_queue.cc:260] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:33.932852 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2d639e49570c44278e4e9dfbff7c7bab" } new_table_name: "default.Table_13cca1a2e79e4301b51736b5837ed4e7" modify_external_catalogs: true
I20260928 14:50:33.934480 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8bd49281d920462e90ddcd6c29877c4b" } modify_external_catalogs: true
I20260928 14:50:33.934410 9851 ts_tablet_manager.cc:1428] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260928 14:50:33.935750 9851 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:33.935863 9815 ts_tablet_manager.cc:1918] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.935984 9815 log.cc:1196] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/274ab65ebc2d41db9dc5d8a0139f9bc9
I20260928 14:50:33.936575 9815 ts_tablet_manager.cc:1939] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:33.938793 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (table default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]) successfully deleted
I20260928 14:50:33.939348 9815 tablet_replica.cc:330] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.939783 9815 raft_consensus.cc:2229] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.939935 9815 raft_consensus.cc:2258] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.940685 9815 ts_tablet_manager.cc:1905] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.941425 9855 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.946290 9851 tablet_bootstrap.cc:654] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.946385 9855 ts_tablet_manager.cc:1397] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.012s
I20260928 14:50:33.947541 9855 raft_consensus.cc:348] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.947803 9855 raft_consensus.cc:374] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.947906 9855 raft_consensus.cc:729] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.948231 9855 consensus_queue.cc:260] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.949041 10631 raft_consensus.cc:482] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.949148 10631 raft_consensus.cc:504] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.949988 10631 leader_election.cc:288] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.954398 10641 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:33.956202 10386 raft_consensus.cc:2726] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:33.961587 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.962141 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d08466aa7d54f12b137986258a6d174 consensus state has no leader
W20260928 14:50:33.962148 9497 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.963527 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_a235a0c6603143439c7a545281e9754a [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 5 got 0
I20260928 14:50:33.963692 9855 ts_tablet_manager.cc:1428] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260928 14:50:33.964515 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ebdec478d58042548c75729bd5b6c7c7" } new_table_name: "default.Table_4b9a6480b5fe4c6db2eb4186012566d5" modify_external_catalogs: true
I20260928 14:50:33.971385 10630 raft_consensus.cc:482] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:33.971501 10630 raft_consensus.cc:504] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:33.972082 10630 leader_election.cc:288] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:33.974531 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfacaf069e3746aeb8ca11d95e65c5ea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:33.975134 9497 leader_election.cc:341] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:33.976012 9855 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:33.979969 9855 tablet_bootstrap.cc:654] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:33.984022 10641 tablet.cc:1722] T d8c20a70834344c7937f96ab5fae2049 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 14:50:33.986863 9815 ts_tablet_manager.cc:1918] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:33.987246 9815 log.cc:1196] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/11f9b039838a430eac3fd422f0f4d087
I20260928 14:50:33.987622 9815 ts_tablet_manager.cc:1939] T 11f9b039838a430eac3fd422f0f4d087 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:33.988269 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6e4ce1f9eed42abb3688716dc6733cf consensus state has no leader
I20260928 14:50:33.988827 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 11f9b039838a430eac3fd422f0f4d087 (table default.Table_e762fd7ab0074c308dc4407d3c3f70a9 [id=e249dfbd0f314fe7a4283f46d66dfd61]) successfully deleted
I20260928 14:50:33.989174 9815 tablet_replica.cc:330] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:33.989380 9815 raft_consensus.cc:2229] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:33.989614 9815 raft_consensus.cc:2258] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:33.989970 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 24c45934c64642c2b171cb42544728bc
I20260928 14:50:33.990837 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c45934c64642c2b171cb42544728bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.990175 9815 ts_tablet_manager.cc:1905] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:33.990836 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d1f0ac6c967e43d7bbe7fdb8db9f14e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.991494 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1f0ac6c967e43d7bbe7fdb8db9f14e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.992997 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2df12117111548beb5d570436e2d6de2
I20260928 14:50:33.993598 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:33.993762 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dec376dac1344cd4b134f320b973e812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:33.994426 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dec376dac1344cd4b134f320b973e812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:33.995497 9855 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:33.995666 9855 ts_tablet_manager.cc:1397] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.005s
I20260928 14:50:33.996244 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6459cd3ed4fe42c897a4fbe2d97611eb" } new_table_name: "default.Table_91fba5be108742dfadfae0e7c4aa61f6" modify_external_catalogs: true
I20260928 14:50:33.997390 9855 raft_consensus.cc:348] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.997610 9855 raft_consensus.cc:374] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:33.997666 9855 raft_consensus.cc:729] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:33.997989 9855 consensus_queue.cc:260] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:33.999152 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_885f9ac0ea4c4c918834dd9e3fa63889" } new_table_name: "default.Table_afcf04581e334591951dbfb4c5d17b8c" modify_external_catalogs: true
I20260928 14:50:34.000859 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_64407deb9d1b496889a06e24ac68b9ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.001663 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64407deb9d1b496889a06e24ac68b9ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.002044 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 92d1100b862b4170807be02a39307359
I20260928 14:50:34.003336 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cfb37e10a1a64ee2965cbfcd70f87adf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.004002 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfb37e10a1a64ee2965cbfcd70f87adf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.005962 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.006691 9855 ts_tablet_manager.cc:1428] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260928 14:50:34.006863 10386 raft_consensus.cc:482] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.007084 10386 raft_consensus.cc:504] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.008064 10386 leader_election.cc:288] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.008544 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c45934c64642c2b171cb42544728bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.008694 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.009156 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.012478 9855 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:34.013031 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_32e300160b6d40b6b78f7cab5973cd76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.013792 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32e300160b6d40b6b78f7cab5973cd76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.005460 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_a235a0c6603143439c7a545281e9754a [id=c90173a37f6f4615a34f85216ec6d750]). Expected version 5 got 4
W20260928 14:50:34.014878 9219 leader_election.cc:341] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 4bd612753b914a079ccf89249b073018
I20260928 14:50:34.015542 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
I20260928 14:50:34.016458 9851 tablet_bootstrap.cc:492] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.016621 9851 ts_tablet_manager.cc:1397] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.081s user 0.007s sys 0.011s
I20260928 14:50:34.016770 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a828130854b4e4e8c44b2b45260e50e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.017606 9851 raft_consensus.cc:348] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.017921 9851 raft_consensus.cc:374] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.018785 9851 raft_consensus.cc:729] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.019141 9851 consensus_queue.cc:260] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.023324 9851 ts_tablet_manager.cc:1428] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260928 14:50:34.023639 9851 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.041229 9851 tablet_bootstrap.cc:654] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.045830 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.048249 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.049190 10549 consensus_queue.cc:1035] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.325s
I20260928 14:50:34.051164 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:34.052175 9428 raft_consensus.cc:3037] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.052484 9427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1eb8a9faf04e3b97db9e0f8e9104f8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.052958 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3348f5a55ef34af88611077aab447f83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:34.053396 9360 leader_election.cc:341] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.053546 9360 leader_election.cc:302] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:34.053853 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 168429us
I20260928 14:50:34.053889 9814 ts_tablet_manager.cc:1918] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.054009 9814 log.cc:1196] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:34.054358 9814 ts_tablet_manager.cc:1939] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.054597 10546 raft_consensus.cc:504] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.054864 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 603) took 1127 ms. Trace:
I20260928 14:50:34.054970 9814 rpcz_store.cc:276] 0928 14:50:32.927140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.927316 (+ 176us) service_pool.cc:227] Handling call
0928 14:50:33.803070 (+875754us) ts_tablet_manager.cc:1145] Deleting tablet ee1eb8a9faf04e3b97db9e0f8e9104f8
0928 14:50:33.803078 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.049198 (+246120us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.053775 (+ 4577us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.054831 (+ 1056us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847745}
I20260928 14:50:34.055428 10546 leader_election.cc:288] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.055423 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (table default.Table_b83606ed237744d88ba3ebb26186e236 [id=653bfb0f2b28414e968985203ce7a611]) successfully deleted
I20260928 14:50:34.055716 9814 tablet_replica.cc:330] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.055717 10546 raft_consensus.cc:2726] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.055904 9814 raft_consensus.cc:2229] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.056048 9814 raft_consensus.cc:2258] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.056134 10614 raft_consensus.cc:504] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.056674 10614 leader_election.cc:288] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.056950 9814 ts_tablet_manager.cc:1905] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.057502 9427 raft_consensus.cc:2454] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:34.059120 9220 leader_election.cc:302] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:34.059342 9220 raft_consensus.cc:2670] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:34.061651 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67956e8ba12d4411bfca6263b84aa93e consensus state has no leader
I20260928 14:50:34.062264 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cc14ad35a4de45f19a8409e3a29b6bf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.062471 9220 leader_election.cc:341] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: 4bd612753b914a079ccf89249b073018
I20260928 14:50:34.062748 9851 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.062865 9220 leader_election.cc:302] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.063378 10386 raft_consensus.cc:2726] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:34.063596 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc14ad35a4de45f19a8409e3a29b6bf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.064131 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ffc5bee62845519a4b7ee8c914e70d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.062901 9851 ts_tablet_manager.cc:1397] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.002s
I20260928 14:50:34.066049 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 9a1a6f397cee4b54ac2a39d19b132b23 (DEFAULT_TABLE table=default.Table_aac83c42b32f4807a59c6fd187ee04ac [id=ff7f5bbad8624fa38ffe79cf93218d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.066082 9851 raft_consensus.cc:348] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.066442 9851 raft_consensus.cc:374] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.066603 9851 raft_consensus.cc:729] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:34.066617 9498 leader_election.cc:341] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.066740 9498 leader_election.cc:302] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.066965 10630 raft_consensus.cc:2726] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.067023 9851 consensus_queue.cc:260] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.067240 9421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.067783 10556 raft_consensus.cc:482] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.067889 9851 ts_tablet_manager.cc:1428] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:34.068356 9851 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.070438 9851 tablet_bootstrap.cc:654] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:34.073272 9498 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.073390 9498 leader_election.cc:302] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.073735 10630 raft_consensus.cc:2726] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:34.074191 9426 consensus_meta.cc:287] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Time spent flushing consensus metadata: real 0.507s user 0.002s sys 0.002s
I20260928 14:50:34.075460 9814 ts_tablet_manager.cc:1918] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.075706 9814 log.cc:1196] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:34.076191 9814 ts_tablet_manager.cc:1939] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.076735 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 607) took 1104 ms. Trace:
I20260928 14:50:34.076972 9814 rpcz_store.cc:276] 0928 14:50:32.972683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.972737 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:34.055658 (+1082921us) ts_tablet_manager.cc:1145] Deleting tablet 311e4286b2a943ee924ac1c25dc9ca46
0928 14:50:34.055669 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.060835 (+ 5166us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.075272 (+ 14437us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.076685 (+ 1413us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1082567}
I20260928 14:50:34.077564 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 311e4286b2a943ee924ac1c25dc9ca46 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]) successfully deleted
I20260928 14:50:34.079293 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 37273935d3d64d9fa436085720f05302 (DEFAULT_TABLE table=default.Table_d7844c3ccdc942cc8cd00e7cf31c0686 [id=bb6622895372474096dbf81c74f786ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.079473 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 116a4dfadd074531a0c0421519588343 (DEFAULT_TABLE table=default.Table_7f5d7b2677654d9f90a269e23dc49186 [id=977d8dab063b4a6599125d391285bb41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.079854 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37273935d3d64d9fa436085720f05302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.080170 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116a4dfadd074531a0c0421519588343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.080415 9423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.080667 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c51f5944c6534e9492594c39ae9796b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51f5944c6534e9492594c39ae9796b2 already in progress: creating tablet
I20260928 14:50:34.081776 9392 tablet_service.cc:1467] Processing CreateTablet for tablet d935c6fb85354cb6b0131cc17490bf5c (DEFAULT_TABLE table=default.Table_5dc7dfd8d10d471b9360ab4188c1e1ee [id=a8f47c1a6ff14f63a0931e657d0f69d8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:34.082760 9498 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.082870 9498 leader_election.cc:302] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:34.084172 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b8738a1591f644758f44fc720fd694a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8738a1591f644758f44fc720fd694a3 already in progress: creating tablet
I20260928 14:50:34.087088 9426 raft_consensus.cc:2454] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.087971 10556 raft_consensus.cc:3037] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.088152 10484 raft_consensus.cc:2726] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.089846 9263 tablet_service.cc:1467] Processing CreateTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c (DEFAULT_TABLE table=default.Table_658d0d60d5d542cca24520229c3b736e [id=64cc10ff39c14d0f9b18daf9b358c034]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.090385 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b3b4611c6c4e96a7ac8df34eaab11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.093329 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d4fc720b05f40a0844cf79a886abacc" } modify_external_catalogs: true
I20260928 14:50:34.092844 9814 tablet_replica.cc:330] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.094028 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d4fc720b05f40a0844cf79a886abacc" } modify_external_catalogs: true
I20260928 14:50:34.096331 9814 raft_consensus.cc:2229] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.093750 9851 tablet_bootstrap.cc:492] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.096666 9851 ts_tablet_manager.cc:1397] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260928 14:50:34.097500 9851 raft_consensus.cc:348] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:34.097791 9851 raft_consensus.cc:374] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.097901 9851 raft_consensus.cc:729] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.098129 9851 consensus_queue.cc:260] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:34.098750 9851 ts_tablet_manager.cc:1428] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:34.098958 9814 raft_consensus.cc:2258] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.099705 9814 ts_tablet_manager.cc:1905] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.099236 9851 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.102994 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfacaf069e3746aeb8ca11d95e65c5ea" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.106966 9498 leader_election.cc:341] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.107136 9498 leader_election.cc:302] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:34.107293 9498 raft_consensus.cc:2670] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:34.109596 9851 tablet_bootstrap.cc:654] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.118669 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a1a6f397cee4b54ac2a39d19b132b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.124876 9851 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.125128 9851 ts_tablet_manager.cc:1397] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260928 14:50:34.126032 9851 raft_consensus.cc:348] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.126276 9851 raft_consensus.cc:374] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.126405 9851 raft_consensus.cc:729] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.126653 9851 consensus_queue.cc:260] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.127264 9851 ts_tablet_manager.cc:1428] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:34.127811 9851 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.129689 9851 tablet_bootstrap.cc:654] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.132370 9814 ts_tablet_manager.cc:1918] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.132562 9814 log.cc:1196] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4bd612753b914a079ccf89249b073018
I20260928 14:50:34.135231 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 116a4dfadd074531a0c0421519588343 (DEFAULT_TABLE table=default.Table_7f5d7b2677654d9f90a269e23dc49186 [id=977d8dab063b4a6599125d391285bb41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.137845 9814 ts_tablet_manager.cc:1939] T 4bd612753b914a079ccf89249b073018 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.138494 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116a4dfadd074531a0c0421519588343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.138896 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4bd612753b914a079ccf89249b073018 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]) successfully deleted
I20260928 14:50:34.139920 9814 tablet_replica.cc:330] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.140290 9814 raft_consensus.cc:2229] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.140533 9814 raft_consensus.cc:2258] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.141446 9814 ts_tablet_manager.cc:1905] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.142360 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 37273935d3d64d9fa436085720f05302 (DEFAULT_TABLE table=default.Table_d7844c3ccdc942cc8cd00e7cf31c0686 [id=bb6622895372474096dbf81c74f786ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.142706 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37273935d3d64d9fa436085720f05302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.143934 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:34.144306 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:34.152611 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:34.153302 9851 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.153429 9851 ts_tablet_manager.cc:1397] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260928 14:50:34.154275 9851 raft_consensus.cc:348] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.154525 9851 raft_consensus.cc:374] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.154625 9851 raft_consensus.cc:729] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.154863 9851 consensus_queue.cc:260] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.155431 9851 ts_tablet_manager.cc:1428] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:34.155714 9851 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.158703 9851 tablet_bootstrap.cc:654] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:34.161231 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad549aa4257d497ab7f03b3cdd734968 consensus state has no leader
W20260928 14:50:34.161478 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59ced67c921e43e48bcb5195da212582 consensus state has no leader
I20260928 14:50:34.162027 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e92b08254f4041e482e7fa1935dd7071
I20260928 14:50:34.162684 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.162891 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_795852c44f3e445fb688726c11fb5c42" } modify_external_catalogs: true
I20260928 14:50:34.163223 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_795852c44f3e445fb688726c11fb5c42" } modify_external_catalogs: true
I20260928 14:50:34.164218 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet e92b08254f4041e482e7fa1935dd7071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.165146 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_224b699f0cba4133a5ffb1e73d69d754" } new_table_name: "default.Table_7dcd72b94fb2427d9e4e57a1cbb291ee" modify_external_catalogs: true
I20260928 14:50:34.171638 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d935c6fb85354cb6b0131cc17490bf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.172240 9424 raft_consensus.cc:2454] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.173385 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3233b0dcc6734abfb7bf17260f14fa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.180151 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d34a235b38aa4e9ba328a7f542342653
I20260928 14:50:34.183338 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet d34a235b38aa4e9ba328a7f542342653 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.185098 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet e92b08254f4041e482e7fa1935dd7071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.190294 9220 leader_election.cc:302] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:34.190874 9220 raft_consensus.cc:2670] T 311e4286b2a943ee924ac1c25dc9ca46 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:34.191828 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet d34a235b38aa4e9ba328a7f542342653 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.192647 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7535e922d06d4529856d59f1e12de3d3" } modify_external_catalogs: true
I20260928 14:50:34.192991 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7535e922d06d4529856d59f1e12de3d3" } modify_external_catalogs: true
I20260928 14:50:34.197371 9814 ts_tablet_manager.cc:1918] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.198515 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_38143067447e44d483568617ab9d9e13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.199818 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38143067447e44d483568617ab9d9e13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.200510 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 86bf3a9ff1474e609dbafd7ffb9130a6 (DEFAULT_TABLE table=default.Table_7005aebec4a34d70b546ead87e628c3b [id=480652d955504f2480e04e219b027f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.203717 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c9da29b5882b442392a3f79e5a737ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.204249 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9da29b5882b442392a3f79e5a737ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.205084 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_039a4d4fbb964bdb995a4b30b21ef7bf" } modify_external_catalogs: true
I20260928 14:50:34.205300 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_039a4d4fbb964bdb995a4b30b21ef7bf" } modify_external_catalogs: true
I20260928 14:50:34.206153 9851 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.206315 9851 ts_tablet_manager.cc:1397] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.005s
I20260928 14:50:34.207080 9851 raft_consensus.cc:348] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.207311 9851 raft_consensus.cc:374] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.207374 9851 raft_consensus.cc:729] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.207602 9851 consensus_queue.cc:260] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.208932 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e4fdf91d5a91446caa0fb71fa8fbab00" } modify_external_catalogs: true
I20260928 14:50:34.209122 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e4fdf91d5a91446caa0fb71fa8fbab00" } modify_external_catalogs: true
I20260928 14:50:34.209599 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_490e1f7324f14b858efd98a2937f0bb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.210119 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_490e1f7324f14b858efd98a2937f0bb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.210621 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8c99043954b44135b9b0bf8d933aed70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.211115 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c99043954b44135b9b0bf8d933aed70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.209246 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 598523e862d74ed982f2fa7757f95619 (DEFAULT_TABLE table=default.Table_1eb1ac72cc9d46e4948c87c000d87cb6 [id=b6d9f1a345544451b5284a7f124d7846]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:34.212277 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c073b27ed9d14c178caa3080ff0737ff consensus state has no leader
I20260928 14:50:34.212344 9428 raft_consensus.cc:2454] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.212718 9220 leader_election.cc:302] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:34.212931 9220 raft_consensus.cc:2670] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:34.221870 10630 raft_consensus.cc:482] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.222008 10630 raft_consensus.cc:504] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.222584 10630 leader_election.cc:288] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.223085 9851 ts_tablet_manager.cc:1428] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20260928 14:50:34.224153 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:34.224771 9497 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.225646 9851 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.230402 8946 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:34.236812 9851 tablet_bootstrap.cc:654] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.237447 9848 tablet_bootstrap.cc:654] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:34.247670 9405 consensus_meta.cc:287] T 6eec5384f8914b398de78f01bf52b9d9 P ae832871bd1142f7af10c084115ffc12: Time spent flushing consensus metadata: real 0.525s user 0.004s sys 0.000s
W20260928 14:50:34.249099 9390 consensus_meta.cc:287] T 2b230e43173849e1903a2871fa4b0f91 P ae832871bd1142f7af10c084115ffc12: Time spent flushing consensus metadata: real 0.524s user 0.005s sys 0.000s
I20260928 14:50:34.249372 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86bf3a9ff1474e609dbafd7ffb9130a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.256019 9543 tablet_service.cc:1467] Processing CreateTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c (DEFAULT_TABLE table=default.Table_658d0d60d5d542cca24520229c3b736e [id=64cc10ff39c14d0f9b18daf9b358c034]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.256408 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b3b4611c6c4e96a7ac8df34eaab11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.262832 9851 tablet_bootstrap.cc:492] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.262989 9851 ts_tablet_manager.cc:1397] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.004s
I20260928 14:50:34.263747 9851 raft_consensus.cc:348] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.264006 9851 raft_consensus.cc:374] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.264098 9851 raft_consensus.cc:729] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.264323 9851 consensus_queue.cc:260] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.264886 9851 ts_tablet_manager.cc:1428] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:34.266547 9851 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.234985 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:34.267112 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:34.270645 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.271203 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c45934c64642c2b171cb42544728bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.271761 9851 tablet_bootstrap.cc:654] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.277554 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 598523e862d74ed982f2fa7757f95619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.280529 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.280735 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.280836 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.281080 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.281111 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 37273935d3d64d9fa436085720f05302 (DEFAULT_TABLE table=default.Table_d7844c3ccdc942cc8cd00e7cf31c0686 [id=bb6622895372474096dbf81c74f786ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.281489 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37273935d3d64d9fa436085720f05302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.283282 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.283802 9498 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.283927 9498 leader_election.cc:302] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.284088 8951 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 7cc5be2fb5cb42f8a6a07705405d4a8d
I20260928 14:50:34.284667 10556 raft_consensus.cc:504] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.285822 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:34.286243 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
I20260928 14:50:34.286459 10630 raft_consensus.cc:2726] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.286620 10630 raft_consensus.cc:482] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.286711 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:34.286715 10630 raft_consensus.cc:504] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.287145 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:34.287263 10630 leader_election.cc:288] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.288808 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad844de91e4040c3a8ae4873c0fa6ba4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.289296 9498 leader_election.cc:341] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.289808 9814 log.cc:1196] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:34.291028 10556 leader_election.cc:288] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.289780 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 066df778654449bda96f68b5035c4d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.290933 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad844de91e4040c3a8ae4873c0fa6ba4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.291833 9851 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.292349 9851 ts_tablet_manager.cc:1397] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.004s
W20260928 14:50:34.292526 9497 leader_election.cc:341] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.292635 9497 leader_election.cc:302] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.292924 10484 raft_consensus.cc:2726] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.293345 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9961b24814874d1aab1daecdf3ac19e2" } new_table_name: "default.Table_2f8e54c563e346c98a7f64bdb9d38c92" modify_external_catalogs: true
I20260928 14:50:34.293474 9851 raft_consensus.cc:348] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.293823 9851 raft_consensus.cc:374] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.293920 9851 raft_consensus.cc:729] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.294224 9851 consensus_queue.cc:260] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.294577 10484 raft_consensus.cc:482] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.294689 10484 raft_consensus.cc:504] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.295168 10484 leader_election.cc:288] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.297123 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a303792e4c804844bc6037fabb425be4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.297276 9851 ts_tablet_manager.cc:1428] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:34.297557 9851 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.297765 10484 raft_consensus.cc:482] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.297869 10484 raft_consensus.cc:504] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.298369 10484 leader_election.cc:288] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:34.299047 9497 leader_election.cc:341] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.299165 9851 tablet_bootstrap.cc:654] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.299342 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11714d0ca321429c95de223320794a0e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:34.299943 9497 leader_election.cc:341] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.300249 9814 ts_tablet_manager.cc:1939] T f05131db52e94d7c9f4856b0455246d2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.301476 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f05131db52e94d7c9f4856b0455246d2 (table default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]) successfully deleted
I20260928 14:50:34.301860 9814 tablet_replica.cc:330] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.302157 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.303076 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 116a4dfadd074531a0c0421519588343 (DEFAULT_TABLE table=default.Table_7f5d7b2677654d9f90a269e23dc49186 [id=977d8dab063b4a6599125d391285bb41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.303447 9814 raft_consensus.cc:2229] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.303467 10386 raft_consensus.cc:482] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.303634 10386 raft_consensus.cc:504] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:34.303953 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116a4dfadd074531a0c0421519588343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.303634 9814 raft_consensus.cc:2258] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.304378 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11714d0ca321429c95de223320794a0e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.304682 9814 ts_tablet_manager.cc:1905] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.305210 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:34.305312 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.304169 10386 leader_election.cc:288] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:34.306680 9498 leader_election.cc:341] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.306770 9498 leader_election.cc:302] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.307595 10484 raft_consensus.cc:2726] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.309087 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a303792e4c804844bc6037fabb425be4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.309895 9498 leader_election.cc:341] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.309988 9498 leader_election.cc:302] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.310371 10484 raft_consensus.cc:2726] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.312913 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254ab608221e4fe2bc459f9d6fee925a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.314194 9220 leader_election.cc:302] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.314405 10386 raft_consensus.cc:2726] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.316442 9851 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.316565 9851 ts_tablet_manager.cc:1397] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260928 14:50:34.317188 9851 raft_consensus.cc:348] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.317380 9851 raft_consensus.cc:374] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.317425 9851 raft_consensus.cc:729] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.317607 9851 consensus_queue.cc:260] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.318070 9851 ts_tablet_manager.cc:1428] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260928 14:50:34.319415 9851 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.320708 9851 tablet_bootstrap.cc:654] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.324787 9814 ts_tablet_manager.cc:1918] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.324807 9813 ts_tablet_manager.cc:1918] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:34.325084 9398 tablet_service.cc:1467] Processing CreateTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c (DEFAULT_TABLE table=default.Table_658d0d60d5d542cca24520229c3b736e [id=64cc10ff39c14d0f9b18daf9b358c034]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.325868 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b3b4611c6c4e96a7ac8df34eaab11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.326604 9814 log.cc:1196] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:34.326907 9814 ts_tablet_manager.cc:1939] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.327595 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 999aa56f1683464d9612a2ddbfbebbda (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:34.327696 9814 tablet_replica.cc:330] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.327859 9814 raft_consensus.cc:2229] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.328003 9814 raft_consensus.cc:2258] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:34.328086 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 148e81f8add349f2b233862a7049e54c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148e81f8add349f2b233862a7049e54c already in progress: creating tablet
W20260928 14:50:34.328338 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 05a9e2d2794545eab75daf61d75272c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05a9e2d2794545eab75daf61d75272c6 already in progress: creating tablet
I20260928 14:50:34.328471 9814 ts_tablet_manager.cc:1905] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.332031 10484 raft_consensus.cc:482] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.332171 10484 raft_consensus.cc:504] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.332774 10484 leader_election.cc:288] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.330188 9851 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.333562 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.333654 9851 ts_tablet_manager.cc:1397] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
W20260928 14:50:34.334120 9497 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.334277 9851 raft_consensus.cc:348] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.334467 9851 raft_consensus.cc:374] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.334522 9851 raft_consensus.cc:729] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.334726 9851 consensus_queue.cc:260] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.334892 9855 tablet_bootstrap.cc:654] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.335220 9851 ts_tablet_manager.cc:1428] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260928 14:50:34.336311 9813 log.cc:1196] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5e0b8288fc9b47ce8c70dec324dfecf0
I20260928 14:50:34.336429 9851 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.338019 9851 tablet_bootstrap.cc:654] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.341384 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet aaacc1f839914859b23ae755042e02d8
I20260928 14:50:34.342005 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet e92b08254f4041e482e7fa1935dd7071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.342348 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.342556 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.343557 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 88015bcd867e40e5b9263930e820074a (table default.Table_67d8c754b00c4bc083809df338bf770a [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]). Expected version 4 got 0
I20260928 14:50:34.343637 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7eb037389ef54e5f97821cf8134be4ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.344220 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eb037389ef54e5f97821cf8134be4ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.345016 9814 ts_tablet_manager.cc:1918] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.345127 9814 log.cc:1196] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:34.345376 9814 ts_tablet_manager.cc:1939] T fd24e60a0e944f6086ff9c9fbe2e8180 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.347280 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.347745 9498 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.347867 9498 leader_election.cc:302] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.348304 10484 raft_consensus.cc:2726] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.349668 9813 ts_tablet_manager.cc:1939] T 5e0b8288fc9b47ce8c70dec324dfecf0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:34.350040 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 445) took 5193 ms. Trace:
I20260928 14:50:34.350163 9813 rpcz_store.cc:276] 0928 14:50:29.156368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.156739 (+ 371us) service_pool.cc:227] Handling call
0928 14:50:33.424700 (+4267961us) ts_tablet_manager.cc:1145] Deleting tablet 5e0b8288fc9b47ce8c70dec324dfecf0
0928 14:50:33.424713 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.111244 (+686531us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.324700 (+213456us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.350027 (+ 25327us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51607,"tablet-delete.queue_time_us":4248174}
I20260928 14:50:34.347524 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.351042 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet d34a235b38aa4e9ba328a7f542342653 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.351377 9851 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.351497 9851 ts_tablet_manager.cc:1397] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260928 14:50:34.352301 9851 raft_consensus.cc:348] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.352501 9851 raft_consensus.cc:374] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.352568 9851 raft_consensus.cc:729] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.352862 9851 consensus_queue.cc:260] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.353433 9851 ts_tablet_manager.cc:1428] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:34.353752 9851 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.355551 9851 tablet_bootstrap.cc:654] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.353655 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f098c0f6e424ae3afd0d67cf01db2aa" } new_table_name: "default.Table_b34f8ded602249869f2d30667cb1bc04" modify_external_catalogs: true
I20260928 14:50:34.361799 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 451) took 5195 ms. Trace:
I20260928 14:50:34.362037 9813 rpcz_store.cc:276] 0928 14:50:29.166711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.166781 (+ 70us) service_pool.cc:227] Handling call
0928 14:50:34.350559 (+5183778us) ts_tablet_manager.cc:1145] Deleting tablet 86f11c5ca3154bac934cae3842f16de4
0928 14:50:34.350569 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.361778 (+ 11209us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5171694}
I20260928 14:50:34.364670 9814 tablet_replica.cc:330] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.364828 9814 raft_consensus.cc:2229] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.364985 9814 raft_consensus.cc:2258] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.365370 9813 tablet_replica.cc:330] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:34.365726 9813 raft_consensus.cc:2229] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.366022 9813 raft_consensus.cc:2258] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.368098 9813 ts_tablet_manager.cc:1905] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.370707 9851 tablet_bootstrap.cc:492] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.370877 9851 ts_tablet_manager.cc:1397] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20260928 14:50:34.371912 9851 raft_consensus.cc:348] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.372242 9851 raft_consensus.cc:374] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.372354 9851 raft_consensus.cc:729] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.372694 9851 consensus_queue.cc:260] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.373632 9851 ts_tablet_manager.cc:1428] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:34.374269 9851 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.377034 9851 tablet_bootstrap.cc:654] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:34.381399 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 327247us
I20260928 14:50:34.382112 10556 consensus_queue.cc:1035] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 14:50:34.358278 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4d3442fc50ac47deafcaab819720545b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.384696 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d3442fc50ac47deafcaab819720545b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.362178 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6e246f841a2543d69ee059defc37a2d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.363083 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet fd24e60a0e944f6086ff9c9fbe2e8180 (table default.Table_c10738b4aa7a42c2a6eef90a1999483a [id=9ef3939e8d864755819b15d57ed3b443]) successfully deleted
I20260928 14:50:34.363129 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6795a92d851b46ac8d69afae687ac7da" } new_table_name: "default.Table_694877d6ab66488382d654a68ca0c235" modify_external_catalogs: true
I20260928 14:50:34.364233 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5e0b8288fc9b47ce8c70dec324dfecf0 (table default.Table_1ec91a2f8ab14f82888c9ed84ff6433a [id=11115f212dde4f8e8ef6e06db5310c96]) successfully deleted
W20260928 14:50:34.385123 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e246f841a2543d69ee059defc37a2d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:34.385571 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 86f11c5ca3154bac934cae3842f16de4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f11c5ca3154bac934cae3842f16de4 already in progress: creating tablet
I20260928 14:50:34.365480 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]). Expected version 3 got 0
W20260928 14:50:34.386096 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 49d69e4ad9554da9871800c8b392851c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49d69e4ad9554da9871800c8b392851c already in progress: creating tablet
W20260928 14:50:34.386415 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f81dfe4d10424288b8b450c62d10a92e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f81dfe4d10424288b8b450c62d10a92e already in progress: creating tablet
W20260928 14:50:34.390098 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d96492abf8cf459a992dd1d7b0226b57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d96492abf8cf459a992dd1d7b0226b57 already in progress: creating tablet
I20260928 14:50:34.391530 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f5bcc70b7720421fad8a94e37bbd663d" } new_table_name: "default.Table_ec53a95de3d2420e8fb0c19d712a61aa" modify_external_catalogs: true
I20260928 14:50:34.394523 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:34.394714 9567 raft_consensus.cc:2454] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:34.395648 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.395910 9287 raft_consensus.cc:2454] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 0.
I20260928 14:50:34.389981 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6afcf7527a994c0aa7b8d8343501e175"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.397059 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6afcf7527a994c0aa7b8d8343501e175 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:34.402640 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ae6fbfca4fc0b0b053d0134a49d0 already in progress: creating tablet
W20260928 14:50:34.402889 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 24c45934c64642c2b171cb42544728bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24c45934c64642c2b171cb42544728bc already in progress: creating tablet
W20260928 14:50:34.403065 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2df12117111548beb5d570436e2d6de2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df12117111548beb5d570436e2d6de2 already in progress: creating tablet
W20260928 14:50:34.403241 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 92d1100b862b4170807be02a39307359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1100b862b4170807be02a39307359 already in progress: creating tablet
I20260928 14:50:34.408854 10386 raft_consensus.cc:482] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.408981 10386 raft_consensus.cc:504] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.410295 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.410879 9220 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.411206 10386 leader_election.cc:288] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.411759 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:34.411959 9568 raft_consensus.cc:2454] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:34.412420 9219 leader_election.cc:302] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.412865 10386 raft_consensus.cc:2781] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.412940 10386 raft_consensus.cc:482] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.412997 10386 raft_consensus.cc:3037] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.415459 10556 raft_consensus.cc:482] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.415599 10556 raft_consensus.cc:504] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.416026 9360 leader_election.cc:302] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:34.415997 10386 raft_consensus.cc:504] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:34.416443 9360 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:34.417241 10546 consensus_queue.cc:1035] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 14:50:34.417827 10546 raft_consensus.cc:2781] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.417915 10546 raft_consensus.cc:482] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.417979 10546 raft_consensus.cc:3037] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.417904 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:34.418490 9220 leader_election.cc:341] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.418947 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.420222 9814 ts_tablet_manager.cc:1905] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.422048 10641 tablet.cc:1722] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 14:50:34.423309 9360 leader_election.cc:341] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:34.417904 10556 leader_election.cc:288] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.423506 9360 leader_election.cc:302] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:34.428190 10556 raft_consensus.cc:2726] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:34.428756 9360 leader_election.cc:341] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:34.433130 9287 raft_consensus.cc:3037] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.437100 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:34.438247 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f81f1875265642c3a428e658dca558d0
I20260928 14:50:34.439041 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_766e2c205c494d5695c1c6bd3e8a0dad" } modify_external_catalogs: true
I20260928 14:50:34.439420 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_766e2c205c494d5695c1c6bd3e8a0dad" } modify_external_catalogs: true
W20260928 14:50:34.444749 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9491547723a247b295fbb1444f0002b9 consensus state has no leader
I20260928 14:50:34.445271 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a3e2f9c2c1f04bcc9c3d6b002df28d54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.446094 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e2f9c2c1f04bcc9c3d6b002df28d54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.447242 9287 raft_consensus.cc:1261] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Refusing update from remote peer ae832871bd1142f7af10c084115ffc12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:34.448216 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091600d56fdc469d8b754acd8933808b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:34.448387 9569 raft_consensus.cc:3037] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.449617 10386 leader_election.cc:288] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.450356 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d6ee0411db8d422bb5a9b900321e6e1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.452294 9569 raft_consensus.cc:2454] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.452776 9219 leader_election.cc:302] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.453317 10386 raft_consensus.cc:2781] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:34.453594 10386 raft_consensus.cc:686] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:34.453861 10386 consensus_queue.cc:237] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.454011 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet f81f1875265642c3a428e658dca558d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:34.454978 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ee0411db8d422bb5a9b900321e6e1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.459829 10663 tablet.cc:1722] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:34.470459 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_91fba5be108742dfadfae0e7c4aa61f6" } modify_external_catalogs: true
I20260928 14:50:34.470800 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_91fba5be108742dfadfae0e7c4aa61f6" } modify_external_catalogs: true
I20260928 14:50:34.473019 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9e72d815a218451b884604a1f334d632
W20260928 14:50:34.473860 9360 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:34.474018 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b5fb99de4a8240cdbda5493a5185ba57" } new_table_name: "default.Table_35bed516887d44ccb8b35dae4b50f062" modify_external_catalogs: true
I20260928 14:50:34.475281 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e72d815a218451b884604a1f334d632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.475987 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e72d815a218451b884604a1f334d632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:34.481323 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f977693e429d4345b1156f879c4dd471 consensus state has no leader
W20260928 14:50:34.481884 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6fed86d9eda45cab2083fca73825383 consensus state has no leader
I20260928 14:50:34.485184 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]). Expected version 3 got 0
W20260928 14:50:34.486097 8939 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 9491547723a247b295fbb1444f0002b9 (table default.Table_2f8e54c563e346c98a7f64bdb9d38c92 [id=11bc2c3d781548cc8572c481bf281133], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9491547723a247b295fbb1444f0002b9 consensus state has no leader
I20260928 14:50:34.490841 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:34.492514 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1320db9993414adfa520046892472dc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.493134 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1320db9993414adfa520046892472dc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.493811 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_28471d752bd8446eb00cba5559e560f2" } modify_external_catalogs: true
I20260928 14:50:34.494743 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_28471d752bd8446eb00cba5559e560f2" } modify_external_catalogs: true
I20260928 14:50:34.495846 9855 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:34.495985 9855 ts_tablet_manager.cc:1397] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.484s user 0.002s sys 0.002s
I20260928 14:50:34.496170 10546 raft_consensus.cc:504] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.496728 10546 leader_election.cc:288] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.468829 10663 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:34142 (request call id 617) took 1089 ms. Trace:
I20260928 14:50:34.497304 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e72d815a218451b884604a1f334d632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.497617 9855 raft_consensus.cc:348] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.497931 9855 raft_consensus.cc:374] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.498059 9855 raft_consensus.cc:729] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.499249 9813 ts_tablet_manager.cc:1918] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.499403 9813 log.cc:1196] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cf2dd699271542bd9b9604e746686c53
I20260928 14:50:34.499873 9813 ts_tablet_manager.cc:1939] T cf2dd699271542bd9b9604e746686c53 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:34.500236 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 456) took 5238 ms. Trace:
I20260928 14:50:34.500417 9813 rpcz_store.cc:276] 0928 14:50:29.262152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.266164 (+ 4012us) service_pool.cc:227] Handling call
0928 14:50:34.364994 (+5098830us) ts_tablet_manager.cc:1145] Deleting tablet cf2dd699271542bd9b9604e746686c53
0928 14:50:34.365026 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.395852 (+ 30826us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.499158 (+103306us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.500219 (+ 1061us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5098456}
I20260928 14:50:34.501174 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cf2dd699271542bd9b9604e746686c53 (table default.Table_4970c43c954a4fc4abe5155f630f6f6f [id=4d559594449c4a6e8a65daeacd0c48d9]) successfully deleted
I20260928 14:50:34.501865 9815 ts_tablet_manager.cc:1918] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.501993 9815 log.cc:1196] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/dfacaf069e3746aeb8ca11d95e65c5ea
I20260928 14:50:34.502272 9815 ts_tablet_manager.cc:1939] T dfacaf069e3746aeb8ca11d95e65c5ea P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.506269 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet dfacaf069e3746aeb8ca11d95e65c5ea (table default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]) successfully deleted
W20260928 14:50:34.506719 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d96492abf8cf459a992dd1d7b0226b57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d96492abf8cf459a992dd1d7b0226b57 already in progress: creating tablet
I20260928 14:50:34.498374 9855 consensus_queue.cc:260] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.507771 9855 ts_tablet_manager.cc:1428] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260928 14:50:34.508314 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 59ced67c921e43e48bcb5195da212582
W20260928 14:50:34.509138 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bda4f5da7a6b4a4e867d4e260a274d2a consensus state has no leader
W20260928 14:50:34.474077 9360 leader_election.cc:341] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:34.509618 9360 leader_election.cc:302] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:34.509961 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:34.510063 9360 leader_election.cc:341] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:34.510159 9360 leader_election.cc:302] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:34.510491 10647 raft_consensus.cc:2726] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.510713 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.510905 10647 raft_consensus.cc:2726] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.511029 10647 consensus_queue.cc:1035] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:34.512365 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:34.512621 9281 raft_consensus.cc:3037] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.515095 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet f81f1875265642c3a428e658dca558d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.515350 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet f81f1875265642c3a428e658dca558d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.515714 9281 raft_consensus.cc:2454] T d61eb0b79a424ec5a4cbbe83cfb540df P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:34.516711 9360 leader_election.cc:302] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters:
I20260928 14:50:34.516896 10612 raft_consensus.cc:482] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.517669 10647 raft_consensus.cc:2781] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:34.517763 10647 raft_consensus.cc:686] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Becoming Leader. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Running, Role: LEADER
I20260928 14:50:34.518944 9851 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.519136 9851 ts_tablet_manager.cc:1397] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.145s user 0.008s sys 0.008s
I20260928 14:50:34.496909 10663 rpcz_store.cc:276] 0928 14:50:33.379407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.379722 (+ 315us) service_pool.cc:227] Handling call
0928 14:50:34.468809 (+1089087us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0928 14:50:33.484822 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0928 14:50:33.486270 (+ 1448us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 14:50:33.486279 (+ 9us) alter_schema_op.cc:65] Acquired schema lock
0928 14:50:33.486285 (+ 6us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0928 14:50:33.486320 (+ 35us) alter_schema_op.cc:126] START. Timestamp: 1790607033486264
0928 14:50:33.486323 (+ 3us) op_driver.cc:331] REPLICATION: starting
0928 14:50:33.496871 (+ 10548us) log.cc:842] Serialized 173 byte log entry
0928 14:50:34.071676 (+574805us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x6160003f16a0. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00007fde16b7927d 00007fde16b79373 00007fde138bd7cf 00007fde138bcc7e 00007fde1396de45 00007fde1396ecd9 00007fde14ca17f1 00007fde14ca0359 00007fde14ca81bb 00007fde14ca8038 00000000009edb7c
0928 14:50:34.084615 (+ 12939us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x6160003f16a0. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde138b9390 00007fde138d0a59 00007fde138d07c1 00007fde1b3ff47d 00007fde1391c8a1 00007fde139215ae 00007fde13921331 00007fde1b3ff47d 00007fde13359308 00007fde133419c3
0928 14:50:34.382958 (+298343us) op_driver.cc:444] REPLICATION: finished
0928 14:50:34.459803 (+ 76845us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0928 14:50:34.460207 (+ 404us) log.cc:842] Serialized 5 byte log entry
0928 14:50:34.467302 (+ 7095us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.468558 (+ 1256us) log.cc:842] Serialized 14 byte log entry
0928 14:50:34.468770 (+ 212us) alter_schema_op.cc:71] Released schema lock
0928 14:50:34.468773 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76779,"prepare.queue_time_us":486,"prepare.run_cpu_time_us":56314,"prepare.run_wall_time_us":586906,"replication_time_us":896607,"spinlock_wait_cycles":792100480,"thread_start_us":434404,"threads_started":2,"wal-append.queue_time_us":368800}]]}
I20260928 14:50:34.521981 10663 tablet.cc:1722] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:34.522564 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 457) took 5256 ms. Trace:
I20260928 14:50:34.523257 10552 raft_consensus.cc:482] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.523387 10552 raft_consensus.cc:504] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:34.523957 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f92d30a7102f49828227b1428e2224da consensus state has no leader
I20260928 14:50:34.524071 10552 leader_election.cc:288] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.528682 9851 raft_consensus.cc:348] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.528890 9851 raft_consensus.cc:374] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.528955 9851 raft_consensus.cc:729] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.529155 9851 consensus_queue.cc:260] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.530652 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 622a7af04be44ddebc1af16fcc6325ae
I20260928 14:50:34.533903 9851 ts_tablet_manager.cc:1428] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 14:50:34.533883 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.537613 9851 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.537791 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 622a7af04be44ddebc1af16fcc6325ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.538559 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 622a7af04be44ddebc1af16fcc6325ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.512107 9855 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:34.541018 9851 tablet_bootstrap.cc:654] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.522693 9813 rpcz_store.cc:276] 0928 14:50:29.265790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.266567 (+ 777us) service_pool.cc:227] Handling call
0928 14:50:34.515552 (+5248985us) ts_tablet_manager.cc:1145] Deleting tablet c6b4b4c775fe4eacaaa557d4daa2a600
0928 14:50:34.515562 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.522546 (+ 6984us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5248694}
I20260928 14:50:34.542016 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_820374b9926e4f70b9e5c5646f36238e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.542832 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_820374b9926e4f70b9e5c5646f36238e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.544585 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38e8d8c399254d78ba45f973e9064285" } modify_external_catalogs: true
I20260928 14:50:34.544875 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38e8d8c399254d78ba45f973e9064285" } modify_external_catalogs: true
I20260928 14:50:34.517939 10647 consensus_queue.cc:237] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.516981 10612 raft_consensus.cc:504] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.525841 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c2b819b194d4373a59a3e94267361c1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.555013 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ea7b363d546c45ceb3efb9352cf184f4
W20260928 14:50:34.556278 9220 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.557230 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.511508 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61eb0b79a424ec5a4cbbe83cfb540df" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
W20260928 14:50:34.558207 9219 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:34.558305 9219 leader_election.cc:302] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.558389 9815 tablet_replica.cc:330] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.558600 9815 raft_consensus.cc:2229] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.558759 9815 raft_consensus.cc:2258] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.557787 9568 raft_consensus.cc:3037] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:34.558802 10484 raft_consensus.cc:659] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260928 14:50:34.559005 10552 raft_consensus.cc:2726] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.560941 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.562927 9855 tablet_bootstrap.cc:654] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.565339 9568 raft_consensus.cc:2454] T d61eb0b79a424ec5a4cbbe83cfb540df P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae832871bd1142f7af10c084115ffc12 in term 1.
I20260928 14:50:34.565364 9815 ts_tablet_manager.cc:1905] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.566175 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4f781e5a85b24737a08045e6b0482d50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.566953 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f781e5a85b24737a08045e6b0482d50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.580885 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 458) took 5283 ms. Trace:
I20260928 14:50:34.581043 9813 rpcz_store.cc:276] 0928 14:50:29.297192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.300518 (+ 3326us) service_pool.cc:227] Handling call
0928 14:50:34.541953 (+5241435us) ts_tablet_manager.cc:1145] Deleting tablet 4744deca899b4e6caa57f70ce1df8a8d
0928 14:50:34.541963 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.580858 (+ 38895us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5237342}
I20260928 14:50:34.582417 10612 leader_election.cc:288] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:34.584429 10484 raft_consensus.cc:482] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.586879 9814 ts_tablet_manager.cc:1918] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.587062 9814 log.cc:1196] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6a828130854b4e4e8c44b2b45260e50e
I20260928 14:50:34.587399 9814 ts_tablet_manager.cc:1939] T 6a828130854b4e4e8c44b2b45260e50e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.588665 9814 tablet_replica.cc:330] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.588891 9814 raft_consensus.cc:2229] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.589100 9814 raft_consensus.cc:2258] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.590461 9851 tablet_bootstrap.cc:492] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.590612 9851 ts_tablet_manager.cc:1397] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.004s
I20260928 14:50:34.591650 9851 raft_consensus.cc:348] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.591871 9851 raft_consensus.cc:374] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.591982 9851 raft_consensus.cc:729] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.592183 9851 consensus_queue.cc:260] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.596786 9851 ts_tablet_manager.cc:1428] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:34.600610 9851 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.603041 9387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 101) took 1375 ms. Trace:
I20260928 14:50:34.603147 9387 rpcz_store.cc:276] 0928 14:50:33.227781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.228161 (+ 380us) service_pool.cc:227] Handling call
0928 14:50:33.694006 (+465845us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x615000187ca4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.213265 (+519259us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x6150001890a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.412790 (+199525us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x6150001b60a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.603003 (+190213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1204231680}
I20260928 14:50:34.603891 9851 tablet_bootstrap.cc:654] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.605613 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6a828130854b4e4e8c44b2b45260e50e (table default.Table_4f67958edd6b445693683ebf4f469972 [id=135455fa96ab4b05ae173bd269ba5269]) successfully deleted
W20260928 14:50:34.606294 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e92b08254f4041e482e7fa1935dd7071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e92b08254f4041e482e7fa1935dd7071 already in progress: creating tablet
W20260928 14:50:34.606747 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d34a235b38aa4e9ba328a7f542342653 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d34a235b38aa4e9ba328a7f542342653 already in progress: creating tablet
I20260928 14:50:34.611234 9848 tablet_bootstrap.cc:492] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:34.611452 9848 ts_tablet_manager.cc:1397] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 1.028s user 0.009s sys 0.011s
I20260928 14:50:34.617821 9851 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.617954 9851 ts_tablet_manager.cc:1397] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20260928 14:50:34.618937 9851 raft_consensus.cc:348] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.619146 9851 raft_consensus.cc:374] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.619206 9851 raft_consensus.cc:729] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.619385 9851 consensus_queue.cc:260] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.619863 9851 ts_tablet_manager.cc:1428] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:34.584542 10484 raft_consensus.cc:504] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:34.620831 10484 leader_election.cc:288] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.621498 9814 ts_tablet_manager.cc:1905] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.622677 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:34.623499 9497 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.624694 9848 raft_consensus.cc:348] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.625696 9851 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.630048 9855 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:34.630224 9855 ts_tablet_manager.cc:1397] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.118s user 0.010s sys 0.002s
I20260928 14:50:34.631569 9855 raft_consensus.cc:348] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.631790 9855 raft_consensus.cc:374] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.631873 9855 raft_consensus.cc:729] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.632191 9855 consensus_queue.cc:260] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.632725 9855 ts_tablet_manager.cc:1428] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:34.634289 10552 raft_consensus.cc:482] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.634485 10552 raft_consensus.cc:504] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.635042 9815 ts_tablet_manager.cc:1918] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.635103 10552 leader_election.cc:288] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.635157 9815 log.cc:1196] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/a7be6013a04c4222ab34a19e77e48a37
I20260928 14:50:34.635694 9815 ts_tablet_manager.cc:1939] T a7be6013a04c4222ab34a19e77e48a37 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.640039 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_db0f7c5aa84347d0890c3d590e0d4262"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.640872 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db0f7c5aa84347d0890c3d590e0d4262 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.641847 10552 raft_consensus.cc:482] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.641968 10552 raft_consensus.cc:504] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.642474 10552 leader_election.cc:288] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.646734 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:34.646922 9567 raft_consensus.cc:2454] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:34.647320 9855 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:34.650281 9219 leader_election.cc:302] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
W20260928 14:50:34.650540 9219 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:34.652645 9815 tablet_replica.cc:330] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.652822 9815 raft_consensus.cc:2229] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.652953 9815 raft_consensus.cc:2258] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.653084 10552 raft_consensus.cc:2781] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.653168 10552 raft_consensus.cc:482] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.653226 10552 raft_consensus.cc:3037] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.653424 9815 ts_tablet_manager.cc:1905] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.655278 9851 tablet_bootstrap.cc:654] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.656379 10552 raft_consensus.cc:504] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.663309 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet a7be6013a04c4222ab34a19e77e48a37 (table default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]) successfully deleted
I20260928 14:50:34.663901 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fc468e61b9734839b1bdaaf51c7f5cd5" } new_table_name: "default.Table_268a79e835004ddaa114b663c8be3a9c" modify_external_catalogs: true
I20260928 14:50:34.665494 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a7f3efa369774f8b97444dbad06ee74d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.666038 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7f3efa369774f8b97444dbad06ee74d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.668478 10386 raft_consensus.cc:482] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.668620 10386 raft_consensus.cc:504] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.669140 10386 leader_election.cc:288] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.669870 9848 raft_consensus.cc:374] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.669862 10552 leader_election.cc:288] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.669839 9423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3ac8adb23c5478fadb6cb6765459913" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.669934 9848 raft_consensus.cc:729] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.623692 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 460) took 5318 ms. Trace:
W20260928 14:50:34.670332 9220 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.670070 9813 rpcz_store.cc:276] 0928 14:50:29.305474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.307494 (+ 2020us) service_pool.cc:227] Handling call
0928 14:50:34.581558 (+5274064us) ts_tablet_manager.cc:1145] Deleting tablet be232889594147bdbe2d4825c3e8c7d0
0928 14:50:34.581571 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.623672 (+ 42101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5273767}
I20260928 14:50:34.622033 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.671038 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 459) took 5365 ms. Trace:
I20260928 14:50:34.671125 9813 rpcz_store.cc:276] 0928 14:50:29.305348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.307801 (+ 2453us) service_pool.cc:227] Handling call
0928 14:50:34.670868 (+5363067us) ts_tablet_manager.cc:1145] Deleting tablet a303792e4c804844bc6037fabb425be4
0928 14:50:34.670880 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.671022 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5362881}
I20260928 14:50:34.671454 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.671519 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 461) took 5349 ms. Trace:
I20260928 14:50:34.636471 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e56077833e41dbacf54c1757ba6a38" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.671590 9813 rpcz_store.cc:276] 0928 14:50:29.321939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.322042 (+ 103us) service_pool.cc:227] Handling call
0928 14:50:34.671321 (+5349279us) ts_tablet_manager.cc:1145] Deleting tablet dc8400fdb8d948b084733011b16df1b3
0928 14:50:34.671331 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.671502 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5348388}
I20260928 14:50:34.671679 9428 raft_consensus.cc:2454] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:34.671898 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 462) took 5126 ms. Trace:
W20260928 14:50:34.671950 9498 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.672060 9498 leader_election.cc:302] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.672012 9813 rpcz_store.cc:276] 0928 14:50:29.545056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.545209 (+ 153us) service_pool.cc:227] Handling call
0928 14:50:34.671763 (+5126554us) ts_tablet_manager.cc:1145] Deleting tablet 1b22c3f9578a464a96be0bac6127e56d
0928 14:50:34.671772 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.671883 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5126062}
I20260928 14:50:34.672248 9813 tablet_replica.cc:330] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:34.672384 10484 raft_consensus.cc:2726] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.672420 9813 raft_consensus.cc:2229] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.640542 9426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.8.181.1:60133 (request call id 127) took 1146 ms. Trace:
I20260928 14:50:34.643716 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.644883 10672 tablet.cc:1717] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:34.661516 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:34.672997 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:34.673163 9567 raft_consensus.cc:3037] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.673420 9426 rpcz_store.cc:276] 0928 14:50:33.494451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.496123 (+ 1672us) service_pool.cc:227] Handling call
0928 14:50:34.640518 (+1144395us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260928 14:50:34.673576 9220 leader_election.cc:302] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:34.673919 9220 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:34.674173 9220 leader_election.cc:341] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.674045 9848 consensus_queue.cc:260] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.674310 9220 leader_election.cc:302] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
W20260928 14:50:34.674491 9220 raft_consensus.cc:2670] T 999aa56f1683464d9612a2ddbfbebbda P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:34.674642 9848 ts_tablet_manager.cc:1428] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260928 14:50:34.674870 9848 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:34.675601 9219 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:34.675671 9567 raft_consensus.cc:2454] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.675696 9219 leader_election.cc:302] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.676319 9848 tablet_bootstrap.cc:654] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.676975 9855 tablet_bootstrap.cc:654] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.679766 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3fb54ea0da09494c99d850793c1cc0ef" } modify_external_catalogs: true
I20260928 14:50:34.680038 9813 raft_consensus.cc:2258] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.680006 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3fb54ea0da09494c99d850793c1cc0ef" } modify_external_catalogs: true
I20260928 14:50:34.680070 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c19e95d4db2943829d59bae7577a5e2a" } modify_external_catalogs: true
I20260928 14:50:34.680241 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c19e95d4db2943829d59bae7577a5e2a" } modify_external_catalogs: true
I20260928 14:50:34.680495 10386 raft_consensus.cc:2781] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.680552 9813 ts_tablet_manager.cc:1905] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.680580 10386 raft_consensus.cc:482] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.680644 10386 raft_consensus.cc:3037] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.680687 10552 raft_consensus.cc:2726] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.683521 10386 raft_consensus.cc:504] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.684432 9219 leader_election.cc:302] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.684864 10386 leader_election.cc:288] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.685308 10386 raft_consensus.cc:2781] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:34.685698 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e9f33f551fc94b99849f78d3bb8d5e33" } new_table_name: "default.Table_aab84a72d35448c8a96afd735fa0b4fe" modify_external_catalogs: true
I20260928 14:50:34.685853 10386 raft_consensus.cc:686] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:34.686058 10386 consensus_queue.cc:237] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
W20260928 14:50:34.685734 9219 leader_election.cc:341] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:34.686911 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5558aed7f8954bb3b2a5c0891ef030a8" } new_table_name: "default.Table_2ef88ab43d2c4684b5abea68667a8686" modify_external_catalogs: true
I20260928 14:50:34.688133 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_056d3fea7c954741878c0c00280b909e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.692114 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_056d3fea7c954741878c0c00280b909e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.693913 9851 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.694043 9851 ts_tablet_manager.cc:1397] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.001s
I20260928 14:50:34.694742 9851 raft_consensus.cc:348] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.694926 9851 raft_consensus.cc:374] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.694976 9851 raft_consensus.cc:729] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:34.694991 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8237f7d97304a98889bde6817358eda consensus state has no leader
I20260928 14:50:34.695237 9814 ts_tablet_manager.cc:1918] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.695154 9851 consensus_queue.cc:260] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.695327 9814 log.cc:1196] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:34.695340 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0d750a496c404b97a60106c35458ba06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.695605 9814 ts_tablet_manager.cc:1939] T 3f8db468ad3c4bba8c701c3d8feba9f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:34.695828 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d750a496c404b97a60106c35458ba06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.697139 9851 ts_tablet_manager.cc:1428] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:34.697386 9851 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.697822 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
I20260928 14:50:34.699193 9814 tablet_replica.cc:330] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.699349 9814 raft_consensus.cc:2229] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.699340 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 622a7af04be44ddebc1af16fcc6325ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.699469 9814 raft_consensus.cc:2258] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.699692 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.699923 9814 ts_tablet_manager.cc:1905] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:34.700371 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c6b4b4c775fe4eacaaa557d4daa2a600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b4b4c775fe4eacaaa557d4daa2a600 already in progress: creating tablet
W20260928 14:50:34.700743 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4744deca899b4e6caa57f70ce1df8a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4744deca899b4e6caa57f70ce1df8a8d already in progress: creating tablet
W20260928 14:50:34.701108 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet be232889594147bdbe2d4825c3e8c7d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be232889594147bdbe2d4825c3e8c7d0 already in progress: creating tablet
W20260928 14:50:34.701426 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet dc8400fdb8d948b084733011b16df1b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc8400fdb8d948b084733011b16df1b3 already in progress: creating tablet
I20260928 14:50:34.666523 9386 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 102) took 1165 ms. Trace:
I20260928 14:50:34.702183 9386 rpcz_store.cc:276] 0928 14:50:33.501510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.501593 (+ 83us) service_pool.cc:227] Handling call
0928 14:50:34.285681 (+784088us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x6150002425a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.633064 (+347383us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x615000277524. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.666473 (+ 33409us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1048402560}
I20260928 14:50:34.702358 9383 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 104) took 1081 ms. Trace:
I20260928 14:50:34.702437 9383 rpcz_store.cc:276] 0928 14:50:33.657695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.657767 (+ 72us) service_pool.cc:227] Handling call
0928 14:50:34.296157 (+638390us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x6150002425a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.629454 (+333297us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x615000277524. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.646584 (+ 17130us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x615000262624. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.702277 (+ 55693us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1038106240}
I20260928 14:50:34.704291 9851 tablet_bootstrap.cc:654] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.705191 10484 raft_consensus.cc:482] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.705266 9814 ts_tablet_manager.cc:1918] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.705351 9814 log.cc:1196] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:34.705323 10484 raft_consensus.cc:504] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.705480 9384 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:34132 (request call id 103) took 1091 ms. Trace:
I20260928 14:50:34.705595 9384 rpcz_store.cc:276] 0928 14:50:33.613757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.614024 (+ 267us) service_pool.cc:227] Handling call
0928 14:50:34.308654 (+694630us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x6150002425a4. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.626197 (+317543us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x615000277524. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.641471 (+ 15274us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x615000262624. stack: 00007fde0846066e 00007fde08460430 00007fde074e75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fde13968630 00007fde17540c7f 00007fde120ac016 00007fde120abd45 00007fde0ef9c9be 00007fde0ef9b79e 00007fde0efa1b25 00007fde0efa254f 00007fde0efa2378 00000000009edb7c
0928 14:50:34.705442 (+ 63971us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":825903488}
I20260928 14:50:34.705909 10484 leader_election.cc:288] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.706954 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73bbcf31960d478087a0a91337c34ec8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.707151 9814 ts_tablet_manager.cc:1939] T 3c2b819b194d4373a59a3e94267361c1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:34.707512 9497 leader_election.cc:341] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.708027 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73bbcf31960d478087a0a91337c34ec8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.708444 9498 leader_election.cc:341] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.708529 9498 leader_election.cc:302] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.708570 9814 tablet_replica.cc:330] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.708722 9814 raft_consensus.cc:2229] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.708842 9814 raft_consensus.cc:2258] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.709000 10484 raft_consensus.cc:2726] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:34.709897 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aeab20d78f5b41b1b36c3bf379e2c797 consensus state has no leader
W20260928 14:50:34.710584 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09f04bf1357148818ea60b32cfd5f9cc consensus state has no leader
I20260928 14:50:34.714392 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3c2b819b194d4373a59a3e94267361c1 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
I20260928 14:50:34.714583 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_694877d6ab66488382d654a68ca0c235" } new_table_name: "default.Table_49fa394c7baf4558b7413994dc2fc2ed" modify_external_catalogs: true
I20260928 14:50:34.714393 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_21a4bfb6f8964ad5937b0106fa65cc82" } modify_external_catalogs: true
I20260928 14:50:34.715509 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_21a4bfb6f8964ad5937b0106fa65cc82" } modify_external_catalogs: true
I20260928 14:50:34.716724 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_690bd7f5a5a945d787c5bfaf7bad1107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.717217 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_690bd7f5a5a945d787c5bfaf7bad1107 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.720173 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e56077833e41dbacf54c1757ba6a38" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:34.720520 9426 raft_consensus.cc:3037] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.726897 9426 raft_consensus.cc:2454] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.727922 9851 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.728060 9851 ts_tablet_manager.cc:1397] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
W20260928 14:50:34.728654 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f977693e429d4345b1156f879c4dd471 consensus state has no leader
I20260928 14:50:34.728744 9851 raft_consensus.cc:348] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.728920 9851 raft_consensus.cc:374] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.728960 9851 raft_consensus.cc:729] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.729148 9851 consensus_queue.cc:260] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.730108 10683 raft_consensus.cc:482] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.730232 10683 raft_consensus.cc:504] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.730772 10683 leader_election.cc:288] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.731495 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:34.731739 9567 raft_consensus.cc:2454] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:34.732170 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6a14297d430c49208e7a05d1341ffab9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.732309 9815 ts_tablet_manager.cc:1918] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.732407 9815 log.cc:1196] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ad844de91e4040c3a8ae4873c0fa6ba4
I20260928 14:50:34.732667 9219 leader_election.cc:302] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:34.732740 9815 ts_tablet_manager.cc:1939] T ad844de91e4040c3a8ae4873c0fa6ba4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.732892 10386 raft_consensus.cc:2781] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.732956 10386 raft_consensus.cc:482] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.733013 10386 raft_consensus.cc:3037] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.733560 9815 tablet_replica.cc:330] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.735638 9851 ts_tablet_manager.cc:1428] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:34.736019 10386 raft_consensus.cc:504] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.736254 9851 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.736907 10386 leader_election.cc:288] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.738224 9851 tablet_bootstrap.cc:654] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.740193 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_495e7c03dc714f76ae556f136f2a4006" } new_table_name: "default.Table_179a0cdc7fb945369cf32b7380fb39fe" modify_external_catalogs: true
I20260928 14:50:34.741091 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ad844de91e4040c3a8ae4873c0fa6ba4 (table default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]) successfully deleted
I20260928 14:50:34.741909 9220 leader_election.cc:302] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:34.742591 10386 raft_consensus.cc:2781] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:34.742709 10386 raft_consensus.cc:686] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:34.742903 10386 consensus_queue.cc:237] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.734170 9855 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:34.743440 9855 ts_tablet_manager.cc:1397] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.008s
I20260928 14:50:34.744575 9855 raft_consensus.cc:348] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.744766 9855 raft_consensus.cc:374] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.744822 9855 raft_consensus.cc:729] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.745038 9855 consensus_queue.cc:260] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.738934 10484 raft_consensus.cc:482] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.740365 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:34.745630 9567 raft_consensus.cc:3037] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.747289 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:34.747965 9220 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.748440 9813 ts_tablet_manager.cc:1918] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.748549 9813 log.cc:1196] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7cc4c49a4962473699103528b64a1005
I20260928 14:50:34.748668 9567 raft_consensus.cc:2454] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.748940 9813 ts_tablet_manager.cc:1939] T 7cc4c49a4962473699103528b64a1005 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:34.745609 10484 raft_consensus.cc:504] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:34.749066 9219 leader_election.cc:302] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.749641 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 467) took 5180 ms. Trace:
I20260928 14:50:34.749662 10484 leader_election.cc:288] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.749733 9813 rpcz_store.cc:276] 0928 14:50:29.569328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.569494 (+ 166us) service_pool.cc:227] Handling call
0928 14:50:34.672211 (+5102717us) ts_tablet_manager.cc:1145] Deleting tablet 7cc4c49a4962473699103528b64a1005
0928 14:50:34.672220 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.708949 (+ 36729us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.748349 (+ 39400us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.749622 (+ 1273us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5091696}
I20260928 14:50:34.750066 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:34.751127 9497 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.751194 9855 ts_tablet_manager.cc:1428] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:34.752125 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 473) took 5170 ms. Trace:
I20260928 14:50:34.752207 9813 rpcz_store.cc:276] 0928 14:50:29.581413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.581459 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:34.751916 (+5170457us) ts_tablet_manager.cc:1145] Deleting tablet 1016ad6219294ccd829fca9b264ab06f
0928 14:50:34.751927 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.752108 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5169692}
I20260928 14:50:34.752282 9815 raft_consensus.cc:2229] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.752496 9815 raft_consensus.cc:2258] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.752635 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 474) took 5170 ms. Trace:
I20260928 14:50:34.752701 9813 rpcz_store.cc:276] 0928 14:50:29.582306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.582359 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:34.752536 (+5170177us) ts_tablet_manager.cc:1145] Deleting tablet 4684ba575d9d45f3bb059a15efdd936d
0928 14:50:34.752545 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.752622 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5168340}
I20260928 14:50:34.753119 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 472) took 5171 ms. Trace:
I20260928 14:50:34.753201 9813 rpcz_store.cc:276] 0928 14:50:29.581301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.581671 (+ 370us) service_pool.cc:227] Handling call
0928 14:50:34.753019 (+5171348us) ts_tablet_manager.cc:1145] Deleting tablet 79f4b20a5e784d909f7297cc7f1b05e6
0928 14:50:34.753027 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.753104 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5168524}
I20260928 14:50:34.753314 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.754096 9498 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.754251 9498 leader_election.cc:302] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.755827 10484 raft_consensus.cc:2726] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:34.756704 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a14297d430c49208e7a05d1341ffab9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.756392 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_453f1cfe1974492aa15946bdaf2b3432"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.757416 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_453f1cfe1974492aa15946bdaf2b3432 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.757869 9813 tablet_replica.cc:330] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:34.758046 9813 raft_consensus.cc:2229] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.758189 9813 raft_consensus.cc:2258] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.758409 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7cc4c49a4962473699103528b64a1005 (table default.Table_cce07af2389446a1b409612d248028cf [id=e7b5d54bcbb747449e7ce94c8afa7cec]) successfully deleted
I20260928 14:50:34.758651 9813 ts_tablet_manager.cc:1905] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.759609 9848 tablet_bootstrap.cc:492] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:34.759727 9848 ts_tablet_manager.cc:1397] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.006s
I20260928 14:50:34.760528 9848 raft_consensus.cc:348] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.760771 9848 raft_consensus.cc:374] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.760828 9848 raft_consensus.cc:729] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.761040 9848 consensus_queue.cc:260] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.761925 9855 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:34.763285 9848 ts_tablet_manager.cc:1428] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:34.763520 9848 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:34.763892 9855 tablet_bootstrap.cc:654] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.766165 9815 ts_tablet_manager.cc:1905] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:34.767892 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1016ad6219294ccd829fca9b264ab06f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1016ad6219294ccd829fca9b264ab06f already in progress: creating tablet
W20260928 14:50:34.768174 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4684ba575d9d45f3bb059a15efdd936d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4684ba575d9d45f3bb059a15efdd936d already in progress: creating tablet
I20260928 14:50:34.768664 9814 ts_tablet_manager.cc:1905] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:34.769369 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 79f4b20a5e784d909f7297cc7f1b05e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f4b20a5e784d909f7297cc7f1b05e6 already in progress: creating tablet
I20260928 14:50:34.769554 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b8bf89489cec43d2ad925995c11007a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.769781 9848 tablet_bootstrap.cc:654] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.749859 10386 raft_consensus.cc:2781] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
W20260928 14:50:34.772584 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8bf89489cec43d2ad925995c11007a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.772838 10386 raft_consensus.cc:686] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:34.773566 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_67d8c754b00c4bc083809df338bf770a" } modify_external_catalogs: true
I20260928 14:50:34.773759 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_67d8c754b00c4bc083809df338bf770a" } modify_external_catalogs: true
I20260928 14:50:34.778074 10683 raft_consensus.cc:482] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.773849 10386 consensus_queue.cc:237] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.778221 10683 raft_consensus.cc:504] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.778867 10683 leader_election.cc:288] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:34.779523 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85735981779438197f2c0f489681b96" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:34.779753 9422 raft_consensus.cc:2454] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
W20260928 14:50:34.779932 9219 leader_election.cc:341] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c85735981779438197f2c0f489681b96
I20260928 14:50:34.780333 9220 leader_election.cc:302] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:34.780578 10683 raft_consensus.cc:2781] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:34.780659 10683 raft_consensus.cc:482] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:34.780728 10683 raft_consensus.cc:3037] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:34.783304 10683 raft_consensus.cc:504] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.783879 10683 leader_election.cc:288] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:34.784945 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ca013d1c5b44730b7163e71dc408b04 consensus state has no leader
I20260928 14:50:34.784996 8948 catalog_manager.cc:5495] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:34.785681 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85735981779438197f2c0f489681b96" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:34.785843 9422 raft_consensus.cc:3037] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:34.785883 9219 leader_election.cc:341] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c85735981779438197f2c0f489681b96
I20260928 14:50:34.786765 9851 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:34.786883 9851 ts_tablet_manager.cc:1397] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260928 14:50:34.787705 9851 raft_consensus.cc:348] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.787966 9851 raft_consensus.cc:374] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.788026 9851 raft_consensus.cc:729] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.788209 9851 consensus_queue.cc:260] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.788913 9851 ts_tablet_manager.cc:1428] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:34.789271 9422 raft_consensus.cc:2454] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:34.789315 9851 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.789661 9220 leader_election.cc:302] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91
I20260928 14:50:34.789881 10683 raft_consensus.cc:2781] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:34.790002 10683 raft_consensus.cc:686] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:34.790225 10683 consensus_queue.cc:237] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.790501 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]). Expected version 3 got 0
I20260928 14:50:34.790719 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
I20260928 14:50:34.798581 9813 ts_tablet_manager.cc:1918] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.798704 9813 log.cc:1196] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/c9a7573c751d412aa8394d6277c28b7f
I20260928 14:50:34.799010 9813 ts_tablet_manager.cc:1939] T c9a7573c751d412aa8394d6277c28b7f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:34.804302 9814 ts_tablet_manager.cc:1918] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.804425 9814 log.cc:1196] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/066df778654449bda96f68b5035c4d73
I20260928 14:50:34.804721 9814 ts_tablet_manager.cc:1939] T 066df778654449bda96f68b5035c4d73 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.804771 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4] alter complete (version 3)
I20260928 14:50:34.804970 9851 tablet_bootstrap.cc:654] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.806460 9855 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:34.806658 9855 ts_tablet_manager.cc:1397] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260928 14:50:34.808008 9815 ts_tablet_manager.cc:1918] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.810000 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet af22f23ff3864620bfefb31b9e899036
I20260928 14:50:34.810997 9815 log.cc:1196] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/11714d0ca321429c95de223320794a0e
I20260928 14:50:34.808550 9855 raft_consensus.cc:348] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.812129 9814 tablet_replica.cc:330] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.812037 9855 raft_consensus.cc:374] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.812491 9855 raft_consensus.cc:729] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.812539 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f781e5a85b24737a08045e6b0482d50" } modify_external_catalogs: true
I20260928 14:50:34.812968 9814 raft_consensus.cc:2229] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.812863 9855 consensus_queue.cc:260] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.813025 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f781e5a85b24737a08045e6b0482d50" } modify_external_catalogs: true
I20260928 14:50:34.813127 9814 raft_consensus.cc:2258] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.813714 9855 ts_tablet_manager.cc:1428] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260928 14:50:34.814149 9855 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:34.814054 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bc3579d72196492f94142c12326547da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.812863 9815 ts_tablet_manager.cc:1939] T 11714d0ca321429c95de223320794a0e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.818238 9814 ts_tablet_manager.cc:1905] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:34.820078 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc3579d72196492f94142c12326547da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.800447 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.823452 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599aa40a0fa54c13bcaf5450cdfed3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.824128 9814 ts_tablet_manager.cc:1918] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.824224 9814 log.cc:1196] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ca5c040fa6ba4e2785959874a3346bf7
I20260928 14:50:34.824487 9814 ts_tablet_manager.cc:1939] T ca5c040fa6ba4e2785959874a3346bf7 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.826011 9815 tablet_replica.cc:330] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.826248 9815 raft_consensus.cc:2229] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.826422 9815 raft_consensus.cc:2258] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.826913 9815 ts_tablet_manager.cc:1905] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.801337 9848 tablet_bootstrap.cc:492] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:34.830818 9848 ts_tablet_manager.cc:1397] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.004s
I20260928 14:50:34.831454 9848 raft_consensus.cc:348] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.831638 9848 raft_consensus.cc:374] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:34.831682 9848 raft_consensus.cc:729] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:34.831830 9848 consensus_queue.cc:260] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:34.832630 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b309deffacb94196b6b641147fa20814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.803411 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 479) took 4990 ms. Trace:
W20260928 14:50:34.833364 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b309deffacb94196b6b641147fa20814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.833364 9813 rpcz_store.cc:276] 0928 14:50:29.813318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.816020 (+ 2702us) service_pool.cc:227] Handling call
0928 14:50:34.757829 (+4941809us) ts_tablet_manager.cc:1145] Deleting tablet c9a7573c751d412aa8394d6277c28b7f
0928 14:50:34.757839 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.795677 (+ 37838us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.798491 (+ 2814us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.803389 (+ 4898us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4941615}
I20260928 14:50:34.833869 9813 tablet_replica.cc:330] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:34.834031 9813 raft_consensus.cc:2229] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.834163 9813 raft_consensus.cc:2258] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.834329 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.834599 9813 ts_tablet_manager.cc:1905] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.834682 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599aa40a0fa54c13bcaf5450cdfed3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.835269 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.835592 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599aa40a0fa54c13bcaf5450cdfed3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.812240 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet af22f23ff3864620bfefb31b9e899036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.818610 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 7e99b221268b4c33ab6e32f341eb2d6e (DEFAULT_TABLE table=default.Table_38143067447e44d483568617ab9d9e13 [id=1bae1c5138574509a242c5c16168c3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.838011 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e99b221268b4c33ab6e32f341eb2d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.838565 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet af22f23ff3864620bfefb31b9e899036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.839020 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet af22f23ff3864620bfefb31b9e899036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.839844 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 7e99b221268b4c33ab6e32f341eb2d6e (DEFAULT_TABLE table=default.Table_38143067447e44d483568617ab9d9e13 [id=1bae1c5138574509a242c5c16168c3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.840178 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e99b221268b4c33ab6e32f341eb2d6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:34.809795 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 249860us
I20260928 14:50:34.844923 9815 ts_tablet_manager.cc:1918] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.845010 9815 log.cc:1196] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/a303792e4c804844bc6037fabb425be4
I20260928 14:50:34.848685 9814 tablet_replica.cc:330] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.848878 9814 raft_consensus.cc:2229] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.849016 9814 raft_consensus.cc:2258] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.849586 9814 ts_tablet_manager.cc:1905] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.849781 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 7e99b221268b4c33ab6e32f341eb2d6e (DEFAULT_TABLE table=default.Table_38143067447e44d483568617ab9d9e13 [id=1bae1c5138574509a242c5c16168c3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.850200 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e99b221268b4c33ab6e32f341eb2d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.851297 10484 raft_consensus.cc:482] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:34.851434 9815 ts_tablet_manager.cc:1939] T a303792e4c804844bc6037fabb425be4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.851403 10484 raft_consensus.cc:504] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.851986 10484 leader_election.cc:288] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:34.852348 9815 tablet_replica.cc:330] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.852619 9815 raft_consensus.cc:2229] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.852775 9815 raft_consensus.cc:2258] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.852662 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0489aea8bb0a45daaaec6a48db756c51" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:34.853255 9815 ts_tablet_manager.cc:1905] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:34.853327 9497 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.853622 9263 tablet_service.cc:1467] Processing CreateTablet for tablet e000190187974d138aed1d21b8c8bf8e (DEFAULT_TABLE table=default.Table_cfb37e10a1a64ee2965cbfcd70f87adf [id=da20213bdf84459cac7fa9135b737306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.854027 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e000190187974d138aed1d21b8c8bf8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.854877 10641 tablet.cc:1717] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:34.857728 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0489aea8bb0a45daaaec6a48db756c51" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.858477 9498 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.858587 9498 leader_election.cc:302] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:34.858948 10484 raft_consensus.cc:2726] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.859380 9814 ts_tablet_manager.cc:1918] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.859480 9814 log.cc:1196] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:34.859547 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a2d5a67ec9ce403d91ef1f6d52380b96
I20260928 14:50:34.859736 9814 ts_tablet_manager.cc:1939] T f3ac8adb23c5478fadb6cb6765459913 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.860888 8916 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu pid 8994
I20260928 14:50:34.863023 9848 ts_tablet_manager.cc:1428] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.032s user 0.000s sys 0.001s
I20260928 14:50:34.863016 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:34.863458 9848 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:34.863549 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 88015bcd867e40e5b9263930e820074a
I20260928 14:50:34.864202 9815 ts_tablet_manager.cc:1918] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.864344 9815 log.cc:1196] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/be232889594147bdbe2d4825c3e8c7d0
I20260928 14:50:34.864666 9815 ts_tablet_manager.cc:1939] T be232889594147bdbe2d4825c3e8c7d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.864913 9814 tablet_replica.cc:330] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.865319 9848 tablet_bootstrap.cc:654] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.865662 9814 raft_consensus.cc:2229] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.866474 9814 raft_consensus.cc:2258] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.867048 9814 ts_tablet_manager.cc:1905] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.870231 9815 tablet_replica.cc:330] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.870479 9815 raft_consensus.cc:2229] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.870769 9815 raft_consensus.cc:2258] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.871286 9815 ts_tablet_manager.cc:1905] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.872503 10696 tablet.cc:1722] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:34.799540 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:34.876295 9220 leader_election.cc:341] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:34.876684 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet c9a7573c751d412aa8394d6277c28b7f (table default.Table_cd097e6f93214ec0b7966e4b467d51e2 [id=af10d65afe83474cb0951a8c0e9f0a55]) successfully deleted
I20260928 14:50:34.878270 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 88015bcd867e40e5b9263930e820074a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.878664 9397 tablet_service.cc:1467] Processing CreateTablet for tablet e000190187974d138aed1d21b8c8bf8e (DEFAULT_TABLE table=default.Table_cfb37e10a1a64ee2965cbfcd70f87adf [id=da20213bdf84459cac7fa9135b737306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.879067 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e000190187974d138aed1d21b8c8bf8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.880802 10641 tablet.cc:1722] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:34.881067 9815 ts_tablet_manager.cc:1918] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:34.881156 9815 log.cc:1196] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f81f1875265642c3a428e658dca558d0
I20260928 14:50:34.881469 9815 ts_tablet_manager.cc:1939] T f81f1875265642c3a428e658dca558d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:34.881780 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b7879be7bb70430daf898fc79f5ce19c (DEFAULT_TABLE table=default.Table_32e300160b6d40b6b78f7cab5973cd76 [id=0e6b07d7ff0b47dda8d5fd44390cc599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.882117 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7879be7bb70430daf898fc79f5ce19c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:34.884832 9360 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:34.878690 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 00810c4b2d074854af17b2a71700a393 (DEFAULT_TABLE table=default.Table_d1f0ac6c967e43d7bbe7fdb8db9f14e2 [id=5b45dc56cd274c7d8682fca4d1b37137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.886780 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00810c4b2d074854af17b2a71700a393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.890393 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.896032 9397 tablet_service.cc:1467] Processing CreateTablet for tablet f9806789400a4e15bd9e06860c9fd4df (DEFAULT_TABLE table=default.Table_64407deb9d1b496889a06e24ac68b9ce [id=d5c37c8492594ea78068eddf5f659a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.896386 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9806789400a4e15bd9e06860c9fd4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.897784 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbc88b53052473895a2d2e63da9be50 (DEFAULT_TABLE table=default.Table_cc14ad35a4de45f19a8409e3a29b6bf9 [id=8d6f5903ee8342268f7808ecdd33727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.898139 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbc88b53052473895a2d2e63da9be50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.898392 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]). Expected version 1 got 0
I20260928 14:50:34.898717 8948 catalog_manager.cc:5495] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:34.899528 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:34.899917 8948 catalog_manager.cc:5495] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:34.900470 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:34.860353 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 11714d0ca321429c95de223320794a0e (table default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]) successfully deleted
W20260928 14:50:34.900919 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 51959.2us
W20260928 14:50:34.901213 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ae6fbfca4fc0b0b053d0134a49d0 already in progress: creating tablet
W20260928 14:50:34.901571 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 24c45934c64642c2b171cb42544728bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24c45934c64642c2b171cb42544728bc already in progress: creating tablet
I20260928 14:50:34.901816 9851 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:34.901839 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2df12117111548beb5d570436e2d6de2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df12117111548beb5d570436e2d6de2 already in progress: creating tablet
I20260928 14:50:34.902019 9851 ts_tablet_manager.cc:1397] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.113s user 0.007s sys 0.000s
W20260928 14:50:34.902329 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 92d1100b862b4170807be02a39307359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1100b862b4170807be02a39307359 already in progress: creating tablet
I20260928 14:50:34.902680 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet a303792e4c804844bc6037fabb425be4 (table default.Table_39fb4e4216bf46188c6df0df4e908528 [id=6d447d56ce46413f934c0d407c8b7eb9]) successfully deleted
I20260928 14:50:34.903486 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet be232889594147bdbe2d4825c3e8c7d0 (table default.Table_7bb67fe09d1544418318121e5efde0a0 [id=fa7396482f54455193f716a38798ca0f]) successfully deleted
W20260928 14:50:34.903801 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e92b08254f4041e482e7fa1935dd7071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e92b08254f4041e482e7fa1935dd7071 already in progress: creating tablet
I20260928 14:50:34.903822 9851 raft_consensus.cc:348] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.904141 9851 raft_consensus.cc:374] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:34.904098 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d34a235b38aa4e9ba328a7f542342653 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d34a235b38aa4e9ba328a7f542342653 already in progress: creating tablet
I20260928 14:50:34.904222 9851 raft_consensus.cc:729] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:34.904667 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet aaacc1f839914859b23ae755042e02d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaacc1f839914859b23ae755042e02d8 already in progress: creating tablet
W20260928 14:50:34.904938 9360 leader_election.cc:341] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: bad2124268994f04ae7153ea5aaeeab0
W20260928 14:50:34.906023 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9e72d815a218451b884604a1f334d632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e72d815a218451b884604a1f334d632 already in progress: creating tablet
W20260928 14:50:34.906245 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 59ced67c921e43e48bcb5195da212582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ced67c921e43e48bcb5195da212582 already in progress: creating tablet
I20260928 14:50:34.906620 9360 leader_election.cc:302] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:34.906965 10678 raft_consensus.cc:2726] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:34.906975 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 066df778654449bda96f68b5035c4d73 (table default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]) successfully deleted
I20260928 14:50:34.907228 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ca5c040fa6ba4e2785959874a3346bf7 (table default.Table_c2ea7b972a3441858741b741d8452bd7 [id=8fe8d4808cbe43a3ad3d3f217582b27c]) successfully deleted
W20260928 14:50:34.907671 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet aaacc1f839914859b23ae755042e02d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaacc1f839914859b23ae755042e02d8 already in progress: creating tablet
I20260928 14:50:34.907938 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f3ac8adb23c5478fadb6cb6765459913 (table default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]) successfully deleted
I20260928 14:50:34.908581 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.909919 9814 ts_tablet_manager.cc:1918] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:34.910079 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.910460 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:34.911247 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.911837 10696 tablet.cc:1722] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:34.904522 9851 consensus_queue.cc:260] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:34.914495 9543 tablet_service.cc:1467] Processing CreateTablet for tablet e000190187974d138aed1d21b8c8bf8e (DEFAULT_TABLE table=default.Table_cfb37e10a1a64ee2965cbfcd70f87adf [id=da20213bdf84459cac7fa9135b737306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.914842 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e000190187974d138aed1d21b8c8bf8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.915135 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.915151 9254 tablet_service.cc:1467] Processing CreateTablet for tablet b7879be7bb70430daf898fc79f5ce19c (DEFAULT_TABLE table=default.Table_32e300160b6d40b6b78f7cab5973cd76 [id=0e6b07d7ff0b47dda8d5fd44390cc599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.915890 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7879be7bb70430daf898fc79f5ce19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.922504 9059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260928 14:50:34.927861 9543 tablet_service.cc:1467] Processing CreateTablet for tablet b7879be7bb70430daf898fc79f5ce19c (DEFAULT_TABLE table=default.Table_32e300160b6d40b6b78f7cab5973cd76 [id=0e6b07d7ff0b47dda8d5fd44390cc599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.928294 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7879be7bb70430daf898fc79f5ce19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.930285 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 00810c4b2d074854af17b2a71700a393 (DEFAULT_TABLE table=default.Table_d1f0ac6c967e43d7bbe7fdb8db9f14e2 [id=5b45dc56cd274c7d8682fca4d1b37137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.930828 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00810c4b2d074854af17b2a71700a393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.932837 8954 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f54b4de03fc14daebdff48c0e7f3b34e
I20260928 14:50:34.936089 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 10bdc3b5957b46ff8c470df4cee3bb1f (DEFAULT_TABLE table=default.Table_18bf397043f247ce852099afb93bb980 [id=e1642334627f4f3db0e871bc1a750282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.936545 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bdc3b5957b46ff8c470df4cee3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.937728 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 00810c4b2d074854af17b2a71700a393 (DEFAULT_TABLE table=default.Table_d1f0ac6c967e43d7bbe7fdb8db9f14e2 [id=5b45dc56cd274c7d8682fca4d1b37137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.938122 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00810c4b2d074854af17b2a71700a393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.938647 9851 ts_tablet_manager.cc:1428] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260928 14:50:34.938194 9813 ts_tablet_manager.cc:1918] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:34.938756 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 19526201c0124eba8cc4c9ab2f60d401 (DEFAULT_TABLE table=default.Table_dec376dac1344cd4b134f320b973e812 [id=f2158888463846d28b125085207f6a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.939604 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19526201c0124eba8cc4c9ab2f60d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.910094 9814 log.cc:1196] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f81f1875265642c3a428e658dca558d0
I20260928 14:50:34.943770 9814 ts_tablet_manager.cc:1939] T f81f1875265642c3a428e658dca558d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:34.942550 9813 log.cc:1196] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f095e4cbf95147d9afb83434ae1fd29f
I20260928 14:50:34.945044 9261 tablet_service.cc:1467] Processing CreateTablet for tablet f9806789400a4e15bd9e06860c9fd4df (DEFAULT_TABLE table=default.Table_64407deb9d1b496889a06e24ac68b9ce [id=d5c37c8492594ea78068eddf5f659a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.945744 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 88015bcd867e40e5b9263930e820074a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.946857 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f9806789400a4e15bd9e06860c9fd4df (DEFAULT_TABLE table=default.Table_64407deb9d1b496889a06e24ac68b9ce [id=d5c37c8492594ea78068eddf5f659a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.947243 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9806789400a4e15bd9e06860c9fd4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.949580 9851 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:34.950884 9813 ts_tablet_manager.cc:1939] T f095e4cbf95147d9afb83434ae1fd29f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:34.952359 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbc88b53052473895a2d2e63da9be50 (DEFAULT_TABLE table=default.Table_cc14ad35a4de45f19a8409e3a29b6bf9 [id=8d6f5903ee8342268f7808ecdd33727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.952858 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbc88b53052473895a2d2e63da9be50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.955945 9815 tablet_replica.cc:330] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:34.956139 9815 raft_consensus.cc:2229] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.956292 9815 raft_consensus.cc:2258] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.956972 9815 ts_tablet_manager.cc:1905] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.961875 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 88015bcd867e40e5b9263930e820074a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:34.961889 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 (DEFAULT_TABLE table=default.Table_7dd5d5888c7d425ab48023cafda7fa64 [id=e4c2b18d311f4dfbb45dc455883bb99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.962483 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5ceda898274189b81b9172cdbc7bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.963001 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_f38371501cb347d3b36246f9a12070f8 [id=1692d8fdf9b240f6a1662de9319db005]). Expected version 3 got 0
I20260928 14:50:34.963095 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a3c68a2575cf4150a70fedf55d507235"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.963796 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3c68a2575cf4150a70fedf55d507235 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.964313 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9806789400a4e15bd9e06860c9fd4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.964926 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:34.966440 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad1ea40cde8748a3801f5825208eeac1" } new_table_name: "default.Table_5aeedece8e2c413fbab21f1520e5933d" modify_external_catalogs: true
I20260928 14:50:34.970534 9814 tablet_replica.cc:330] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:34.970746 9814 raft_consensus.cc:2229] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:34.970912 9814 raft_consensus.cc:2258] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:34.971392 9814 ts_tablet_manager.cc:1905] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:34.972453 10695 tablet.cc:1717] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:34.973851 9851 tablet_bootstrap.cc:654] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:34.974834 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:34.975394 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_96b6e8f2c5cd403da0aeaae9a7daba11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.975998 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.979406 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8bc54dd6856f4710b282b4dce6e03df6" } new_table_name: "default.Table_2e1b9160eba94bbf9e2bc2bae293d177" modify_external_catalogs: true
I20260928 14:50:34.981763 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84280ea01fa6441ebb483c2c09cb42db" } new_table_name: "default.Table_f9d1f83d4b0d4777b9d3b3755b556817" modify_external_catalogs: true
I20260928 14:50:34.984525 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 480) took 5171 ms. Trace:
I20260928 14:50:34.985473 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0309537ad6814ffe84375cc41cc22974"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.986130 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0309537ad6814ffe84375cc41cc22974 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.984668 9813 rpcz_store.cc:276] 0928 14:50:29.813498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.821822 (+ 8324us) service_pool.cc:227] Handling call
0928 14:50:34.833829 (+5012007us) ts_tablet_manager.cc:1145] Deleting tablet f095e4cbf95147d9afb83434ae1fd29f
0928 14:50:34.833839 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.837166 (+ 3327us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.936697 (+ 99531us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:34.984505 (+ 47808us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5011786}
I20260928 14:50:34.987433 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f095e4cbf95147d9afb83434ae1fd29f (table default.Table_ad79ea2361c24f15adbaee0e9f6a72e8 [id=7eae86649b99495e8c94f9bec64bfc83]) successfully deleted
I20260928 14:50:34.987892 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 486) took 5153 ms. Trace:
I20260928 14:50:34.988014 9813 rpcz_store.cc:276] 0928 14:50:29.834640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.834690 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:34.987775 (+5153085us) ts_tablet_manager.cc:1145] Deleting tablet 4a14c0b50cad4954b5dc5666689810ba
0928 14:50:34.987785 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.987875 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5152809}
W20260928 14:50:34.988922 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4a14c0b50cad4954b5dc5666689810ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a14c0b50cad4954b5dc5666689810ba already in progress: creating tablet
I20260928 14:50:34.989540 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:34.990234 8953 catalog_manager.cc:6565] ReplaceTablet: tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f deleted and replaced by tablet 6b8211c873b2414c94798169f73502c2
I20260928 14:50:34.990015 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbc88b53052473895a2d2e63da9be50 (DEFAULT_TABLE table=default.Table_cc14ad35a4de45f19a8409e3a29b6bf9 [id=8d6f5903ee8342268f7808ecdd33727f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.990567 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbc88b53052473895a2d2e63da9be50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.992190 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 496) took 5085 ms. Trace:
W20260928 14:50:34.992642 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4eeb2aa92a24b628156d34129f1381c consensus state has no leader
I20260928 14:50:34.992323 9813 rpcz_store.cc:276] 0928 14:50:29.907085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:29.910298 (+ 3213us) service_pool.cc:227] Handling call
0928 14:50:34.992086 (+5081788us) ts_tablet_manager.cc:1145] Deleting tablet 8f2898a032e1488b98c31b5e83371a71
0928 14:50:34.992096 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:34.992174 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5065168}
I20260928 14:50:34.993841 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_842f7ea913494cddabfad1158c95b762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:34.994115 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0b0c5d342f0141f2be1adba65d11798f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.994554 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_842f7ea913494cddabfad1158c95b762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:34.994727 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b0c5d342f0141f2be1adba65d11798f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.995075 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 19526201c0124eba8cc4c9ab2f60d401 (DEFAULT_TABLE table=default.Table_dec376dac1344cd4b134f320b973e812 [id=f2158888463846d28b125085207f6a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:34.995388 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19526201c0124eba8cc4c9ab2f60d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:34.995945 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_177966ee47784d7daa96d6d622777e77" } new_table_name: "default.Table_a76ef2e24c6a46f196b589c24e7cb5f9" modify_external_catalogs: true
I20260928 14:50:34.996079 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_47b964b20f4d4594b7cd7dac3a47388d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:34.996532 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b964b20f4d4594b7cd7dac3a47388d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:34.996860 9855 tablet_bootstrap.cc:654] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:34.999536 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b consensus state has no leader
I20260928 14:50:34.999408 8953 catalog_manager.cc:5495] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae832871bd1142f7af10c084115ffc12 (127.8.181.2). New cstate: current_term: 1 leader_uuid: "ae832871bd1142f7af10c084115ffc12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:35.000017 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 10bdc3b5957b46ff8c470df4cee3bb1f (DEFAULT_TABLE table=default.Table_18bf397043f247ce852099afb93bb980 [id=e1642334627f4f3db0e871bc1a750282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.000778 8948 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41] alter complete (version 1)
I20260928 14:50:35.001036 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.002832 9855 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.002954 9855 ts_tablet_manager.cc:1397] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.189s user 0.017s sys 0.003s
I20260928 14:50:35.003528 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 57e56077833e41dbacf54c1757ba6a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.003542 9855 raft_consensus.cc:348] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.003734 9855 raft_consensus.cc:374] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.003799 9855 raft_consensus.cc:729] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.004595 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 501) took 4989 ms. Trace:
I20260928 14:50:35.004455 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.004729 9813 rpcz_store.cc:276] 0928 14:50:30.015205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.037862 (+ 22657us) service_pool.cc:227] Handling call
0928 14:50:35.004471 (+4966609us) ts_tablet_manager.cc:1145] Deleting tablet 2e16a0f674114ac8b4520fbce2d383d8
0928 14:50:35.004481 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.004578 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4966161}
I20260928 14:50:35.004678 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 19526201c0124eba8cc4c9ab2f60d401 (DEFAULT_TABLE table=default.Table_dec376dac1344cd4b134f320b973e812 [id=f2158888463846d28b125085207f6a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.005054 9813 tablet_replica.cc:330] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:35.005275 9813 raft_consensus.cc:2229] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.005478 9813 raft_consensus.cc:2258] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.005745 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.006073 9813 ts_tablet_manager.cc:1905] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.006487 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.006665 9855 consensus_queue.cc:260] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.007228 9855 ts_tablet_manager.cc:1428] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:35.007246 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.008126 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 10bdc3b5957b46ff8c470df4cee3bb1f (DEFAULT_TABLE table=default.Table_18bf397043f247ce852099afb93bb980 [id=e1642334627f4f3db0e871bc1a750282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.008205 9855 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.009107 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 (DEFAULT_TABLE table=default.Table_7dd5d5888c7d425ab48023cafda7fa64 [id=e4c2b18d311f4dfbb45dc455883bb99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.009677 9855 tablet_bootstrap.cc:654] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.010691 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 (DEFAULT_TABLE table=default.Table_7dd5d5888c7d425ab48023cafda7fa64 [id=e4c2b18d311f4dfbb45dc455883bb99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.011626 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 5e25b5e7f69e4250a518fe72c07045d9 (DEFAULT_TABLE table=default.Table_40809d57eacb44dea6a88cd21516512a [id=e5683cccac40475d8f8e979fbf5f7729]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:35.012632 9220 consensus_peers.cc:487] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:35.012703 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 5e25b5e7f69e4250a518fe72c07045d9 (DEFAULT_TABLE table=default.Table_40809d57eacb44dea6a88cd21516512a [id=e5683cccac40475d8f8e979fbf5f7729]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.013114 9567 raft_consensus.cc:1261] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:35.013792 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5ceda898274189b81b9172cdbc7bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.013721 10683 consensus_queue.cc:1035] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:35.013998 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1df25948af14998a26b36bb5b466a1e consensus state has no leader
I20260928 14:50:35.014433 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e25b5e7f69e4250a518fe72c07045d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.016240 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 820a60a83d2a4c32bdb23e600cf60b0d (DEFAULT_TABLE table=default.Table_22f2a27e142e4b97a331706f380ad184 [id=1748a29b96ee4c4a95fbb7e1ab372698]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:35.017313 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bdcddceb8844a9f80bdd9b0761a5433 consensus state has no leader
I20260928 14:50:35.021149 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f81f1875265642c3a428e658dca558d0 (table default.Table_039a4d4fbb964bdb995a4b30b21ef7bf [id=5ac524ecad68439eb40c058be3ee262a]) successfully deleted
I20260928 14:50:35.022807 9855 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.022925 9855 ts_tablet_manager.cc:1397] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.005s
I20260928 14:50:35.023532 9855 raft_consensus.cc:348] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.023718 9855 raft_consensus.cc:374] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.023784 9855 raft_consensus.cc:729] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.023954 9855 consensus_queue.cc:260] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:35.024441 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9e72d815a218451b884604a1f334d632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e72d815a218451b884604a1f334d632 already in progress: creating tablet
I20260928 14:50:35.024479 9855 ts_tablet_manager.cc:1428] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:35.024600 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bdc3b5957b46ff8c470df4cee3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.024703 9855 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:35.027074 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 59ced67c921e43e48bcb5195da212582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ced67c921e43e48bcb5195da212582 already in progress: creating tablet
I20260928 14:50:35.029315 9855 tablet_bootstrap.cc:654] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:35.030056 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 622a7af04be44ddebc1af16fcc6325ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622a7af04be44ddebc1af16fcc6325ae already in progress: creating tablet
I20260928 14:50:35.032191 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 820a60a83d2a4c32bdb23e600cf60b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.032809 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 5e25b5e7f69e4250a518fe72c07045d9 (DEFAULT_TABLE table=default.Table_40809d57eacb44dea6a88cd21516512a [id=e5683cccac40475d8f8e979fbf5f7729]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.033017 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bdc3b5957b46ff8c470df4cee3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.033145 10484 raft_consensus.cc:482] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.033255 10484 raft_consensus.cc:504] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.033813 10484 leader_election.cc:288] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.034294 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.034852 9497 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.035460 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e25b5e7f69e4250a518fe72c07045d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.036010 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19526201c0124eba8cc4c9ab2f60d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.036029 9855 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.036135 9855 ts_tablet_manager.cc:1397] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260928 14:50:35.036669 9855 raft_consensus.cc:348] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.036834 9855 raft_consensus.cc:374] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.036875 9855 raft_consensus.cc:729] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.038450 9851 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.038645 9851 ts_tablet_manager.cc:1397] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.092s user 0.007s sys 0.016s
I20260928 14:50:35.039408 9851 raft_consensus.cc:348] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.039695 9851 raft_consensus.cc:374] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.039789 9851 raft_consensus.cc:729] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.039832 9848 tablet_bootstrap.cc:492] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.039942 9848 ts_tablet_manager.cc:1397] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.177s user 0.000s sys 0.004s
I20260928 14:50:35.040175 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e25b5e7f69e4250a518fe72c07045d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.040041 9851 consensus_queue.cc:260] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.040772 9851 ts_tablet_manager.cc:1428] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.037735 9855 consensus_queue.cc:260] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.041309 9855 ts_tablet_manager.cc:1428] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:35.041603 9855 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.041491 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 820a60a83d2a4c32bdb23e600cf60b0d (DEFAULT_TABLE table=default.Table_22f2a27e142e4b97a331706f380ad184 [id=1748a29b96ee4c4a95fbb7e1ab372698]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.042659 9851 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.044423 9851 tablet_bootstrap.cc:654] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.046044 9855 tablet_bootstrap.cc:654] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.049003 9281 raft_consensus.cc:3037] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.055439 9855 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.055697 9855 ts_tablet_manager.cc:1397] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260928 14:50:35.056314 9855 raft_consensus.cc:348] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.056502 9855 raft_consensus.cc:374] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.056559 9855 raft_consensus.cc:729] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.056989 9855 consensus_queue.cc:260] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.058483 9851 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.058620 9851 ts_tablet_manager.cc:1397] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.006s
I20260928 14:50:35.059314 9851 raft_consensus.cc:348] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.059463 9814 ts_tablet_manager.cc:1918] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.059690 9814 log.cc:1196] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/88015bcd867e40e5b9263930e820074a
I20260928 14:50:35.057513 9855 ts_tablet_manager.cc:1428] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:35.059978 9855 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.059532 9851 raft_consensus.cc:374] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.060849 9851 raft_consensus.cc:729] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.061201 9814 ts_tablet_manager.cc:1939] T 88015bcd867e40e5b9263930e820074a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.061616 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5ceda898274189b81b9172cdbc7bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.061730 9855 tablet_bootstrap.cc:654] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.061919 10484 raft_consensus.cc:482] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.062023 10484 raft_consensus.cc:504] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.062572 10484 leader_election.cc:288] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.063280 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1e945f1c54281856bfabe08fba42e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.063777 9497 leader_election.cc:341] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.061100 9851 consensus_queue.cc:260] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.064406 9851 ts_tablet_manager.cc:1428] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 14:50:35.064697 9851 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:35.065843 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ea7b363d546c45ceb3efb9352cf184f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea7b363d546c45ceb3efb9352cf184f4 already in progress: creating tablet
I20260928 14:50:35.066221 9851 tablet_bootstrap.cc:654] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.066430 9814 tablet_replica.cc:330] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:35.066540 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet af22f23ff3864620bfefb31b9e899036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af22f23ff3864620bfefb31b9e899036 already in progress: creating tablet
I20260928 14:50:35.066691 9814 raft_consensus.cc:2229] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:35.066865 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a2d5a67ec9ce403d91ef1f6d52380b96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2d5a67ec9ce403d91ef1f6d52380b96 already in progress: creating tablet
I20260928 14:50:35.066922 9814 raft_consensus.cc:2258] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:35.067155 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 already in progress: creating tablet
I20260928 14:50:35.067466 9814 ts_tablet_manager.cc:1905] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.067819 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 88015bcd867e40e5b9263930e820074a (table default.Table_67d8c754b00c4bc083809df338bf770a [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]) successfully deleted
I20260928 14:50:35.068280 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f81f1875265642c3a428e658dca558d0 (table default.Table_039a4d4fbb964bdb995a4b30b21ef7bf [id=5ac524ecad68439eb40c058be3ee262a]) successfully deleted
W20260928 14:50:35.068648 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 622a7af04be44ddebc1af16fcc6325ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622a7af04be44ddebc1af16fcc6325ae already in progress: creating tablet
W20260928 14:50:35.068965 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ea7b363d546c45ceb3efb9352cf184f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea7b363d546c45ceb3efb9352cf184f4 already in progress: creating tablet
I20260928 14:50:35.070163 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.079656 9851 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.079687 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:35.079874 9851 ts_tablet_manager.cc:1397] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260928 14:50:35.080981 9851 raft_consensus.cc:348] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.081283 9851 raft_consensus.cc:374] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.081439 9851 raft_consensus.cc:729] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.081444 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.081708 9851 consensus_queue.cc:260] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.082306 9851 ts_tablet_manager.cc:1428] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 14:50:35.082779 9851 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.091152 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:35.093703 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.094682 9814 ts_tablet_manager.cc:1918] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.094959 9814 log.cc:1196] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9648be4c626e44e0986c196704483955
I20260928 14:50:35.096864 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 820a60a83d2a4c32bdb23e600cf60b0d (DEFAULT_TABLE table=default.Table_22f2a27e142e4b97a331706f380ad184 [id=1748a29b96ee4c4a95fbb7e1ab372698]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.097652 9851 tablet_bootstrap.cc:654] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.098048 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa (DEFAULT_TABLE table=default.Table_8c99043954b44135b9b0bf8d933aed70 [id=a7cf602de10d43619e60ca448edc3b2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.098469 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 820a60a83d2a4c32bdb23e600cf60b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.099990 10683 raft_consensus.cc:482] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.100042 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151f556d50bc400a9ed4cfbdbbfc84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.100206 10683 raft_consensus.cc:504] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.100941 10683 leader_election.cc:288] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.105285 9815 ts_tablet_manager.cc:1918] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:35.105446 9219 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:35.105969 9814 ts_tablet_manager.cc:1939] T 9648be4c626e44e0986c196704483955 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.106109 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa (DEFAULT_TABLE table=default.Table_8c99043954b44135b9b0bf8d933aed70 [id=a7cf602de10d43619e60ca448edc3b2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.106566 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151f556d50bc400a9ed4cfbdbbfc84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.106977 9814 tablet_replica.cc:330] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.107261 9814 raft_consensus.cc:2229] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.107538 9814 raft_consensus.cc:2258] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.108286 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.108907 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.109037 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 820a60a83d2a4c32bdb23e600cf60b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.109227 9814 ts_tablet_manager.cc:1905] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.112087 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f01f727f946f45d3978bfa5bda304b36" } new_table_name: "default.Table_dbc4720c6e574bb7a875e924f8c2524f" modify_external_catalogs: true
I20260928 14:50:35.113581 9848 raft_consensus.cc:348] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.113914 9848 raft_consensus.cc:374] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.113763 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1e945f1c54281856bfabe08fba42e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.114135 9848 raft_consensus.cc:729] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.114593 9848 consensus_queue.cc:260] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.116328 9848 ts_tablet_manager.cc:1428] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.076s user 0.003s sys 0.000s
I20260928 14:50:35.117286 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2898a032e1488b98c31b5e83371a71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.117678 9851 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.117823 9851 ts_tablet_manager.cc:1397] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.009s
I20260928 14:50:35.117954 10641 tablet.cc:1722] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:35.119330 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:35.119709 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f437d450119b40f5af9c5e4f167cd36e" } modify_external_catalogs: true
W20260928 14:50:35.119948 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.119988 10696 tablet.cc:1722] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:35.122435 9848 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:35.122567 9498 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.122675 9498 leader_election.cc:302] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:35.123008 9498 leader_election.cc:341] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.123112 9498 leader_election.cc:302] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.123394 10630 raft_consensus.cc:2726] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.123524 10630 raft_consensus.cc:2726] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.125350 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c2b819b194d4373a59a3e94267361c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e16a0f674114ac8b4520fbce2d383d8) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.126880 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 8234670cb2604ba7b405ad7f70e03a2f from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:35.127727 9851 raft_consensus.cc:348] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.127978 9851 raft_consensus.cc:374] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.128021 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2969f92d404942518e3feadd54948444" } modify_external_catalogs: true
I20260928 14:50:35.130035 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:35.130672 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.131528 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74a626e855bc41ecb2d3684dae5c9346" } modify_external_catalogs: true
I20260928 14:50:35.133193 9851 raft_consensus.cc:729] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.133595 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.133462 9851 consensus_queue.cc:260] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.134188 9851 ts_tablet_manager.cc:1428] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260928 14:50:35.134541 9851 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.139479 9814 ts_tablet_manager.cc:1918] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.141690 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f437d450119b40f5af9c5e4f167cd36e" } modify_external_catalogs: true
I20260928 14:50:35.143092 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74a626e855bc41ecb2d3684dae5c9346" } modify_external_catalogs: true
I20260928 14:50:35.144778 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2969f92d404942518e3feadd54948444" } modify_external_catalogs: true
I20260928 14:50:35.105403 9815 log.cc:1196] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/73bbcf31960d478087a0a91337c34ec8
I20260928 14:50:35.146399 9815 ts_tablet_manager.cc:1939] T 73bbcf31960d478087a0a91337c34ec8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.147209 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet ca5c040fa6ba4e2785959874a3346bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.148382 9855 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.148497 9855 ts_tablet_manager.cc:1397] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.089s user 0.026s sys 0.018s
I20260928 14:50:35.151032 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet c85735981779438197f2c0f489681b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.153231 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9648be4c626e44e0986c196704483955 (table default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]) successfully deleted
I20260928 14:50:35.153498 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f79fcac805b42ba8b66949fbdfeb8f6" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.154690 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa (DEFAULT_TABLE table=default.Table_8c99043954b44135b9b0bf8d933aed70 [id=a7cf602de10d43619e60ca448edc3b2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.155864 9815 tablet_replica.cc:330] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.156065 9815 raft_consensus.cc:2229] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.156208 9815 raft_consensus.cc:2258] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.156749 9855 raft_consensus.cc:348] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:35.156731 9220 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.156951 9855 raft_consensus.cc:374] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.157004 9855 raft_consensus.cc:729] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.157193 9855 consensus_queue.cc:260] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.157663 9855 ts_tablet_manager.cc:1428] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260928 14:50:35.157907 9855 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.158514 9815 ts_tablet_manager.cc:1905] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.158833 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151f556d50bc400a9ed4cfbdbbfc84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.166435 9851 tablet_bootstrap.cc:654] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.166417 9220 leader_election.cc:302] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.166882 10552 raft_consensus.cc:2726] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.168663 9815 ts_tablet_manager.cc:1918] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.168766 9815 log.cc:1196] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:35.169036 9815 ts_tablet_manager.cc:1939] T 0489aea8bb0a45daaaec6a48db756c51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.169760 9814 log.cc:1196] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8b914e3c8243490d92378a8765d6390f
I20260928 14:50:35.170774 9814 ts_tablet_manager.cc:1939] T 8b914e3c8243490d92378a8765d6390f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.171482 9855 tablet_bootstrap.cc:654] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.173938 9814 tablet_replica.cc:330] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.174818 9814 raft_consensus.cc:2229] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.175277 9814 raft_consensus.cc:2258] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.176638 9814 ts_tablet_manager.cc:1905] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.180047 9815 tablet_replica.cc:330] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.181473 9851 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.181635 9815 raft_consensus.cc:2229] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.181663 9851 ts_tablet_manager.cc:1397] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.007s
I20260928 14:50:35.181780 9815 raft_consensus.cc:2258] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.182224 9815 ts_tablet_manager.cc:1905] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.182353 9851 raft_consensus.cc:348] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.182642 9851 raft_consensus.cc:374] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.182744 9851 raft_consensus.cc:729] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.183097 9851 consensus_queue.cc:260] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.183951 9851 ts_tablet_manager.cc:1428] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:35.184446 9851 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.186908 9855 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.187080 9855 ts_tablet_manager.cc:1397] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260928 14:50:35.188906 9855 raft_consensus.cc:348] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.189203 9855 raft_consensus.cc:374] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.189285 9855 raft_consensus.cc:729] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.189507 9855 consensus_queue.cc:260] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.195483 9855 ts_tablet_manager.cc:1428] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260928 14:50:35.195778 9855 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.196305 9814 ts_tablet_manager.cc:1918] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.196559 9848 tablet_bootstrap.cc:654] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.197850 9851 tablet_bootstrap.cc:654] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.197970 9814 log.cc:1196] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:35.203954 9855 tablet_bootstrap.cc:654] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.205494 9814 ts_tablet_manager.cc:1939] T b65fd0746d1b474e9fbebe6f09053743 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.206606 9814 tablet_replica.cc:330] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.208415 9814 raft_consensus.cc:2229] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:35.208904 9814 pending_rounds.cc:62] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:35.209161 9814 pending_rounds.cc:68] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326414309851136 op_type: NO_OP noop_request { }
I20260928 14:50:35.209499 9814 raft_consensus.cc:2866] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:35.209894 9814 raft_consensus.cc:2258] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.211305 9814 ts_tablet_manager.cc:1905] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.211700 9815 ts_tablet_manager.cc:1918] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.153149 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]). Expected version 3 got 0
W20260928 14:50:35.216418 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 63127.2us
I20260928 14:50:35.216840 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8b914e3c8243490d92378a8765d6390f (table default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]) successfully deleted
I20260928 14:50:35.217128 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet b65fd0746d1b474e9fbebe6f09053743 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:35.217182 8948 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da] alter complete (version 3)
I20260928 14:50:35.217502 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 73bbcf31960d478087a0a91337c34ec8 (table default.Table_7cbe9b800b63472f9c3edbe98510060c [id=40cbb3838eac45129f8df57636ce48dc]) successfully deleted
W20260928 14:50:35.154073 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8f2898a032e1488b98c31b5e83371a71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f2898a032e1488b98c31b5e83371a71 already in progress: creating tablet
W20260928 14:50:35.217840 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet af22f23ff3864620bfefb31b9e899036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af22f23ff3864620bfefb31b9e899036 already in progress: creating tablet
W20260928 14:50:35.217893 8940 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 63863.8us
W20260928 14:50:35.157258 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 080159d2e65a4550861f4c63fb22d02e consensus state has no leader
I20260928 14:50:35.218165 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 0489aea8bb0a45daaaec6a48db756c51 (table default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]) successfully deleted
W20260928 14:50:35.218353 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 already in progress: creating tablet
I20260928 14:50:35.220432 9813 ts_tablet_manager.cc:1918] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.220561 9813 log.cc:1196] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6891077c78ef4f3d84e33283096ddf7a
I20260928 14:50:35.220762 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7dd5d5888c7d425ab48023cafda7fa64" } modify_external_catalogs: true
I20260928 14:50:35.220860 9813 ts_tablet_manager.cc:1939] T 6891077c78ef4f3d84e33283096ddf7a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:35.220960 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7dd5d5888c7d425ab48023cafda7fa64" } modify_external_catalogs: true
W20260928 14:50:35.223232 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2e16a0f674114ac8b4520fbce2d383d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16a0f674114ac8b4520fbce2d383d8 already in progress: creating tablet
I20260928 14:50:35.224056 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b34f8ded602249869f2d30667cb1bc04" } modify_external_catalogs: true
I20260928 14:50:35.224344 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b34f8ded602249869f2d30667cb1bc04" } modify_external_catalogs: true
I20260928 14:50:35.158439 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 43c887b7c4e8434a9342d49145fde3ae
I20260928 14:50:35.158704 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3348f5a55ef34af88611077aab447f83
I20260928 14:50:35.164399 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:35.228091 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.228394 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 3348f5a55ef34af88611077aab447f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.229241 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 43c887b7c4e8434a9342d49145fde3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.232157 9815 log.cc:1196] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/88015bcd867e40e5b9263930e820074a
I20260928 14:50:35.232528 9815 ts_tablet_manager.cc:1939] T 88015bcd867e40e5b9263930e820074a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.233086 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 503) took 5183 ms. Trace:
I20260928 14:50:35.233220 9813 rpcz_store.cc:276] 0928 14:50:30.049713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.059780 (+ 10067us) service_pool.cc:227] Handling call
0928 14:50:35.005017 (+4945237us) ts_tablet_manager.cc:1145] Deleting tablet 6891077c78ef4f3d84e33283096ddf7a
0928 14:50:35.005026 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.161371 (+156345us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.220324 (+ 58953us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.233055 (+ 12731us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4935227}
I20260928 14:50:35.233700 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6891077c78ef4f3d84e33283096ddf7a (table default.Table_30bb2a03ceff45e0b56a5fd71a36a327 [id=db22600905f14d00b20240613b299c2c]) successfully deleted
I20260928 14:50:35.233819 9813 tablet_replica.cc:330] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:35.233991 9813 raft_consensus.cc:2229] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.234150 9813 raft_consensus.cc:2258] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.234653 9813 ts_tablet_manager.cc:1905] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.235339 9815 tablet_replica.cc:330] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.235580 9815 raft_consensus.cc:2229] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.235755 9815 raft_consensus.cc:2258] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.236224 9815 ts_tablet_manager.cc:1905] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.238270 9848 tablet_bootstrap.cc:492] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.238440 9848 ts_tablet_manager.cc:1397] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.001s
I20260928 14:50:35.239128 9848 raft_consensus.cc:348] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.239411 9848 raft_consensus.cc:374] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.239506 9848 raft_consensus.cc:729] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.239748 9848 consensus_queue.cc:260] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.238366 9855 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.240228 9855 ts_tablet_manager.cc:1397] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.005s
I20260928 14:50:35.240399 9848 ts_tablet_manager.cc:1428] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:35.241053 9855 raft_consensus.cc:348] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.241343 9855 raft_consensus.cc:374] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.241432 9855 raft_consensus.cc:729] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.241689 9855 consensus_queue.cc:260] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.242268 9855 ts_tablet_manager.cc:1428] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:35.242570 9855 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.244745 9814 ts_tablet_manager.cc:1918] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:35.244884 9855 tablet_bootstrap.cc:654] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.249671 9848 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:35.256278 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2120286b0fdb44de96415255839b3445"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:35.256932 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2120286b0fdb44de96415255839b3445 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.258971 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_008fa4a217d843c893276437e5867b4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:35.261802 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ed6b85c8224a4ba08354e6e04b50cb31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:35.262243 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:35.262363 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed6b85c8224a4ba08354e6e04b50cb31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.262446 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.264176 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 88015bcd867e40e5b9263930e820074a (table default.Table_67d8c754b00c4bc083809df338bf770a [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]) successfully deleted
I20260928 14:50:35.265043 9848 tablet_bootstrap.cc:654] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.265811 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 43c887b7c4e8434a9342d49145fde3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.265966 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 3348f5a55ef34af88611077aab447f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.266181 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.266362 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:35.266855 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_008fa4a217d843c893276437e5867b4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.267903 10678 raft_consensus.cc:482] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.268016 10678 raft_consensus.cc:504] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.268592 10678 leader_election.cc:288] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:35.270046 9360 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 88015bcd867e40e5b9263930e820074a
W20260928 14:50:35.270380 9360 leader_election.cc:341] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 88015bcd867e40e5b9263930e820074a
I20260928 14:50:35.270458 9360 leader_election.cc:302] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:35.270905 10678 raft_consensus.cc:2726] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.274464 9815 ts_tablet_manager.cc:1918] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.274629 9815 log.cc:1196] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/a2d5a67ec9ce403d91ef1f6d52380b96
I20260928 14:50:35.274937 9815 ts_tablet_manager.cc:1939] T a2d5a67ec9ce403d91ef1f6d52380b96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.276512 9815 tablet_replica.cc:330] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.276705 9815 raft_consensus.cc:2229] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.276846 9815 raft_consensus.cc:2258] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.279995 9815 ts_tablet_manager.cc:1905] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.283533 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:35.283751 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet a2d5a67ec9ce403d91ef1f6d52380b96 (table default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]) successfully deleted
I20260928 14:50:35.285713 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 1e06b733c67341df93fe16a24397130c (DEFAULT_TABLE table=default.Table_47b964b20f4d4594b7cd7dac3a47388d [id=ac0acf9a9e044d74afc18f86c3e07ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.285938 10484 raft_consensus.cc:482] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.286057 10484 raft_consensus.cc:504] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.286593 10484 leader_election.cc:288] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.287561 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b4b4c775fe4eacaaa557d4daa2a600" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.288197 9498 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:35.285827 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f already in progress: creating tablet
I20260928 14:50:35.288947 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 (DEFAULT_TABLE table=default.Table_842f7ea913494cddabfad1158c95b762 [id=118eb73864b343e18de749e595ba731b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.289665 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.290494 9408 tablet_service.cc:1467] Processing CreateTablet for tablet f2ef75af63c84656b0e308b0df621c98 (DEFAULT_TABLE table=default.Table_bc3579d72196492f94142c12326547da [id=158a244e6a4e4ec58ed0069e78390bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.290654 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 7aff7724868140b3b544d6b1f237b6fa (DEFAULT_TABLE table=default.Table_6a14297d430c49208e7a05d1341ffab9 [id=bda5ca7705fd47259d0b51174e0f4f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.291137 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 1e06b733c67341df93fe16a24397130c (DEFAULT_TABLE table=default.Table_47b964b20f4d4594b7cd7dac3a47388d [id=ac0acf9a9e044d74afc18f86c3e07ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.291468 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e06b733c67341df93fe16a24397130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.292618 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5e5ceda898274189b81b9172cdbc7bb7
I20260928 14:50:35.292689 9392 tablet_service.cc:1467] Processing CreateTablet for tablet caddc46461d349c78a8f06df1f4d658c (DEFAULT_TABLE table=default.Table_b8bf89489cec43d2ad925995c11007a2 [id=06472efd523e40dbbea6df090f63069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.292974 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 50de094e60c247189c082d13dfa7df32 (DEFAULT_TABLE table=default.Table_0309537ad6814ffe84375cc41cc22974 [id=8969a14f4a394191ab1b807efe84ed77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.293411 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.293648 10556 raft_consensus.cc:482] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.293751 10556 raft_consensus.cc:504] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.294257 10556 leader_election.cc:288] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:35.294971 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:35.295188 9567 raft_consensus.cc:2379] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:35.295373 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d30d06c910fa4142a6248e8bfd00f4b2 (table default.Table_4e86b9df2c224f9083cc99ffe56ecbb4 [id=720e4385ef6d42cbbaa26b3fc3cb5521]). Expected version 1 got 0
I20260928 14:50:35.296576 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 9050b87026a2453688df6d403fa18d08 (DEFAULT_TABLE table=default.Table_453f1cfe1974492aa15946bdaf2b3432 [id=c03261e8e48e40358da3119419156134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.296996 9394 tablet_service.cc:1467] Processing CreateTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 (DEFAULT_TABLE table=default.Table_056d3fea7c954741878c0c00280b909e [id=a1d18cd53b794377a316ea8c15cfc254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.297096 9855 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.297205 9855 ts_tablet_manager.cc:1397] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.004s
I20260928 14:50:35.297884 9855 raft_consensus.cc:348] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.298142 9855 raft_consensus.cc:374] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.298249 9855 raft_consensus.cc:729] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.298642 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f92d30a7102f49828227b1428e2224da
I20260928 14:50:35.298817 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 86c1bb371c164248a90236b67f6ed939 (DEFAULT_TABLE table=default.Table_0d750a496c404b97a60106c35458ba06 [id=ef6eb71e789a4d698dd7ae6c81098a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.299571 9855 consensus_queue.cc:260] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.299683 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet f92d30a7102f49828227b1428e2224da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:35.300191 9855 ts_tablet_manager.cc:1428] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:35.300501 9855 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.302105 9393 tablet_service.cc:1467] Processing CreateTablet for tablet a669313e134147bd87e4d65311e242a8 (DEFAULT_TABLE table=default.Table_db0f7c5aa84347d0890c3d590e0d4262 [id=76eb126c005c45809d52ab9170ccd1b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.302852 9403 tablet_service.cc:1467] Processing CreateTablet for tablet e20155b99e264403bd0a8b1380f2345a (DEFAULT_TABLE table=default.Table_820374b9926e4f70b9e5c5646f36238e [id=743d65433252420d8b12c2780bcc50de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.305967 9815 ts_tablet_manager.cc:1918] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.307068 9815 log.cc:1196] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/01c1e945f1c54281856bfabe08fba42e
I20260928 14:50:35.306973 9855 tablet_bootstrap.cc:654] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.307497 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ef75af63c84656b0e308b0df621c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.307684 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbf40dcd1f57425a85193a3fe4b039b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.307936 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20155b99e264403bd0a8b1380f2345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.308103 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a669313e134147bd87e4d65311e242a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.308581 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caddc46461d349c78a8f06df1f4d658c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.308877 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0f7aae759444d8aa4309b98fe7b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.309012 9395 tablet_service.cc:1467] Processing CreateTablet for tablet e00bf3d07eeb42219d79326705b3e440 (DEFAULT_TABLE table=default.Table_1320db9993414adfa520046892472dc5 [id=3a136c87e16a4dfd96fec5366b8c37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.309162 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9050b87026a2453688df6d403fa18d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.309437 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aff7724868140b3b544d6b1f237b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.309756 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e06b733c67341df93fe16a24397130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.310071 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a4a6c21a0824a93acaafa25e1b6e99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.310271 9405 tablet_service.cc:1467] Processing CreateTablet for tablet d1afe428500649e9a4e3c47736062f76 (DEFAULT_TABLE table=default.Table_6afcf7527a994c0aa7b8d8343501e175 [id=c6ce1ba083094afd8221b29cc0867b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.310081 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 257b834a8f024521affb108767a0cc18 (DEFAULT_TABLE table=default.Table_a3e2f9c2c1f04bcc9c3d6b002df28d54 [id=a064391c1b0f4e9e9e80848148f1e071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.310751 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c1bb371c164248a90236b67f6ed939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.311415 9402 tablet_service.cc:1467] Processing CreateTablet for tablet b3d6aa891123476b82eff842aefb565c (DEFAULT_TABLE table=default.Table_c9da29b5882b442392a3f79e5a737ec0 [id=a3c70fd107df41cf81d8cc27b1a821eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.312037 9406 tablet_service.cc:1467] Processing CreateTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e (DEFAULT_TABLE table=default.Table_a3c68a2575cf4150a70fedf55d507235 [id=7f12d167b0d94cab9bba1c0e9246e248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.312391 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50de094e60c247189c082d13dfa7df32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.262475 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 43c887b7c4e8434a9342d49145fde3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.313334 9814 log.cc:1196] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:35.262557 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.263021 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 3348f5a55ef34af88611077aab447f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.313391 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 24f53d04326f4e639be23564563034e0 (DEFAULT_TABLE table=default.Table_7eb037389ef54e5f97821cf8134be4ab [id=64049fd699aa4619b8af272af12c59ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.287714 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b4b4c775fe4eacaaa557d4daa2a600" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:35.289759 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.313817 9814 ts_tablet_manager.cc:1939] T 57e56077833e41dbacf54c1757ba6a38 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.290472 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 1e06b733c67341df93fe16a24397130c (DEFAULT_TABLE table=default.Table_47b964b20f4d4594b7cd7dac3a47388d [id=ac0acf9a9e044d74afc18f86c3e07ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.314096 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e06b733c67341df93fe16a24397130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.314028 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8211c873b2414c94798169f73502c2 (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.314658 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1afe428500649e9a4e3c47736062f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.314932 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 50de094e60c247189c082d13dfa7df32 (DEFAULT_TABLE table=default.Table_0309537ad6814ffe84375cc41cc22974 [id=8969a14f4a394191ab1b807efe84ed77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.315016 9391 tablet_service.cc:1467] Processing CreateTablet for tablet d8c4b670a1974c7aaa448bd6a3398b43 (DEFAULT_TABLE table=default.Table_a7f3efa369774f8b97444dbad06ee74d [id=8c294faf8938455f9a8e9b811a9817fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.315162 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00bf3d07eeb42219d79326705b3e440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.315250 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50de094e60c247189c082d13dfa7df32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.307713 9815 ts_tablet_manager.cc:1939] T 01c1e945f1c54281856bfabe08fba42e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.315584 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d6aa891123476b82eff842aefb565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.315958 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257b834a8f024521affb108767a0cc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.295801 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb6a6cea334521b13b5ebd47fbab98" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.318307 9497 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.318408 9497 leader_election.cc:302] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.309026 9851 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.318760 9851 ts_tablet_manager.cc:1397] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.135s user 0.017s sys 0.018s
I20260928 14:50:35.319583 9851 raft_consensus.cc:348] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.319820 9851 raft_consensus.cc:374] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.319876 9851 raft_consensus.cc:729] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.320046 9851 consensus_queue.cc:260] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.320657 9851 ts_tablet_manager.cc:1428] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.320938 10484 raft_consensus.cc:2726] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.320986 9360 leader_election.cc:302] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:35.321238 9851 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.322408 9815 tablet_replica.cc:330] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.322582 9815 raft_consensus.cc:2229] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.322702 9815 raft_consensus.cc:2258] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.322933 9851 tablet_bootstrap.cc:654] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.324638 10556 raft_consensus.cc:3037] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.327586 10556 raft_consensus.cc:2726] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.330190 9815 ts_tablet_manager.cc:1905] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.333495 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 50de094e60c247189c082d13dfa7df32 (DEFAULT_TABLE table=default.Table_0309537ad6814ffe84375cc41cc22974 [id=8969a14f4a394191ab1b807efe84ed77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.334426 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 (DEFAULT_TABLE table=default.Table_842f7ea913494cddabfad1158c95b762 [id=118eb73864b343e18de749e595ba731b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.334757 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0f7aae759444d8aa4309b98fe7b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.338274 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50de094e60c247189c082d13dfa7df32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.338827 9851 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.338951 9851 ts_tablet_manager.cc:1397] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
I20260928 14:50:35.339686 9851 raft_consensus.cc:348] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.339871 9851 raft_consensus.cc:374] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.339926 9851 raft_consensus.cc:729] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.340091 9851 consensus_queue.cc:260] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.340646 9851 ts_tablet_manager.cc:1428] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:35.341341 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 (DEFAULT_TABLE table=default.Table_842f7ea913494cddabfad1158c95b762 [id=118eb73864b343e18de749e595ba731b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.341691 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0f7aae759444d8aa4309b98fe7b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.342898 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.344049 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c92c44ab247f4107aadad24f568e9f3a" } new_table_name: "default.Table_7d99bdb871a74d888551761985a0175c" modify_external_catalogs: true
I20260928 14:50:35.345822 9851 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.347831 9815 ts_tablet_manager.cc:1918] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.347920 9815 log.cc:1196] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:35.348205 9815 ts_tablet_manager.cc:1939] T 6feba01e78004e50a71c610c9a63aeb5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:35.349876 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2af9b5d62ff3446394272bb983025bfd consensus state has no leader
I20260928 14:50:35.350324 9851 tablet_bootstrap.cc:654] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.357403 9815 tablet_replica.cc:330] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.357838 9815 raft_consensus.cc:2229] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.358238 9815 raft_consensus.cc:2258] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.359197 9815 ts_tablet_manager.cc:1905] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.361430 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc0a83bcaa0647c9bfe9b4635d391b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.366655 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c4b670a1974c7aaa448bd6a3398b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.369751 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8211c873b2414c94798169f73502c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.370050 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f53d04326f4e639be23564563034e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.372705 10677 raft_consensus.cc:482] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.372977 10677 raft_consensus.cc:504] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.373996 10677 leader_election.cc:288] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:35.375420 9815 ts_tablet_manager.cc:1918] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:35.375926 9360 leader_election.cc:341] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ca5c040fa6ba4e2785959874a3346bf7
I20260928 14:50:35.376204 9399 tablet_service.cc:1467] Processing CreateTablet for tablet f5855715375140f5b54b0d53ed1ea915 (DEFAULT_TABLE table=default.Table_690bd7f5a5a945d787c5bfaf7bad1107 [id=4b1073e9ca5943f6a5081c236bfdcc3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.377117 10552 raft_consensus.cc:482] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.377303 10552 raft_consensus.cc:504] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.378018 10552 leader_election.cc:288] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:35.378867 9219 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2f0b97883acb4adfa4091653545e894b
W20260928 14:50:35.383814 9360 leader_election.cc:341] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ca5c040fa6ba4e2785959874a3346bf7
I20260928 14:50:35.384438 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d (DEFAULT_TABLE table=default.Table_6e246f841a2543d69ee059defc37a2d6 [id=6913c15c907f4ca1bbc9259808db6700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.384625 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5855715375140f5b54b0d53ed1ea915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.385104 9815 log.cc:1196] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7d267fa0a698437986feb52cd9c15cc1
I20260928 14:50:35.385696 9815 ts_tablet_manager.cc:1939] T 7d267fa0a698437986feb52cd9c15cc1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.387959 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1bbf59243f4cf6bfc0f770cd01934d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.374009 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5410b1f2384152a4ab80fc44c4cd96 (DEFAULT_TABLE table=default.Table_0b0c5d342f0141f2be1adba65d11798f [id=e49d8c7ff95848c3af1693a14653aef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.389324 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b97883acb4adfa4091653545e894b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.389639 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 058da1b82b214b168ce2218ebada623d (DEFAULT_TABLE table=default.Table_d6ee0411db8d422bb5a9b900321e6e1d [id=880ad2b6273d4eb291ecc052d5a1f1c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:35.389909 9220 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.390027 9220 leader_election.cc:302] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.390100 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058da1b82b214b168ce2218ebada623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.390390 10552 raft_consensus.cc:2726] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.391296 9815 tablet_replica.cc:330] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.391693 9815 raft_consensus.cc:2229] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.392117 9815 raft_consensus.cc:2258] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.394373 9815 ts_tablet_manager.cc:1905] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.395112 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5410b1f2384152a4ab80fc44c4cd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.395356 9855 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.395514 9855 ts_tablet_manager.cc:1397] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.015s
I20260928 14:50:35.395457 9389 tablet_service.cc:1467] Processing CreateTablet for tablet cb1d541610014e408bc0bb7bcb7954bf (DEFAULT_TABLE table=default.Table_4d3442fc50ac47deafcaab819720545b [id=42f0e9db2cce4d23a32c5ebf4a9b55cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.395785 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1d541610014e408bc0bb7bcb7954bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.396298 9855 raft_consensus.cc:348] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.396631 9855 raft_consensus.cc:374] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.396726 9855 raft_consensus.cc:729] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.396946 9855 consensus_queue.cc:260] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.397512 9855 ts_tablet_manager.cc:1428] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.401463 9855 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.403466 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a4a6c21a0824a93acaafa25e1b6e99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.403524 9855 tablet_bootstrap.cc:654] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.416221 9815 ts_tablet_manager.cc:1918] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.426328 9855 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.426545 9855 ts_tablet_manager.cc:1397] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.004s
I20260928 14:50:35.428139 9855 raft_consensus.cc:348] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.428432 9855 raft_consensus.cc:374] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.428525 9855 raft_consensus.cc:729] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.428844 9855 consensus_queue.cc:260] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.429495 9855 ts_tablet_manager.cc:1428] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.429826 9855 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.432120 9855 tablet_bootstrap.cc:654] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.432255 9815 log.cc:1196] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:35.433995 9815 ts_tablet_manager.cc:1939] T c6b4b4c775fe4eacaaa557d4daa2a600 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.442185 10556 raft_consensus.cc:482] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.442370 10556 raft_consensus.cc:504] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.443018 10556 leader_election.cc:288] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:35.443508 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 6be035105eab47fbb3c9b7fa1ae74847 (DEFAULT_TABLE table=default.Table_b309deffacb94196b6b641147fa20814 [id=2b1156c5b0a5426e8a165c1ecc04ed59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.443971 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be035105eab47fbb3c9b7fa1ae74847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.454828 9855 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.455052 9855 ts_tablet_manager.cc:1397] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260928 14:50:35.456434 9855 raft_consensus.cc:348] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.456729 9855 raft_consensus.cc:374] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.456839 9855 raft_consensus.cc:729] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.457086 9855 consensus_queue.cc:260] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.457837 9855 ts_tablet_manager.cc:1428] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:35.458189 9855 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.460196 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_39c68d94f854438e86cf0bdea2f25b90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:35.460968 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39c68d94f854438e86cf0bdea2f25b90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.463295 9855 tablet_bootstrap.cc:654] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.470625 9848 tablet_bootstrap.cc:492] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.470817 9848 ts_tablet_manager.cc:1397] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.221s user 0.004s sys 0.000s
I20260928 14:50:35.471607 9848 raft_consensus.cc:348] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.471915 9848 raft_consensus.cc:374] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.472059 9848 raft_consensus.cc:729] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.472391 9848 consensus_queue.cc:260] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.476512 9848 ts_tablet_manager.cc:1428] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:35.477160 9855 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.477267 9855 ts_tablet_manager.cc:1397] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.004s
I20260928 14:50:35.478174 9855 raft_consensus.cc:348] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.478696 9855 raft_consensus.cc:374] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.478775 9855 raft_consensus.cc:729] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.478988 9855 consensus_queue.cc:260] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.481036 9855 ts_tablet_manager.cc:1428] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:35.481285 9855 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.483939 9848 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:35.488152 9814 tablet_replica.cc:330] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.488430 9814 raft_consensus.cc:2229] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:35.488773 9814 pending_rounds.cc:62] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:35.488883 9814 pending_rounds.cc:68] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326414503387136 op_type: NO_OP noop_request { }
I20260928 14:50:35.489076 9814 raft_consensus.cc:2866] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:35.489216 9814 raft_consensus.cc:2258] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.490936 9813 ts_tablet_manager.cc:1918] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.491111 9813 log.cc:1196] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ee1eb8a9faf04e3b97db9e0f8e9104f8
I20260928 14:50:35.491492 9813 ts_tablet_manager.cc:1939] T ee1eb8a9faf04e3b97db9e0f8e9104f8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:35.491852 9855 tablet_bootstrap.cc:654] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.494266 9814 ts_tablet_manager.cc:1905] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.495935 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e17941e9c752452db972f396574c6bb8" } new_table_name: "default.Table_a392303bc8344306bf5c1d8815194bf4" modify_external_catalogs: true
I20260928 14:50:35.496829 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.497179 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a4a6c21a0824a93acaafa25e1b6e99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.497581 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_46ac9accd4964534a60ae4d76d6a1f54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:35.497818 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 7aff7724868140b3b544d6b1f237b6fa (DEFAULT_TABLE table=default.Table_6a14297d430c49208e7a05d1341ffab9 [id=bda5ca7705fd47259d0b51174e0f4f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.498148 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aff7724868140b3b544d6b1f237b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.498260 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46ac9accd4964534a60ae4d76d6a1f54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.499706 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c0576b54ef0249b889f69aaa0ddc68bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:35.500190 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0576b54ef0249b889f69aaa0ddc68bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:35.501015 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_690bd7f5a5a945d787c5bfaf7bad1107" } new_table_name: "default.Table_5cc1e6eebfc24e5d9a8fca3d7fae39e8" modify_external_catalogs: true
I20260928 14:50:35.501652 10552 raft_consensus.cc:482] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.501761 10552 raft_consensus.cc:504] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.501977 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f2ef75af63c84656b0e308b0df621c98 (DEFAULT_TABLE table=default.Table_bc3579d72196492f94142c12326547da [id=158a244e6a4e4ec58ed0069e78390bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.502311 10552 leader_election.cc:288] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.502723 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:35.502902 9568 raft_consensus.cc:2454] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:35.503017 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:35.503342 9219 leader_election.cc:302] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:35.503582 10552 raft_consensus.cc:2781] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:35.503647 10552 raft_consensus.cc:482] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:35.503705 10552 raft_consensus.cc:3037] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.503744 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 7aff7724868140b3b544d6b1f237b6fa (DEFAULT_TABLE table=default.Table_6a14297d430c49208e7a05d1341ffab9 [id=bda5ca7705fd47259d0b51174e0f4f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.504029 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aff7724868140b3b544d6b1f237b6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.504429 10386 raft_consensus.cc:482] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.504537 10386 raft_consensus.cc:504] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.505034 10386 leader_election.cc:288] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.505234 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ef75af63c84656b0e308b0df621c98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.506347 9219 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:35.506368 10552 raft_consensus.cc:504] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.507172 10552 leader_election.cc:288] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.507148 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:35.507293 9568 raft_consensus.cc:3037] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.512208 9568 raft_consensus.cc:2454] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:35.512689 9219 leader_election.cc:302] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:35.512745 9251 tablet_service.cc:1467] Processing CreateTablet for tablet f2ef75af63c84656b0e308b0df621c98 (DEFAULT_TABLE table=default.Table_bc3579d72196492f94142c12326547da [id=158a244e6a4e4ec58ed0069e78390bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.512966 10552 raft_consensus.cc:2781] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:35.513064 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ef75af63c84656b0e308b0df621c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.513546 10552 raft_consensus.cc:686] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:35.513808 10552 consensus_queue.cc:237] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:35.515034 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01dd30e15c31498299ca5f5a3b2770e9 consensus state has no leader
W20260928 14:50:35.519996 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 080159d2e65a4550861f4c63fb22d02e (table default.Table_dbc4720c6e574bb7a875e924f8c2524f [id=3ad062eda9fb4bb9ac95267ea11f413c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 080159d2e65a4550861f4c63fb22d02e consensus state has no leader
W20260928 14:50:35.524055 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5855715375140f5b54b0d53ed1ea915 consensus state has no leader
I20260928 14:50:35.530563 9855 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.530743 9855 ts_tablet_manager.cc:1397] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.004s
I20260928 14:50:35.532357 9250 tablet_service.cc:1467] Processing CreateTablet for tablet caddc46461d349c78a8f06df1f4d658c (DEFAULT_TABLE table=default.Table_b8bf89489cec43d2ad925995c11007a2 [id=06472efd523e40dbbea6df090f63069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.533308 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caddc46461d349c78a8f06df1f4d658c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.531498 9855 raft_consensus.cc:348] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.535609 9855 raft_consensus.cc:374] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.535877 9855 raft_consensus.cc:729] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.536125 9855 consensus_queue.cc:260] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.537964 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.538712 9538 tablet_service.cc:1467] Processing CreateTablet for tablet caddc46461d349c78a8f06df1f4d658c (DEFAULT_TABLE table=default.Table_b8bf89489cec43d2ad925995c11007a2 [id=06472efd523e40dbbea6df090f63069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.539063 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caddc46461d349c78a8f06df1f4d658c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.541334 9855 ts_tablet_manager.cc:1428] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 14:50:35.504948 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.506953 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296732efcb349ab9cc87e3ff1e11fd0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.509158 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962a5dee53514f7ab5a63242f7d70446" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:35.547701 9220 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.547816 9220 leader_election.cc:302] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.547960 9855 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.548017 10386 raft_consensus.cc:2726] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.548172 9220 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.530053 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 657661b2935b4c1481d8d064427cefbb (DEFAULT_TABLE table=default.Table_2120286b0fdb44de96415255839b3445 [id=e8e107f5cc4c4facb52cfaaffba811db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.530407 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 (DEFAULT_TABLE table=default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812 [id=269700602cc347d9b4982afb9d4848b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.530786 9396 tablet_service.cc:1467] Processing CreateTablet for tablet e0b9be5c4dd84957ac2729b5d7d7fe95 (DEFAULT_TABLE table=default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be [id=df177ac1ce8244c3838eb99260c039c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.549556 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657661b2935b4c1481d8d064427cefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.551314 9855 tablet_bootstrap.cc:654] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.553676 9814 ts_tablet_manager.cc:1918] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:35.553828 9814 log.cc:1196] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c85735981779438197f2c0f489681b96
I20260928 14:50:35.553916 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0fce7d3444063a6dcfec9538f4f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.557760 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0b9be5c4dd84957ac2729b5d7d7fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.560459 9855 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.560702 9855 ts_tablet_manager.cc:1397] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260928 14:50:35.561803 9855 raft_consensus.cc:348] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.562180 9855 raft_consensus.cc:374] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.562285 9855 raft_consensus.cc:729] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.562527 9855 consensus_queue.cc:260] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.563155 9855 ts_tablet_manager.cc:1428] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:35.569104 10484 raft_consensus.cc:482] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.569221 10484 raft_consensus.cc:504] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.569772 10484 leader_election.cc:288] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.570307 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30d06c910fa4142a6248e8bfd00f4b2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.570734 9498 leader_election.cc:341] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.531122 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 86242ca6e920486781f3aec9125f70da (DEFAULT_TABLE table=default.Table_ed6b85c8224a4ba08354e6e04b50cb31 [id=174391519b74485ab8de27dd49946ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.571185 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86242ca6e920486781f3aec9125f70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.572286 9855 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.574940 9855 tablet_bootstrap.cc:654] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.531436 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 471f7e55d0934199a77082b3296e8743 (DEFAULT_TABLE table=default.Table_008fa4a217d843c893276437e5867b4e [id=08fa649e75c04c25a8ecc480ed9da513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.577503 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 471f7e55d0934199a77082b3296e8743. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.548409 9220 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.524523 9848 tablet_bootstrap.cc:654] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.584159 9814 ts_tablet_manager.cc:1939] T c85735981779438197f2c0f489681b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.585139 9814 tablet_replica.cc:330] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.585320 9814 raft_consensus.cc:2229] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.585446 9814 raft_consensus.cc:2258] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.585956 9814 ts_tablet_manager.cc:1905] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.586529 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.587352 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.587489 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e5ceda898274189b81b9172cdbc7bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.587855 9543 tablet_service.cc:1467] Processing CreateTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 (DEFAULT_TABLE table=default.Table_056d3fea7c954741878c0c00280b909e [id=a1d18cd53b794377a316ea8c15cfc254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.588091 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet f92d30a7102f49828227b1428e2224da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:35.588220 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbf40dcd1f57425a85193a3fe4b039b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.588786 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 86c1bb371c164248a90236b67f6ed939 (DEFAULT_TABLE table=default.Table_0d750a496c404b97a60106c35458ba06 [id=ef6eb71e789a4d698dd7ae6c81098a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.589141 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c1bb371c164248a90236b67f6ed939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.590953 9360 leader_election.cc:302] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:35.593078 10556 raft_consensus.cc:2726] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.593348 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 217214us
I20260928 14:50:35.593647 9815 tablet_replica.cc:330] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.593822 9815 raft_consensus.cc:2229] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.593952 9815 raft_consensus.cc:2258] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.601616 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 9050b87026a2453688df6d403fa18d08 (DEFAULT_TABLE table=default.Table_453f1cfe1974492aa15946bdaf2b3432 [id=c03261e8e48e40358da3119419156134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.601928 9815 ts_tablet_manager.cc:1905] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.601987 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9050b87026a2453688df6d403fa18d08. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.602007 9360 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:35.604784 9253 tablet_service.cc:1467] Processing CreateTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 (DEFAULT_TABLE table=default.Table_056d3fea7c954741878c0c00280b909e [id=a1d18cd53b794377a316ea8c15cfc254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.605125 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbf40dcd1f57425a85193a3fe4b039b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.608433 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 (DEFAULT_TABLE table=default.Table_c0576b54ef0249b889f69aaa0ddc68bd [id=1391dd242cb64d5d9da9a6b8f6a02096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.608786 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6a176464e84c94bb5cc4ba6016df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.610925 9815 ts_tablet_manager.cc:1918] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.611099 9815 log.cc:1196] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8520b28899bc42b08e239502adb8fece
I20260928 14:50:35.611487 9815 ts_tablet_manager.cc:1939] T 8520b28899bc42b08e239502adb8fece P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.613678 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 86c1bb371c164248a90236b67f6ed939 (DEFAULT_TABLE table=default.Table_0d750a496c404b97a60106c35458ba06 [id=ef6eb71e789a4d698dd7ae6c81098a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.614032 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c1bb371c164248a90236b67f6ed939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.615924 9395 tablet_service.cc:1467] Processing CreateTablet for tablet befd032922a64c07b5beddc631ca22a3 (DEFAULT_TABLE table=default.Table_46ac9accd4964534a60ae4d76d6a1f54 [id=364dfc1e2d834459b30750e35eb23348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.616353 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befd032922a64c07b5beddc631ca22a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.616264 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 9050b87026a2453688df6d403fa18d08 (DEFAULT_TABLE table=default.Table_453f1cfe1974492aa15946bdaf2b3432 [id=c03261e8e48e40358da3119419156134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.616641 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9050b87026a2453688df6d403fa18d08. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.617703 9220 consensus_peers.cc:487] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:35.618949 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30d06c910fa4142a6248e8bfd00f4b2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.621004 9497 leader_election.cc:341] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.621165 9497 leader_election.cc:302] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.621393 10630 raft_consensus.cc:482] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.621544 10484 raft_consensus.cc:2726] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.621498 10630 raft_consensus.cc:504] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.622189 10630 leader_election.cc:288] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.622768 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f9359df0ac466c912cd20fc6b94390" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.623304 9498 leader_election.cc:341] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.625012 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f9359df0ac466c912cd20fc6b94390" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.625506 9497 leader_election.cc:341] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.625697 9497 leader_election.cc:302] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.626096 10630 raft_consensus.cc:2726] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.627615 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e (DEFAULT_TABLE table=default.Table_39c68d94f854438e86cf0bdea2f25b90 [id=a643b5ca4cf44cf2b92989410972ed1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.627969 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2014e5f360ee46b895ae0b0c621a6f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.634003 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 502) took 5584 ms. Trace:
I20260928 14:50:35.634128 9813 rpcz_store.cc:276] 0928 14:50:30.049612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.077655 (+ 28043us) service_pool.cc:227] Handling call
0928 14:50:35.233718 (+5156063us) ts_tablet_manager.cc:1145] Deleting tablet ee1eb8a9faf04e3b97db9e0f8e9104f8
0928 14:50:35.233729 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.313035 (+ 79306us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.490841 (+177806us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.633985 (+143144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5146786}
I20260928 14:50:35.634770 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ee1eb8a9faf04e3b97db9e0f8e9104f8 (table default.Table_b83606ed237744d88ba3ebb26186e236 [id=653bfb0f2b28414e968985203ce7a611]) successfully deleted
I20260928 14:50:35.635188 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 508) took 5554 ms. Trace:
I20260928 14:50:35.635324 9813 rpcz_store.cc:276] 0928 14:50:30.080414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.080924 (+ 510us) service_pool.cc:227] Handling call
0928 14:50:35.635059 (+5554135us) ts_tablet_manager.cc:1145] Deleting tablet ad844de91e4040c3a8ae4873c0fa6ba4
0928 14:50:35.635069 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.635171 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5546860}
W20260928 14:50:35.635955 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ad844de91e4040c3a8ae4873c0fa6ba4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad844de91e4040c3a8ae4873c0fa6ba4 already in progress: creating tablet
I20260928 14:50:35.636336 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 506) took 5558 ms. Trace:
I20260928 14:50:35.636475 9813 rpcz_store.cc:276] 0928 14:50:30.077873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.078674 (+ 801us) service_pool.cc:227] Handling call
0928 14:50:35.636239 (+5557565us) ts_tablet_manager.cc:1145] Deleting tablet 42b9f78ecb674ae691d407615680ca56
0928 14:50:35.636249 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.636321 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5545792}
W20260928 14:50:35.637074 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 42b9f78ecb674ae691d407615680ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42b9f78ecb674ae691d407615680ca56 already in progress: creating tablet
I20260928 14:50:35.637430 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 507) took 5557 ms. Trace:
I20260928 14:50:35.637571 9813 rpcz_store.cc:276] 0928 14:50:30.080301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.111139 (+ 30838us) service_pool.cc:227] Handling call
0928 14:50:35.637338 (+5526199us) ts_tablet_manager.cc:1145] Deleting tablet 56151b288b634d6bb0bc7113afa5fbaa
0928 14:50:35.637347 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.637415 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5515551}
W20260928 14:50:35.638007 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 56151b288b634d6bb0bc7113afa5fbaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56151b288b634d6bb0bc7113afa5fbaa already in progress: creating tablet
I20260928 14:50:35.637951 8953 catalog_manager.cc:5495] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:35.638340 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 518) took 5294 ms. Trace:
I20260928 14:50:35.638402 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_f38371501cb347d3b36246f9a12070f8 [id=1692d8fdf9b240f6a1662de9319db005]). Expected version 3 got 0
I20260928 14:50:35.638406 9813 rpcz_store.cc:276] 0928 14:50:30.343532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.343601 (+ 69us) service_pool.cc:227] Handling call
0928 14:50:35.638245 (+5294644us) ts_tablet_manager.cc:1145] Deleting tablet 8a55156d0bf94b5fbd810d321e78b760
0928 14:50:35.638255 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.638325 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5289206}
W20260928 14:50:35.638769 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8a55156d0bf94b5fbd810d321e78b760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a55156d0bf94b5fbd810d321e78b760 already in progress: creating tablet
I20260928 14:50:35.638859 9814 ts_tablet_manager.cc:1918] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.638962 9814 log.cc:1196] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2f0b97883acb4adfa4091653545e894b
I20260928 14:50:35.639061 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 517) took 5306 ms. Trace:
I20260928 14:50:35.639128 9813 rpcz_store.cc:276] 0928 14:50:30.332986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.339304 (+ 6318us) service_pool.cc:227] Handling call
0928 14:50:35.638969 (+5299665us) ts_tablet_manager.cc:1145] Deleting tablet 8f79fcac805b42ba8b66949fbdfeb8f6
0928 14:50:35.638979 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.639047 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5263675}
I20260928 14:50:35.639254 9814 ts_tablet_manager.cc:1939] T 2f0b97883acb4adfa4091653545e894b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:35.639473 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f79fcac805b42ba8b66949fbdfeb8f6 already in progress: creating tablet
I20260928 14:50:35.640288 9814 tablet_replica.cc:330] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.641680 10630 raft_consensus.cc:482] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.641835 10630 raft_consensus.cc:504] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.641893 10552 consensus_queue.cc:1035] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:35.642490 10630 leader_election.cc:288] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.642983 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:35.647399 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet f92d30a7102f49828227b1428e2224da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.649873 9851 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.650004 9851 ts_tablet_manager.cc:1397] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.304s user 0.027s sys 0.098s
I20260928 14:50:35.650888 9851 raft_consensus.cc:348] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.651283 9851 raft_consensus.cc:374] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.651355 9851 raft_consensus.cc:729] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.651566 9851 consensus_queue.cc:260] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.651728 9814 raft_consensus.cc:2229] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.652104 9851 ts_tablet_manager.cc:1428] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:35.652439 9851 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.654469 9851 tablet_bootstrap.cc:654] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:35.656673 9497 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.660794 10386 consensus_queue.cc:1035] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:35.664276 9529 tablet_service.cc:1467] Processing CreateTablet for tablet a669313e134147bd87e4d65311e242a8 (DEFAULT_TABLE table=default.Table_db0f7c5aa84347d0890c3d590e0d4262 [id=76eb126c005c45809d52ab9170ccd1b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.664566 10484 raft_consensus.cc:482] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.664674 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a669313e134147bd87e4d65311e242a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.664705 10484 raft_consensus.cc:504] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.665277 10484 leader_election.cc:288] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.665642 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.666154 9497 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.666857 9814 raft_consensus.cc:2258] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.666951 9251 tablet_service.cc:1467] Processing CreateTablet for tablet a669313e134147bd87e4d65311e242a8 (DEFAULT_TABLE table=default.Table_db0f7c5aa84347d0890c3d590e0d4262 [id=76eb126c005c45809d52ab9170ccd1b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.667701 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a669313e134147bd87e4d65311e242a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.667971 10630 raft_consensus.cc:482] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.668092 10630 raft_consensus.cc:504] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.668651 10630 leader_election.cc:288] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.669623 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5f68b570e4fff8f8748e4c762ad78" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:35.667412 9814 ts_tablet_manager.cc:1905] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:35.670168 9497 leader_election.cc:341] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.670862 9543 tablet_service.cc:1467] Processing CreateTablet for tablet e20155b99e264403bd0a8b1380f2345a (DEFAULT_TABLE table=default.Table_820374b9926e4f70b9e5c5646f36238e [id=743d65433252420d8b12c2780bcc50de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.671253 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20155b99e264403bd0a8b1380f2345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.671181 9253 tablet_service.cc:1467] Processing CreateTablet for tablet e00bf3d07eeb42219d79326705b3e440 (DEFAULT_TABLE table=default.Table_1320db9993414adfa520046892472dc5 [id=3a136c87e16a4dfd96fec5366b8c37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.671486 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00bf3d07eeb42219d79326705b3e440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.671622 9535 tablet_service.cc:1467] Processing CreateTablet for tablet e00bf3d07eeb42219d79326705b3e440 (DEFAULT_TABLE table=default.Table_1320db9993414adfa520046892472dc5 [id=3a136c87e16a4dfd96fec5366b8c37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.672043 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00bf3d07eeb42219d79326705b3e440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.675804 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 257b834a8f024521affb108767a0cc18 (DEFAULT_TABLE table=default.Table_a3e2f9c2c1f04bcc9c3d6b002df28d54 [id=a064391c1b0f4e9e9e80848148f1e071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.676137 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257b834a8f024521affb108767a0cc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.681797 9261 tablet_service.cc:1467] Processing CreateTablet for tablet e20155b99e264403bd0a8b1380f2345a (DEFAULT_TABLE table=default.Table_820374b9926e4f70b9e5c5646f36238e [id=743d65433252420d8b12c2780bcc50de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.682183 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20155b99e264403bd0a8b1380f2345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.689697 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 257b834a8f024521affb108767a0cc18 (DEFAULT_TABLE table=default.Table_a3e2f9c2c1f04bcc9c3d6b002df28d54 [id=a064391c1b0f4e9e9e80848148f1e071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.690078 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257b834a8f024521affb108767a0cc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.695197 9253 tablet_service.cc:1467] Processing CreateTablet for tablet d1afe428500649e9a4e3c47736062f76 (DEFAULT_TABLE table=default.Table_6afcf7527a994c0aa7b8d8343501e175 [id=c6ce1ba083094afd8221b29cc0867b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.695562 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1afe428500649e9a4e3c47736062f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.701897 9549 tablet_service.cc:1467] Processing CreateTablet for tablet d1afe428500649e9a4e3c47736062f76 (DEFAULT_TABLE table=default.Table_6afcf7527a994c0aa7b8d8343501e175 [id=c6ce1ba083094afd8221b29cc0867b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.702237 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1afe428500649e9a4e3c47736062f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.706216 9534 tablet_service.cc:1467] Processing CreateTablet for tablet b3d6aa891123476b82eff842aefb565c (DEFAULT_TABLE table=default.Table_c9da29b5882b442392a3f79e5a737ec0 [id=a3c70fd107df41cf81d8cc27b1a821eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.706341 9263 tablet_service.cc:1467] Processing CreateTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e (DEFAULT_TABLE table=default.Table_a3c68a2575cf4150a70fedf55d507235 [id=7f12d167b0d94cab9bba1c0e9246e248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.706609 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d6aa891123476b82eff842aefb565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.706621 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc0a83bcaa0647c9bfe9b4635d391b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.707348 9542 tablet_service.cc:1467] Processing CreateTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e (DEFAULT_TABLE table=default.Table_a3c68a2575cf4150a70fedf55d507235 [id=7f12d167b0d94cab9bba1c0e9246e248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.709697 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 24f53d04326f4e639be23564563034e0 (DEFAULT_TABLE table=default.Table_7eb037389ef54e5f97821cf8134be4ab [id=64049fd699aa4619b8af272af12c59ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.709818 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc0a83bcaa0647c9bfe9b4635d391b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.709978 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f53d04326f4e639be23564563034e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.718993 9814 ts_tablet_manager.cc:1918] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.719923 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 24f53d04326f4e639be23564563034e0 (DEFAULT_TABLE table=default.Table_7eb037389ef54e5f97821cf8134be4ab [id=64049fd699aa4619b8af272af12c59ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.720259 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f53d04326f4e639be23564563034e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.722432 9815 tablet_replica.cc:330] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:35.722652 9815 raft_consensus.cc:2229] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.722932 9815 raft_consensus.cc:2258] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.723465 9815 ts_tablet_manager.cc:1905] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.724138 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8211c873b2414c94798169f73502c2 (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.724520 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8211c873b2414c94798169f73502c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.643138 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.726300 9498 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.726450 9498 leader_election.cc:302] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.726862 10630 raft_consensus.cc:2726] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.639771 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 526) took 5252 ms. Trace:
I20260928 14:50:35.727121 9813 rpcz_store.cc:276] 0928 14:50:30.387810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.387853 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:35.639684 (+5251831us) ts_tablet_manager.cc:1145] Deleting tablet 58bb9c7fc599425484fd3fc0b94f3a8c
0928 14:50:35.639694 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.639758 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5251525}
W20260928 14:50:35.727664 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 58bb9c7fc599425484fd3fc0b94f3a8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58bb9c7fc599425484fd3fc0b94f3a8c already in progress: creating tablet
W20260928 14:50:35.615947 9360 leader_election.cc:341] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:35.669201 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5f68b570e4fff8f8748e4c762ad78" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.728027 9360 leader_election.cc:302] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:35.728229 10556 raft_consensus.cc:2726] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.666152 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.728508 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 112663us
W20260928 14:50:35.728865 9498 leader_election.cc:341] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.728997 9498 leader_election.cc:302] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.729318 10630 raft_consensus.cc:2726] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.729396 9498 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.729501 9498 leader_election.cc:302] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.729876 10630 raft_consensus.cc:2726] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.730564 9360 consensus_peers.cc:487] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f81f1875265642c3a428e658dca558d0. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:35.730881 10556 consensus_queue.cc:1035] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:35.731549 9815 ts_tablet_manager.cc:1918] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.731691 9815 log.cc:1196] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/75f9359df0ac466c912cd20fc6b94390
I20260928 14:50:35.733198 9815 ts_tablet_manager.cc:1939] T 75f9359df0ac466c912cd20fc6b94390 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:35.733404 9814 log.cc:1196] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8f2898a032e1488b98c31b5e83371a71
I20260928 14:50:35.733753 9814 ts_tablet_manager.cc:1939] T 8f2898a032e1488b98c31b5e83371a71 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.737233 9814 tablet_replica.cc:330] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.737401 9814 raft_consensus.cc:2229] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.737548 9814 raft_consensus.cc:2258] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.738009 9814 ts_tablet_manager.cc:1905] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.738675 10386 consensus_queue.cc:1035] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:35.751125 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:35.757772 9848 tablet_bootstrap.cc:492] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.758127 9848 ts_tablet_manager.cc:1397] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.274s user 0.003s sys 0.001s
I20260928 14:50:35.759809 9848 raft_consensus.cc:348] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.761269 9848 raft_consensus.cc:374] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.761489 9848 raft_consensus.cc:729] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.779282 9814 ts_tablet_manager.cc:1918] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.779404 9814 log.cc:1196] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:35.779716 9814 ts_tablet_manager.cc:1939] T 8f79fcac805b42ba8b66949fbdfeb8f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.780033 9848 consensus_queue.cc:260] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.780999 10678 consensus_queue.cc:1035] T d61eb0b79a424ec5a4cbbe83cfb540df P ae832871bd1142f7af10c084115ffc12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:35.790462 9848 ts_tablet_manager.cc:1428] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260928 14:50:35.791862 10630 raft_consensus.cc:482] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.792021 10630 raft_consensus.cc:504] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.792589 10630 leader_election.cc:288] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.792992 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:35.793113 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.793540 9497 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:35.793763 9498 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.793881 9498 leader_election.cc:302] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.794094 10630 raft_consensus.cc:2726] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.796208 9848 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:35.796962 10630 raft_consensus.cc:482] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.797133 10630 raft_consensus.cc:504] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.797741 10630 leader_election.cc:288] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.798586 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:35.799186 9498 leader_election.cc:341] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.801623 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:35.802389 9497 leader_election.cc:341] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.802595 9497 leader_election.cc:302] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.803471 10630 raft_consensus.cc:2726] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:35.805763 9814 tablet_replica.cc:330] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.805996 9814 raft_consensus.cc:2229] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.806149 9814 raft_consensus.cc:2258] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.806679 9814 ts_tablet_manager.cc:1905] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.810576 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:35.722725 9253 tablet_service.cc:1467] Processing CreateTablet for tablet b3d6aa891123476b82eff842aefb565c (DEFAULT_TABLE table=default.Table_c9da29b5882b442392a3f79e5a737ec0 [id=a3c70fd107df41cf81d8cc27b1a821eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.723361 9851 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.723421 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8211c873b2414c94798169f73502c2 (DEFAULT_TABLE table=default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.815585 9251 tablet_service.cc:1467] Processing CreateTablet for tablet d8c4b670a1974c7aaa448bd6a3398b43 (DEFAULT_TABLE table=default.Table_a7f3efa369774f8b97444dbad06ee74d [id=8c294faf8938455f9a8e9b811a9817fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.815820 9851 ts_tablet_manager.cc:1397] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.163s user 0.017s sys 0.015s
I20260928 14:50:35.816146 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8211c873b2414c94798169f73502c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.816337 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c4b670a1974c7aaa448bd6a3398b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.816524 9851 raft_consensus.cc:348] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.816702 9851 raft_consensus.cc:374] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.816753 9851 raft_consensus.cc:729] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.816926 9851 consensus_queue.cc:260] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.817385 9851 ts_tablet_manager.cc:1428] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:35.817641 9851 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.825845 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:35.836440 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 525) took 5449 ms. Trace:
I20260928 14:50:35.840713 9535 tablet_service.cc:1467] Processing CreateTablet for tablet d8c4b670a1974c7aaa448bd6a3398b43 (DEFAULT_TABLE table=default.Table_a7f3efa369774f8b97444dbad06ee74d [id=8c294faf8938455f9a8e9b811a9817fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.841301 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c4b670a1974c7aaa448bd6a3398b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.841619 9813 rpcz_store.cc:276] 0928 14:50:30.387459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.388844 (+ 1385us) service_pool.cc:227] Handling call
0928 14:50:35.836289 (+5447445us) ts_tablet_manager.cc:1145] Deleting tablet 76ad7685ece44665896f687697bddccf
0928 14:50:35.836304 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.836415 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5447269}
W20260928 14:50:35.842113 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 76ad7685ece44665896f687697bddccf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76ad7685ece44665896f687697bddccf already in progress: creating tablet
I20260928 14:50:35.844710 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 527) took 5456 ms. Trace:
I20260928 14:50:35.844796 9813 rpcz_store.cc:276] 0928 14:50:30.388393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.388436 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:35.844587 (+5456151us) ts_tablet_manager.cc:1145] Deleting tablet d806161b858145e1a4fa946587ae1529
0928 14:50:35.844599 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.844691 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5447247}
I20260928 14:50:35.845104 9542 tablet_service.cc:1467] Processing CreateTablet for tablet f5855715375140f5b54b0d53ed1ea915 (DEFAULT_TABLE table=default.Table_690bd7f5a5a945d787c5bfaf7bad1107 [id=4b1073e9ca5943f6a5081c236bfdcc3f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:35.845237 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d806161b858145e1a4fa946587ae1529 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d806161b858145e1a4fa946587ae1529 already in progress: creating tablet
I20260928 14:50:35.845639 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5855715375140f5b54b0d53ed1ea915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.846685 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 058da1b82b214b168ce2218ebada623d (DEFAULT_TABLE table=default.Table_d6ee0411db8d422bb5a9b900321e6e1d [id=880ad2b6273d4eb291ecc052d5a1f1c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.847075 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058da1b82b214b168ce2218ebada623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.847329 9848 tablet_bootstrap.cc:654] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.848934 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d (DEFAULT_TABLE table=default.Table_6e246f841a2543d69ee059defc37a2d6 [id=6913c15c907f4ca1bbc9259808db6700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.849339 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1bbf59243f4cf6bfc0f770cd01934d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.849879 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5410b1f2384152a4ab80fc44c4cd96 (DEFAULT_TABLE table=default.Table_0b0c5d342f0141f2be1adba65d11798f [id=e49d8c7ff95848c3af1693a14653aef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.850296 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5410b1f2384152a4ab80fc44c4cd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.854848 9813 tablet_replica.cc:330] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:35.855824 9534 tablet_service.cc:1467] Processing CreateTablet for tablet cb1d541610014e408bc0bb7bcb7954bf (DEFAULT_TABLE table=default.Table_4d3442fc50ac47deafcaab819720545b [id=42f0e9db2cce4d23a32c5ebf4a9b55cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.856228 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1d541610014e408bc0bb7bcb7954bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.861856 9813 raft_consensus.cc:2229] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.862519 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 6be035105eab47fbb3c9b7fa1ae74847 (DEFAULT_TABLE table=default.Table_b309deffacb94196b6b641147fa20814 [id=2b1156c5b0a5426e8a165c1ecc04ed59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.862877 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be035105eab47fbb3c9b7fa1ae74847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.828465 9851 tablet_bootstrap.cc:654] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.832248 10735 raft_consensus.cc:482] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.864814 10735 raft_consensus.cc:504] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.864913 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5410b1f2384152a4ab80fc44c4cd96 (DEFAULT_TABLE table=default.Table_0b0c5d342f0141f2be1adba65d11798f [id=e49d8c7ff95848c3af1693a14653aef9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.865453 10735 leader_election.cc:288] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.836123 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d6aa891123476b82eff842aefb565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.837082 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:35.866729 9219 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 0e53b8b73b37464687d343493d186660
I20260928 14:50:35.866719 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 058da1b82b214b168ce2218ebada623d (DEFAULT_TABLE table=default.Table_d6ee0411db8d422bb5a9b900321e6e1d [id=880ad2b6273d4eb291ecc052d5a1f1c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.867241 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5410b1f2384152a4ab80fc44c4cd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.867952 9264 tablet_service.cc:1467] Processing CreateTablet for tablet f5855715375140f5b54b0d53ed1ea915 (DEFAULT_TABLE table=default.Table_690bd7f5a5a945d787c5bfaf7bad1107 [id=4b1073e9ca5943f6a5081c236bfdcc3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.869313 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058da1b82b214b168ce2218ebada623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.869920 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d (DEFAULT_TABLE table=default.Table_6e246f841a2543d69ee059defc37a2d6 [id=6913c15c907f4ca1bbc9259808db6700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.870769 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5855715375140f5b54b0d53ed1ea915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.871361 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 6be035105eab47fbb3c9b7fa1ae74847 (DEFAULT_TABLE table=default.Table_b309deffacb94196b6b641147fa20814 [id=2b1156c5b0a5426e8a165c1ecc04ed59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.871709 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be035105eab47fbb3c9b7fa1ae74847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.874384 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 57e56077833e41dbacf54c1757ba6a38 (table default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]) successfully deleted
I20260928 14:50:35.874686 10630 raft_consensus.cc:482] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.874773 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c85735981779438197f2c0f489681b96 (table default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]) successfully deleted
I20260928 14:50:35.874812 10630 raft_consensus.cc:504] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.875248 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2f0b97883acb4adfa4091653545e894b (table default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]) successfully deleted
I20260928 14:50:35.875365 10630 leader_election.cc:288] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:35.875584 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f already in progress: creating tablet
I20260928 14:50:35.876358 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8f2898a032e1488b98c31b5e83371a71 (table default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]) successfully deleted
I20260928 14:50:35.876699 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46fe647c6d80431bbb76899126d01c3b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:35.876770 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (table default.Table_4f27adee7f5546bdacf1cf473d252a5b [id=290e5d7ef835430987ca8992b8142bf6]) successfully deleted
W20260928 14:50:35.877050 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 43c887b7c4e8434a9342d49145fde3ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43c887b7c4e8434a9342d49145fde3ae already in progress: creating tablet
W20260928 14:50:35.877432 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 52993ae8b63d4fbaa8cf38720af3dea5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52993ae8b63d4fbaa8cf38720af3dea5 already in progress: creating tablet
W20260928 14:50:35.878119 9497 leader_election.cc:341] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.869414 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e53b8b73b37464687d343493d186660" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.881227 9813 raft_consensus.cc:2258] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.877245 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46fe647c6d80431bbb76899126d01c3b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:35.881804 9813 ts_tablet_manager.cc:1905] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:35.881788 9498 leader_election.cc:341] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.881886 9498 leader_election.cc:302] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.882304 10630 raft_consensus.cc:2726] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.889779 9220 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:35.889891 9220 leader_election.cc:302] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:35.890079 10735 raft_consensus.cc:2726] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:35.894881 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3348f5a55ef34af88611077aab447f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3348f5a55ef34af88611077aab447f83 already in progress: creating tablet
I20260928 14:50:35.894889 9848 tablet_bootstrap.cc:492] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.895058 9848 ts_tablet_manager.cc:1397] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.001s
I20260928 14:50:35.895738 9848 raft_consensus.cc:348] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.896134 9848 raft_consensus.cc:374] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.896241 9848 raft_consensus.cc:729] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.896500 9848 consensus_queue.cc:260] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.897116 9848 ts_tablet_manager.cc:1428] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.897372 9848 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:35.897379 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 01c1e945f1c54281856bfabe08fba42e (table default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]) successfully deleted
I20260928 14:50:35.897775 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6feba01e78004e50a71c610c9a63aeb5 (table default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]) successfully deleted
I20260928 14:50:35.898221 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7d267fa0a698437986feb52cd9c15cc1 (table default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]) successfully deleted
W20260928 14:50:35.898541 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 43c887b7c4e8434a9342d49145fde3ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43c887b7c4e8434a9342d49145fde3ae already in progress: creating tablet
W20260928 14:50:35.898910 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3348f5a55ef34af88611077aab447f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3348f5a55ef34af88611077aab447f83 already in progress: creating tablet
W20260928 14:50:35.899188 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 52993ae8b63d4fbaa8cf38720af3dea5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52993ae8b63d4fbaa8cf38720af3dea5 already in progress: creating tablet
I20260928 14:50:35.899545 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c6b4b4c775fe4eacaaa557d4daa2a600 (table default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]) successfully deleted
W20260928 14:50:35.899748 9360 consensus_peers.cc:487] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f81f1875265642c3a428e658dca558d0. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:35.900272 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8520b28899bc42b08e239502adb8fece (table default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]) successfully deleted
I20260928 14:50:35.902063 9848 tablet_bootstrap.cc:654] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.902896 9855 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.903067 9855 ts_tablet_manager.cc:1397] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.331s user 0.031s sys 0.135s
I20260928 14:50:35.903503 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1bbf59243f4cf6bfc0f770cd01934d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.903952 9855 raft_consensus.cc:348] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.904141 9855 raft_consensus.cc:374] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.904202 9855 raft_consensus.cc:729] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.904484 9813 ts_tablet_manager.cc:1918] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.906141 9855 consensus_queue.cc:260] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.906443 9813 log.cc:1196] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/311e4286b2a943ee924ac1c25dc9ca46
I20260928 14:50:35.906806 9813 ts_tablet_manager.cc:1939] T 311e4286b2a943ee924ac1c25dc9ca46 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:35.906798 9855 ts_tablet_manager.cc:1428] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:35.907318 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 531) took 5199 ms. Trace:
I20260928 14:50:35.907464 9813 rpcz_store.cc:276] 0928 14:50:30.707630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.707680 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:35.854802 (+5147122us) ts_tablet_manager.cc:1145] Deleting tablet 311e4286b2a943ee924ac1c25dc9ca46
0928 14:50:35.854814 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.884861 (+ 30047us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.904395 (+ 19534us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:35.907300 (+ 2905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5128936}
I20260928 14:50:35.908143 9848 tablet_bootstrap.cc:492] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:35.908649 9848 ts_tablet_manager.cc:1397] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.001s
I20260928 14:50:35.909855 9848 raft_consensus.cc:348] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.910099 9848 raft_consensus.cc:374] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.910199 9848 raft_consensus.cc:729] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.910470 9848 consensus_queue.cc:260] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:35.911080 9848 ts_tablet_manager.cc:1428] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:35.911554 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 311e4286b2a943ee924ac1c25dc9ca46 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]) successfully deleted
I20260928 14:50:35.913790 9855 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.914106 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 75f9359df0ac466c912cd20fc6b94390 (table default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]) successfully deleted
I20260928 14:50:35.914479 9848 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:35.916116 9855 tablet_bootstrap.cc:654] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:35.917284 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5e5ceda898274189b81b9172cdbc7bb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5ceda898274189b81b9172cdbc7bb7 already in progress: creating tablet
I20260928 14:50:35.917558 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 533) took 5121 ms. Trace:
W20260928 14:50:35.917678 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f92d30a7102f49828227b1428e2224da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92d30a7102f49828227b1428e2224da already in progress: creating tablet
I20260928 14:50:35.917941 9254 tablet_service.cc:1467] Processing CreateTablet for tablet cb1d541610014e408bc0bb7bcb7954bf (DEFAULT_TABLE table=default.Table_4d3442fc50ac47deafcaab819720545b [id=42f0e9db2cce4d23a32c5ebf4a9b55cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.917691 9813 rpcz_store.cc:276] 0928 14:50:30.796058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.797057 (+ 999us) service_pool.cc:227] Handling call
0928 14:50:35.911826 (+5114769us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5afbdeda4ddfb82124031135e6cb
0928 14:50:35.915805 (+ 3979us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.917515 (+ 1710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5095450}
W20260928 14:50:35.918449 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9f2c5afbdeda4ddfb82124031135e6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5afbdeda4ddfb82124031135e6cb already in progress: creating tablet
I20260928 14:50:35.919387 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb1d541610014e408bc0bb7bcb7954bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.920475 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 534) took 5085 ms. Trace:
I20260928 14:50:35.920572 9813 rpcz_store.cc:276] 0928 14:50:30.833357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.833410 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:35.918247 (+5084837us) ts_tablet_manager.cc:1145] Deleting tablet bd9cedadc7184013a37857206bec2ff0
0928 14:50:35.918270 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.918350 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5078128}
I20260928 14:50:35.921476 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 535) took 5064 ms. Trace:
W20260928 14:50:35.921625 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bd9cedadc7184013a37857206bec2ff0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd9cedadc7184013a37857206bec2ff0 already in progress: creating tablet
I20260928 14:50:35.921221 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 471f7e55d0934199a77082b3296e8743 (DEFAULT_TABLE table=default.Table_008fa4a217d843c893276437e5867b4e [id=08fa649e75c04c25a8ecc480ed9da513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.921690 9813 rpcz_store.cc:276] 0928 14:50:30.857477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.857551 (+ 74us) service_pool.cc:227] Handling call
0928 14:50:35.921378 (+5063827us) ts_tablet_manager.cc:1145] Deleting tablet 299ed0acd7cf46d3b78f4f4cea31858f
0928 14:50:35.921388 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.921462 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5063636}
I20260928 14:50:35.921995 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 536) took 5040 ms. Trace:
I20260928 14:50:35.922070 9813 rpcz_store.cc:276] 0928 14:50:30.881823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.881935 (+ 112us) service_pool.cc:227] Handling call
0928 14:50:35.921903 (+5039968us) ts_tablet_manager.cc:1145] Deleting tablet c163d657ec4f40598d7f4f3879e6d817
0928 14:50:35.921912 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.921980 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5039011}
W20260928 14:50:35.922118 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 299ed0acd7cf46d3b78f4f4cea31858f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 299ed0acd7cf46d3b78f4f4cea31858f already in progress: creating tablet
I20260928 14:50:35.922358 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 537) took 5040 ms. Trace:
I20260928 14:50:35.922433 9813 rpcz_store.cc:276] 0928 14:50:30.882162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.882301 (+ 139us) service_pool.cc:227] Handling call
0928 14:50:35.922270 (+5039969us) ts_tablet_manager.cc:1145] Deleting tablet a7be6013a04c4222ab34a19e77e48a37
0928 14:50:35.922279 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.922343 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5018008}
I20260928 14:50:35.922717 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 538) took 4966 ms. Trace:
I20260928 14:50:35.922791 9813 rpcz_store.cc:276] 0928 14:50:30.956113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:30.956177 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:35.922631 (+4966454us) ts_tablet_manager.cc:1145] Deleting tablet e760d7e556a54fda9dc91300b9968c68
0928 14:50:35.922639 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.922703 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4966248}
W20260928 14:50:35.922848 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c163d657ec4f40598d7f4f3879e6d817 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c163d657ec4f40598d7f4f3879e6d817 already in progress: creating tablet
I20260928 14:50:35.923054 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 548) took 4716 ms. Trace:
W20260928 14:50:35.923079 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a7be6013a04c4222ab34a19e77e48a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7be6013a04c4222ab34a19e77e48a37 already in progress: creating tablet
I20260928 14:50:35.923117 9813 rpcz_store.cc:276] 0928 14:50:31.206857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.206907 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:35.922970 (+4716063us) ts_tablet_manager.cc:1145] Deleting tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f
0928 14:50:35.922978 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.923040 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4705958}
I20260928 14:50:35.923475 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 546) took 4722 ms. Trace:
W20260928 14:50:35.923568 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e760d7e556a54fda9dc91300b9968c68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e760d7e556a54fda9dc91300b9968c68 already in progress: creating tablet
I20260928 14:50:35.923547 9813 rpcz_store.cc:276] 0928 14:50:31.201498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.207102 (+ 5604us) service_pool.cc:227] Handling call
0928 14:50:35.923380 (+4716278us) ts_tablet_manager.cc:1145] Deleting tablet cbb232c73f014351b796a86180ffb660
0928 14:50:35.923389 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.923459 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4705181}
I20260928 14:50:35.923794 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 547) took 4722 ms. Trace:
W20260928 14:50:35.923796 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f already in progress: creating tablet
I20260928 14:50:35.923853 9813 rpcz_store.cc:276] 0928 14:50:31.201685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.207337 (+ 5652us) service_pool.cc:227] Handling call
0928 14:50:35.923712 (+4716375us) ts_tablet_manager.cc:1145] Deleting tablet 010e4f56e85a44d6a1f7524217d3cc58
0928 14:50:35.923720 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.923781 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4705411}
I20260928 14:50:35.924041 9813 tablet_replica.cc:330] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:35.924196 9813 raft_consensus.cc:2229] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.924330 9813 raft_consensus.cc:2258] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.924363 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 471f7e55d0934199a77082b3296e8743. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:35.929896 8916 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu pid 8994: Timed out: CheckLeaks RPC to 127.8.181.61:41417 timed out after 1.000s (SENT)
I20260928 14:50:35.930102 8916 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu with pid 8994
I20260928 14:50:35.930222 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 471f7e55d0934199a77082b3296e8743 (DEFAULT_TABLE table=default.Table_008fa4a217d843c893276437e5867b4e [id=08fa649e75c04c25a8ecc480ed9da513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.930534 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 471f7e55d0934199a77082b3296e8743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.930779 9813 ts_tablet_manager.cc:1905] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.934365 9855 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:35.934458 9855 ts_tablet_manager.cc:1397] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20260928 14:50:35.935111 9855 raft_consensus.cc:348] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.935292 9855 raft_consensus.cc:374] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.935333 9855 raft_consensus.cc:729] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.935490 9855 consensus_queue.cc:260] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:35.935932 9855 ts_tablet_manager.cc:1428] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:35.936403 9851 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.936509 9851 ts_tablet_manager.cc:1397] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.119s user 0.005s sys 0.006s
I20260928 14:50:35.937443 9851 raft_consensus.cc:348] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.937639 9851 raft_consensus.cc:374] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.937687 9851 raft_consensus.cc:729] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.937865 9851 consensus_queue.cc:260] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.938364 9851 ts_tablet_manager.cc:1428] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:35.937981 9814 ts_tablet_manager.cc:1918] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.940927 9814 log.cc:1196] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:35.941206 9814 ts_tablet_manager.cc:1939] T 8296732efcb349ab9cc87e3ff1e11fd0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.941615 9851 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.942636 9855 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:35.943823 9855 tablet_bootstrap.cc:654] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.943969 9814 tablet_replica.cc:330] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.944118 9814 raft_consensus.cc:2229] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.944239 9814 raft_consensus.cc:2258] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.944649 9814 ts_tablet_manager.cc:1905] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.948030 9851 tablet_bootstrap.cc:654] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.952841 10735 raft_consensus.cc:482] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:35.952950 10735 raft_consensus.cc:504] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.953428 10735 leader_election.cc:288] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.953974 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:35.954177 9567 raft_consensus.cc:2454] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:35.954803 9219 leader_election.cc:302] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:35.955075 9814 ts_tablet_manager.cc:1918] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.955160 9814 log.cc:1196] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:35.955421 9814 ts_tablet_manager.cc:1939] T dc8400fdb8d948b084733011b16df1b3 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.957674 10735 raft_consensus.cc:2781] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:35.957777 10735 raft_consensus.cc:482] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:35.957837 10735 raft_consensus.cc:3037] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.958141 9814 tablet_replica.cc:330] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:35.958316 9814 raft_consensus.cc:2229] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:35.958432 9814 raft_consensus.cc:2258] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:35.958853 9814 ts_tablet_manager.cc:1905] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:35.958907 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 86242ca6e920486781f3aec9125f70da (DEFAULT_TABLE table=default.Table_ed6b85c8224a4ba08354e6e04b50cb31 [id=174391519b74485ab8de27dd49946ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.959246 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86242ca6e920486781f3aec9125f70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.960057 10735 raft_consensus.cc:504] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.960860 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:35.961011 9567 raft_consensus.cc:3037] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:35.963342 9567 raft_consensus.cc:2454] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:35.963681 9219 leader_election.cc:302] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:35.963917 10386 raft_consensus.cc:2781] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:35.964011 9814 ts_tablet_manager.cc:1918] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:35.964093 9814 log.cc:1196] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/852b70b1f7444ad2ab92d66d580a0db7
I20260928 14:50:35.964016 10386 raft_consensus.cc:686] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:35.964349 9814 ts_tablet_manager.cc:1939] T 852b70b1f7444ad2ab92d66d580a0db7 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:35.964483 10386 consensus_queue.cc:237] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.965109 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 (DEFAULT_TABLE table=default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812 [id=269700602cc347d9b4982afb9d4848b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.965332 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 (DEFAULT_TABLE table=default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812 [id=269700602cc347d9b4982afb9d4848b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.965431 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0fce7d3444063a6dcfec9538f4f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.965662 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d0fce7d3444063a6dcfec9538f4f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.966318 10735 leader_election.cc:288] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:35.971544 9851 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:35.971701 9851 ts_tablet_manager.cc:1397] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20260928 14:50:35.972100 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 86242ca6e920486781f3aec9125f70da (DEFAULT_TABLE table=default.Table_ed6b85c8224a4ba08354e6e04b50cb31 [id=174391519b74485ab8de27dd49946ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.972352 9851 raft_consensus.cc:348] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.972555 9851 raft_consensus.cc:374] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:35.972615 9851 raft_consensus.cc:729] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:35.972853 9851 consensus_queue.cc:260] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:35.973335 9851 ts_tablet_manager.cc:1428] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:35.973564 9851 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:35.973834 9254 tablet_service.cc:1467] Processing CreateTablet for tablet e0b9be5c4dd84957ac2729b5d7d7fe95 (DEFAULT_TABLE table=default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be [id=df177ac1ce8244c3838eb99260c039c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.973905 9537 tablet_service.cc:1467] Processing CreateTablet for tablet e0b9be5c4dd84957ac2729b5d7d7fe95 (DEFAULT_TABLE table=default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be [id=df177ac1ce8244c3838eb99260c039c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.974421 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0b9be5c4dd84957ac2729b5d7d7fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.980520 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 657661b2935b4c1481d8d064427cefbb (DEFAULT_TABLE table=default.Table_2120286b0fdb44de96415255839b3445 [id=e8e107f5cc4c4facb52cfaaffba811db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.981624 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 (DEFAULT_TABLE table=default.Table_c0576b54ef0249b889f69aaa0ddc68bd [id=1391dd242cb64d5d9da9a6b8f6a02096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.982455 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 (DEFAULT_TABLE table=default.Table_c0576b54ef0249b889f69aaa0ddc68bd [id=1391dd242cb64d5d9da9a6b8f6a02096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:35.982751 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6a176464e84c94bb5cc4ba6016df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.972493 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86242ca6e920486781f3aec9125f70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.989861 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6a176464e84c94bb5cc4ba6016df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.991463 9851 tablet_bootstrap.cc:654] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:35.992352 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0b9be5c4dd84957ac2729b5d7d7fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:35.993911 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657661b2935b4c1481d8d064427cefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.002120 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.002470 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:36.006156 9851 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.006273 9851 ts_tablet_manager.cc:1397] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260928 14:50:36.006531 9813 ts_tablet_manager.cc:1918] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.006637 9813 log.cc:1196] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/bad2124268994f04ae7153ea5aaeeab0
I20260928 14:50:36.006894 9813 ts_tablet_manager.cc:1939] T bad2124268994f04ae7153ea5aaeeab0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.006939 9851 raft_consensus.cc:348] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.007149 9851 raft_consensus.cc:374] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.007161 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 549) took 4790 ms. Trace:
I20260928 14:50:36.007203 9851 raft_consensus.cc:729] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.007233 9813 rpcz_store.cc:276] 0928 14:50:31.216235 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.216687 (+ 452us) service_pool.cc:227] Handling call
0928 14:50:35.924009 (+4707322us) ts_tablet_manager.cc:1145] Deleting tablet bad2124268994f04ae7153ea5aaeeab0
0928 14:50:35.924017 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:35.933761 (+ 9744us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.006444 (+ 72683us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.007146 (+ 702us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4703492}
I20260928 14:50:36.007375 9851 consensus_queue.cc:260] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.007624 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 550) took 4723 ms. Trace:
I20260928 14:50:36.007694 9813 rpcz_store.cc:276] 0928 14:50:31.284431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.284506 (+ 75us) service_pool.cc:227] Handling call
0928 14:50:36.007493 (+4722987us) ts_tablet_manager.cc:1145] Deleting tablet 846a96509f32416087ee4667458c367e
0928 14:50:36.007503 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.007609 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4722766}
I20260928 14:50:36.007877 9851 ts_tablet_manager.cc:1428] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:36.007921 9813 tablet_replica.cc:330] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:36.008105 9851 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.008088 9813 raft_consensus.cc:2229] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.008217 9813 raft_consensus.cc:2258] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.008688 9813 ts_tablet_manager.cc:1905] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.009487 9851 tablet_bootstrap.cc:654] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.011147 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cbb232c73f014351b796a86180ffb660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbb232c73f014351b796a86180ffb660 already in progress: creating tablet
W20260928 14:50:36.011453 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 010e4f56e85a44d6a1f7524217d3cc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 010e4f56e85a44d6a1f7524217d3cc58 already in progress: creating tablet
I20260928 14:50:36.011617 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet bad2124268994f04ae7153ea5aaeeab0 (table default.Table_d8b71be52644495e87e90d56bfd7de1e [id=d1a057df3ad8440dbe0421e27ca68473]) successfully deleted
W20260928 14:50:36.011835 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 846a96509f32416087ee4667458c367e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846a96509f32416087ee4667458c367e already in progress: creating tablet
W20260928 14:50:36.012439 9220 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:36.012742 9220 leader_election.cc:341] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.014816 9851 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.014955 9851 ts_tablet_manager.cc:1397] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260928 14:50:36.015533 9851 raft_consensus.cc:348] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.016003 9851 raft_consensus.cc:374] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.016070 9851 raft_consensus.cc:729] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.016249 9851 consensus_queue.cc:260] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.016746 9851 ts_tablet_manager.cc:1428] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:36.016990 9851 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.018342 9851 tablet_bootstrap.cc:654] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.019315 9813 ts_tablet_manager.cc:1918] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.019451 9813 log.cc:1196] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/999aa56f1683464d9612a2ddbfbebbda
I20260928 14:50:36.019732 9813 ts_tablet_manager.cc:1939] T 999aa56f1683464d9612a2ddbfbebbda P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.020005 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 551) took 4636 ms. Trace:
I20260928 14:50:36.020124 9813 rpcz_store.cc:276] 0928 14:50:31.383270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.383511 (+ 241us) service_pool.cc:227] Handling call
0928 14:50:36.007885 (+4624374us) ts_tablet_manager.cc:1145] Deleting tablet 999aa56f1683464d9612a2ddbfbebbda
0928 14:50:36.007895 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.016207 (+ 8312us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.019246 (+ 3039us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.019993 (+ 747us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4613946}
I20260928 14:50:36.020546 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 564) took 4362 ms. Trace:
I20260928 14:50:36.020666 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 999aa56f1683464d9612a2ddbfbebbda (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:36.020654 9813 rpcz_store.cc:276] 0928 14:50:31.657971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.658059 (+ 88us) service_pool.cc:227] Handling call
0928 14:50:36.020450 (+4362391us) ts_tablet_manager.cc:1145] Deleting tablet 69239e1cc64f40e59f14c3716437de54
0928 14:50:36.020460 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.020533 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4360400}
W20260928 14:50:36.020977 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 69239e1cc64f40e59f14c3716437de54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69239e1cc64f40e59f14c3716437de54 already in progress: creating tablet
I20260928 14:50:36.021039 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 563) took 4378 ms. Trace:
I20260928 14:50:36.021114 9813 rpcz_store.cc:276] 0928 14:50:31.643027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.643142 (+ 115us) service_pool.cc:227] Handling call
0928 14:50:36.020952 (+4377810us) ts_tablet_manager.cc:1145] Deleting tablet 4ea3bb5f742c46d796696c0131b97e68
0928 14:50:36.020961 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.021026 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4320076}
W20260928 14:50:36.021612 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4ea3bb5f742c46d796696c0131b97e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ea3bb5f742c46d796696c0131b97e68 already in progress: creating tablet
I20260928 14:50:36.021915 9813 tablet_replica.cc:330] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:36.022115 9813 raft_consensus.cc:2229] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.022331 9813 raft_consensus.cc:2258] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.022799 9813 ts_tablet_manager.cc:1905] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.023433 9251 tablet_service.cc:1467] Processing CreateTablet for tablet befd032922a64c07b5beddc631ca22a3 (DEFAULT_TABLE table=default.Table_46ac9accd4964534a60ae4d76d6a1f54 [id=364dfc1e2d834459b30750e35eb23348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.023808 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befd032922a64c07b5beddc631ca22a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.026643 9851 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.026757 9851 ts_tablet_manager.cc:1397] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260928 14:50:36.027401 9851 raft_consensus.cc:348] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.027597 9851 raft_consensus.cc:374] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.027645 9851 raft_consensus.cc:729] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.027799 9851 consensus_queue.cc:260] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.028223 9851 ts_tablet_manager.cc:1428] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.028442 9851 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.029722 9851 tablet_bootstrap.cc:654] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.032889 9851 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.033042 9851 ts_tablet_manager.cc:1397] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260928 14:50:36.033754 9851 raft_consensus.cc:348] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.033929 9851 raft_consensus.cc:374] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.033982 9851 raft_consensus.cc:729] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.034147 9851 consensus_queue.cc:260] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.034608 9851 ts_tablet_manager.cc:1428] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.034828 9851 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.036100 9851 tablet_bootstrap.cc:654] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.036809 9534 tablet_service.cc:1467] Processing CreateTablet for tablet befd032922a64c07b5beddc631ca22a3 (DEFAULT_TABLE table=default.Table_46ac9accd4964534a60ae4d76d6a1f54 [id=364dfc1e2d834459b30750e35eb23348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.037220 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befd032922a64c07b5beddc631ca22a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.044664 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e (DEFAULT_TABLE table=default.Table_39c68d94f854438e86cf0bdea2f25b90 [id=a643b5ca4cf44cf2b92989410972ed1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.045028 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2014e5f360ee46b895ae0b0c621a6f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.045421 9851 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.045550 9851 ts_tablet_manager.cc:1397] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260928 14:50:36.046195 9851 raft_consensus.cc:348] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.046372 9851 raft_consensus.cc:374] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.046425 9851 raft_consensus.cc:729] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.046602 9851 consensus_queue.cc:260] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.047036 9851 ts_tablet_manager.cc:1428] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.047263 9851 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.048790 9851 tablet_bootstrap.cc:654] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.052138 10760 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:36.060961 9851 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.061079 9851 ts_tablet_manager.cc:1397] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.002s
I20260928 14:50:36.061702 9851 raft_consensus.cc:348] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.061798 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.061892 9851 raft_consensus.cc:374] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.062027 9814 tablet_replica.cc:330] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.062193 9814 raft_consensus.cc:2229] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.062319 9814 raft_consensus.cc:2258] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.062585 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.062945 9814 ts_tablet_manager.cc:1905] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.068272 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:36.068476 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:36.068643 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:36.068815 9814 ts_tablet_manager.cc:1918] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.068923 9814 log.cc:1196] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:36.061936 9851 raft_consensus.cc:729] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.069348 9851 consensus_queue.cc:260] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.069866 9851 ts_tablet_manager.cc:1428] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:36.070107 9851 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.070796 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_06137559c56b4a89bf8f49323ac5b93a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.071429 9814 ts_tablet_manager.cc:1939] T 4bea51859e0c4bc984288f94c2fcea2e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:36.071463 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06137559c56b4a89bf8f49323ac5b93a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.072849 9851 tablet_bootstrap.cc:654] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.072956 9814 tablet_replica.cc:330] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.073583 9814 raft_consensus.cc:2229] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.073710 9814 raft_consensus.cc:2258] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.073680 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e3472c2548ac494e9aa3a10e042f6f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.074189 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3472c2548ac494e9aa3a10e042f6f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.074530 10735 raft_consensus.cc:482] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.074630 10735 raft_consensus.cc:504] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.076292 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_13fba19288b84741b37b6b24d12ceb0c" } modify_external_catalogs: true
I20260928 14:50:36.076509 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_13fba19288b84741b37b6b24d12ceb0c" } modify_external_catalogs: true
I20260928 14:50:36.076894 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 657661b2935b4c1481d8d064427cefbb (DEFAULT_TABLE table=default.Table_2120286b0fdb44de96415255839b3445 [id=e8e107f5cc4c4facb52cfaaffba811db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.077020 9814 ts_tablet_manager.cc:1905] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.077256 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657661b2935b4c1481d8d064427cefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.077704 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_27c8c6bf92104baba58d5f721c298c16" } modify_external_catalogs: true
I20260928 14:50:36.077885 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_27c8c6bf92104baba58d5f721c298c16" } modify_external_catalogs: true
I20260928 14:50:36.078517 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_78ef16fcfe2e4061882c68341df55233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.078975 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78ef16fcfe2e4061882c68341df55233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.079166 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c473ccd6dd9c45258a6e10eed66828df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.079620 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c473ccd6dd9c45258a6e10eed66828df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.080720 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7d735ceca02945adafa0d6e0606ff717" } new_table_name: "default.Table_03d36d3a614f49d0a4f8f39f923e2677" modify_external_catalogs: true
I20260928 14:50:36.082024 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f46823ee6d474a4f8e5b00016a0c0bbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.082504 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f46823ee6d474a4f8e5b00016a0c0bbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.082675 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_04a048509ef24182a5ba414faa2066d8" } new_table_name: "default.Table_d97a34797d9045f6ad58c57b453ed7a0" modify_external_catalogs: true
I20260928 14:50:36.084251 10735 leader_election.cc:288] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:36.086508 9219 leader_election.cc:341] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:36.087729 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aab84a72d35448c8a96afd735fa0b4fe" } modify_external_catalogs: true
I20260928 14:50:36.087908 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aab84a72d35448c8a96afd735fa0b4fe" } modify_external_catalogs: true
I20260928 14:50:36.092018 10484 raft_consensus.cc:482] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.092134 10484 raft_consensus.cc:504] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.092701 10484 leader_election.cc:288] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.096805 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9cb3cc5b42524a4399d0bcf21c851fd8
I20260928 14:50:36.093150 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.103170 9497 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.103260 10735 raft_consensus.cc:482] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.103379 10735 raft_consensus.cc:504] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.103868 10735 leader_election.cc:288] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:36.105094 9219 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:36.109318 10735 raft_consensus.cc:482] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.109424 10735 raft_consensus.cc:504] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.109694 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e (DEFAULT_TABLE table=default.Table_39c68d94f854438e86cf0bdea2f25b90 [id=a643b5ca4cf44cf2b92989410972ed1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.110062 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2014e5f360ee46b895ae0b0c621a6f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.110496 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8296732efcb349ab9cc87e3ff1e11fd0 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
W20260928 14:50:36.110737 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5e5ceda898274189b81b9172cdbc7bb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5ceda898274189b81b9172cdbc7bb7 already in progress: creating tablet
W20260928 14:50:36.110921 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f92d30a7102f49828227b1428e2224da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92d30a7102f49828227b1428e2224da already in progress: creating tablet
I20260928 14:50:36.111107 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet dc8400fdb8d948b084733011b16df1b3 (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:36.111522 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 852b70b1f7444ad2ab92d66d580a0db7 (table default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]) successfully deleted
I20260928 14:50:36.112037 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4bea51859e0c4bc984288f94c2fcea2e (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
I20260928 14:50:36.028096 9848 tablet_bootstrap.cc:654] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.113054 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.113246 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.113428 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.051656 10759 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:36.114140 9815 tablet_replica.cc:330] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.072453 10556 raft_consensus.cc:482] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.114319 9815 raft_consensus.cc:2229] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.114305 10556 raft_consensus.cc:504] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.114467 9815 raft_consensus.cc:2258] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.114825 10556 leader_election.cc:288] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.087101 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89035a3d41a4af78a8e7afbdb89c7e0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.114912 9815 ts_tablet_manager.cc:1905] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.094321 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.098475 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.104777 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca7fa45e25b0455e92412b844cd78cdc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.115903 9498 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.115995 9498 leader_election.cc:302] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:36.116516 9360 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2f0b97883acb4adfa4091653545e894b
I20260928 14:50:36.118407 10484 raft_consensus.cc:2726] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.120723 9815 ts_tablet_manager.cc:1918] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.120965 9815 log.cc:1196] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/56151b288b634d6bb0bc7113afa5fbaa
I20260928 14:50:36.121294 9815 ts_tablet_manager.cc:1939] T 56151b288b634d6bb0bc7113afa5fbaa P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.122080 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.122720 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 56151b288b634d6bb0bc7113afa5fbaa (table default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]) successfully deleted
I20260928 14:50:36.123329 9815 tablet_replica.cc:330] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.123535 9815 raft_consensus.cc:2229] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.123710 9815 raft_consensus.cc:2258] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.124161 9815 ts_tablet_manager.cc:1905] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.131682 9851 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.131805 9851 ts_tablet_manager.cc:1397] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.002s
W20260928 14:50:36.131812 9220 leader_election.cc:341] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.132109 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:36.132295 9567 raft_consensus.cc:2454] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:36.132738 9219 leader_election.cc:302] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:36.132969 10735 leader_election.cc:288] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:36.133545 9360 leader_election.cc:341] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 2f0b97883acb4adfa4091653545e894b
I20260928 14:50:36.133654 9360 leader_election.cc:302] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.133951 10556 raft_consensus.cc:2726] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.135205 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.131932 9220 leader_election.cc:302] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:36.136459 9220 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.136559 9220 leader_election.cc:302] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.136718 10386 raft_consensus.cc:2726] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.136854 10386 raft_consensus.cc:2781] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:36.136899 10386 raft_consensus.cc:482] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:36.136947 10386 raft_consensus.cc:3037] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.139215 9814 ts_tablet_manager.cc:1918] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.139297 10386 raft_consensus.cc:504] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.139842 10386 leader_election.cc:288] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.139971 9855 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.139861 9851 raft_consensus.cc:348] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.140043 9851 raft_consensus.cc:374] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.140072 9855 ts_tablet_manager.cc:1397] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.197s user 0.044s sys 0.048s
I20260928 14:50:36.140110 9851 raft_consensus.cc:729] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.140264 9851 consensus_queue.cc:260] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.140353 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:36.140493 9567 raft_consensus.cc:3037] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.140614 9855 raft_consensus.cc:348] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.140798 9855 raft_consensus.cc:374] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.140839 9855 raft_consensus.cc:729] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.140992 9855 consensus_queue.cc:260] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.141423 9855 ts_tablet_manager.cc:1428] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.141651 10556 raft_consensus.cc:482] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.141779 10556 raft_consensus.cc:504] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.142292 10556 leader_election.cc:288] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.142488 9567 raft_consensus.cc:2454] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:36.143025 9360 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:36.143397 9219 leader_election.cc:302] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:36.143863 10386 raft_consensus.cc:2781] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:36.143963 10386 raft_consensus.cc:686] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:36.144204 9851 ts_tablet_manager.cc:1428] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260928 14:50:36.144164 10386 consensus_queue.cc:237] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.144424 9851 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.139309 9814 log.cc:1196] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/0e53b8b73b37464687d343493d186660
W20260928 14:50:36.145885 9360 leader_election.cc:341] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:36.145984 9360 leader_election.cc:302] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.146178 10556 raft_consensus.cc:2726] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.146860 9851 tablet_bootstrap.cc:654] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.148814 9814 ts_tablet_manager.cc:1939] T 0e53b8b73b37464687d343493d186660 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.149610 9814 tablet_replica.cc:330] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.149789 9814 raft_consensus.cc:2229] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.149914 9814 raft_consensus.cc:2258] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.150496 9814 ts_tablet_manager.cc:1905] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.154206 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 59ced67c921e43e48bcb5195da212582 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:36.154821 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet aeab20d78f5b41b1b36c3bf379e2c797 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:36.154650 8946 catalog_manager.cc:5495] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:36.156311 9855 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.158119 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9b3cdddf432a4e949f2bf5a224730779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.158564 9855 tablet_bootstrap.cc:654] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.158733 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b3cdddf432a4e949f2bf5a224730779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.161052 9814 ts_tablet_manager.cc:1918] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.161135 9814 log.cc:1196] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/82b042c6ffc148939dcba9b710f198d3
I20260928 14:50:36.161368 9814 ts_tablet_manager.cc:1939] T 82b042c6ffc148939dcba9b710f198d3 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.162488 10556 raft_consensus.cc:482] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.162597 10556 raft_consensus.cc:504] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.163089 10556 leader_election.cc:288] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.163244 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:36.163461 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]). Expected version 2 got 0
I20260928 14:50:36.163718 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
W20260928 14:50:36.164103 9360 leader_election.cc:341] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:36.164553 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:36.164755 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:36.165030 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4]). Expected version 1 got 0
W20260928 14:50:36.165221 9360 leader_election.cc:341] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:36.165318 9360 leader_election.cc:302] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.165706 10556 raft_consensus.cc:2726] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.171689 9848 tablet_bootstrap.cc:492] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.171859 9848 ts_tablet_manager.cc:1397] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.257s user 0.007s sys 0.004s
I20260928 14:50:36.172027 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_86f2a5aadc32486db869dfe9fc1e6d58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.172677 9848 raft_consensus.cc:348] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.172952 9848 raft_consensus.cc:374] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.173046 9848 raft_consensus.cc:729] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:36.173149 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86f2a5aadc32486db869dfe9fc1e6d58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.173300 9848 consensus_queue.cc:260] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.173949 9848 ts_tablet_manager.cc:1428] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:36.174227 9848 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.175645 9848 tablet_bootstrap.cc:654] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.176738 9815 ts_tablet_manager.cc:1918] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.177280 9815 log.cc:1196] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:36.177842 9815 ts_tablet_manager.cc:1939] T e760d7e556a54fda9dc91300b9968c68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.179574 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e760d7e556a54fda9dc91300b9968c68 (table default.Table_d313471146084c3c806a3c01b1c77538 [id=dbed9bfa98404b708a11688e563f1f86]) successfully deleted
I20260928 14:50:36.178013 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:36.182152 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb3cc5b42524a4399d0bcf21c851fd8 already in progress: creating tablet
I20260928 14:50:36.182449 10735 raft_consensus.cc:482] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.182596 10735 raft_consensus.cc:504] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.182926 9815 tablet_replica.cc:330] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.183107 9815 raft_consensus.cc:2229] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.183142 10735 leader_election.cc:288] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.183234 9815 raft_consensus.cc:2258] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:36.184072 9219 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1738a95895914cc4936a38e1d189d538
I20260928 14:50:36.184670 9815 ts_tablet_manager.cc:1905] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.191339 10767 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:36.192945 9848 tablet_bootstrap.cc:492] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.193123 9848 ts_tablet_manager.cc:1397] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260928 14:50:36.194075 9815 ts_tablet_manager.cc:1918] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.194054 9848 raft_consensus.cc:348] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.194276 9848 raft_consensus.cc:374] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.194360 9848 raft_consensus.cc:729] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.194619 9848 consensus_queue.cc:260] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.195216 9848 ts_tablet_manager.cc:1428] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:36.195495 9848 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.196341 9815 log.cc:1196] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/71b5f68b570e4fff8f8748e4c762ad78
I20260928 14:50:36.196775 9815 ts_tablet_manager.cc:1939] T 71b5f68b570e4fff8f8748e4c762ad78 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.196954 9848 tablet_bootstrap.cc:654] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.198088 9815 tablet_replica.cc:330] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.198228 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 71b5f68b570e4fff8f8748e4c762ad78 (table default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]) successfully deleted
I20260928 14:50:36.199101 9815 raft_consensus.cc:2229] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.199499 9815 raft_consensus.cc:2258] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.200140 9815 ts_tablet_manager.cc:1905] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.203370 10760 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:36.207365 9851 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.207525 9851 ts_tablet_manager.cc:1397] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.017s
I20260928 14:50:36.207937 9855 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.208086 9855 ts_tablet_manager.cc:1397] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.065s user 0.012s sys 0.008s
I20260928 14:50:36.208561 9851 raft_consensus.cc:348] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.208806 9851 raft_consensus.cc:374] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.208873 9851 raft_consensus.cc:729] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.208716 9855 raft_consensus.cc:348] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.209075 9855 raft_consensus.cc:374] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.209159 9855 raft_consensus.cc:729] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.209100 9851 consensus_queue.cc:260] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.209452 9855 consensus_queue.cc:260] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.210057 9855 ts_tablet_manager.cc:1428] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:36.210338 9855 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.211686 9855 tablet_bootstrap.cc:654] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.213570 10630 raft_consensus.cc:482] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.213675 10630 raft_consensus.cc:504] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.214160 10630 leader_election.cc:288] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.215191 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.216102 9497 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.216792 10630 raft_consensus.cc:482] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.216909 10630 raft_consensus.cc:504] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.217361 10630 leader_election.cc:288] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.210546 10767 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:36.218870 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.219372 9498 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.198136 9813 ts_tablet_manager.cc:1918] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.203994 10759 tablet.cc:1722] T d7d4ef8a945c4e6c899e2bbd6069969c P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:36.220034 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3461b27174ca4bb184a3369d5de47bcc
I20260928 14:50:36.220104 9813 log.cc:1196] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f05131db52e94d7c9f4856b0455246d2
I20260928 14:50:36.220415 9813 ts_tablet_manager.cc:1939] T f05131db52e94d7c9f4856b0455246d2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.220744 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e3a9f292618469c8d84da18059419b0 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:36.221215 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b14339044619424c9be020fa99ad681e consensus state has no leader
I20260928 14:50:36.221246 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 566) took 4512 ms. Trace:
I20260928 14:50:36.221323 9813 rpcz_store.cc:276] 0928 14:50:31.709277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.709337 (+ 60us) service_pool.cc:227] Handling call
0928 14:50:36.021881 (+4312544us) ts_tablet_manager.cc:1145] Deleting tablet f05131db52e94d7c9f4856b0455246d2
0928 14:50:36.021890 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.124416 (+102526us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.197908 (+ 73492us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.221228 (+ 23320us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4309894}
I20260928 14:50:36.221922 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f05131db52e94d7c9f4856b0455246d2 (table default.Table_ad7b877efd3c4bdfb36a80026836f95f [id=a59e94a47bd34251847688436f6c882a]) successfully deleted
I20260928 14:50:36.221975 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 578) took 4411 ms. Trace:
I20260928 14:50:36.222054 9813 rpcz_store.cc:276] 0928 14:50:31.810937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.811706 (+ 769us) service_pool.cc:227] Handling call
0928 14:50:36.221861 (+4410155us) ts_tablet_manager.cc:1145] Deleting tablet f39c1da071164342aea8eab263d4eebb
0928 14:50:36.221872 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.221960 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4383109}
I20260928 14:50:36.222398 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 577) took 4411 ms. Trace:
I20260928 14:50:36.222479 9813 rpcz_store.cc:276] 0928 14:50:31.810839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.811666 (+ 827us) service_pool.cc:227] Handling call
0928 14:50:36.222306 (+4410640us) ts_tablet_manager.cc:1145] Deleting tablet 835ba6c803a34707b77bb8bc280b9e68
0928 14:50:36.222314 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.222384 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4367613}
I20260928 14:50:36.222597 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 3461b27174ca4bb184a3369d5de47bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.222899 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 579) took 4411 ms. Trace:
I20260928 14:50:36.223016 9813 rpcz_store.cc:276] 0928 14:50:31.811026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.838775 (+ 27749us) service_pool.cc:227] Handling call
0928 14:50:36.222812 (+4384037us) ts_tablet_manager.cc:1145] Deleting tablet 7d267fa0a698437986feb52cd9c15cc1
0928 14:50:36.222821 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.222887 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4310236}
I20260928 14:50:36.223429 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 580) took 4412 ms. Trace:
I20260928 14:50:36.223488 9851 ts_tablet_manager.cc:1428] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260928 14:50:36.223539 9813 rpcz_store.cc:276] 0928 14:50:31.811112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.854716 (+ 43604us) service_pool.cc:227] Handling call
0928 14:50:36.223347 (+4368631us) ts_tablet_manager.cc:1145] Deleting tablet 8a06859c8dcc41d99d29365aae350afa
0928 14:50:36.223356 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.223418 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4310585}
I20260928 14:50:36.223778 9851 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:36.224001 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f39c1da071164342aea8eab263d4eebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f39c1da071164342aea8eab263d4eebb already in progress: creating tablet
W20260928 14:50:36.224262 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 835ba6c803a34707b77bb8bc280b9e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 835ba6c803a34707b77bb8bc280b9e68 already in progress: creating tablet
I20260928 14:50:36.224938 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 3461b27174ca4bb184a3369d5de47bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.225171 9851 tablet_bootstrap.cc:654] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.225419 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8a06859c8dcc41d99d29365aae350afa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a06859c8dcc41d99d29365aae350afa already in progress: creating tablet
I20260928 14:50:36.225800 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 582) took 4299 ms. Trace:
I20260928 14:50:36.227147 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.227684 9497 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.227803 9497 leader_election.cc:302] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.227833 9813 rpcz_store.cc:276] 0928 14:50:31.926368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.926417 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:36.225693 (+4299276us) ts_tablet_manager.cc:1145] Deleting tablet 1eaafbd52e464862ae0f0d44ffae58cf
0928 14:50:36.225702 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.225785 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4299087}
I20260928 14:50:36.228144 10630 raft_consensus.cc:2726] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.228437 9815 ts_tablet_manager.cc:1918] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:36.228485 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1eaafbd52e464862ae0f0d44ffae58cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1eaafbd52e464862ae0f0d44ffae58cf already in progress: creating tablet
I20260928 14:50:36.228600 9815 log.cc:1196] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/46fe647c6d80431bbb76899126d01c3b
I20260928 14:50:36.228852 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 583) took 4280 ms. Trace:
I20260928 14:50:36.228920 9815 ts_tablet_manager.cc:1939] T 46fe647c6d80431bbb76899126d01c3b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.228957 9813 rpcz_store.cc:276] 0928 14:50:31.948458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:31.948509 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:36.228763 (+4280254us) ts_tablet_manager.cc:1145] Deleting tablet 504c0f61d8844bd18062a3b40cd6f8ce
0928 14:50:36.228772 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.228838 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4280007}
W20260928 14:50:36.229372 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 504c0f61d8844bd18062a3b40cd6f8ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 504c0f61d8844bd18062a3b40cd6f8ce already in progress: creating tablet
I20260928 14:50:36.229754 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 584) took 4239 ms. Trace:
I20260928 14:50:36.229868 9813 rpcz_store.cc:276] 0928 14:50:31.990328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.084809 (+ 94481us) service_pool.cc:227] Handling call
0928 14:50:36.229650 (+4144841us) ts_tablet_manager.cc:1145] Deleting tablet 6d193edcfa684b8795b084f3106903c5
0928 14:50:36.229660 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.229740 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4111948}
I20260928 14:50:36.230110 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 46fe647c6d80431bbb76899126d01c3b (table default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]) successfully deleted
W20260928 14:50:36.230297 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6d193edcfa684b8795b084f3106903c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d193edcfa684b8795b084f3106903c5 already in progress: creating tablet
I20260928 14:50:36.230638 9813 tablet_replica.cc:330] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:36.230783 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3461b27174ca4bb184a3369d5de47bcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3461b27174ca4bb184a3369d5de47bcc already in progress: creating tablet
I20260928 14:50:36.230857 9813 raft_consensus.cc:2229] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.231057 9813 raft_consensus.cc:2258] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.231526 9813 ts_tablet_manager.cc:1905] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.234125 9855 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.234247 9855 ts_tablet_manager.cc:1397] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20260928 14:50:36.234841 9855 raft_consensus.cc:348] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.235015 9855 raft_consensus.cc:374] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.235066 9855 raft_consensus.cc:729] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.235263 9855 consensus_queue.cc:260] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.236874 9851 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.237005 9851 ts_tablet_manager.cc:1397] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260928 14:50:36.237898 9855 ts_tablet_manager.cc:1428] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:36.237752 9851 raft_consensus.cc:348] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.237977 9851 raft_consensus.cc:374] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.238067 9851 raft_consensus.cc:729] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.238134 9855 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.238270 9851 consensus_queue.cc:260] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.238888 9851 ts_tablet_manager.cc:1428] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.239292 9851 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.239472 9855 tablet_bootstrap.cc:654] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.240840 9851 tablet_bootstrap.cc:654] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.246151 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.246872 9498 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.246989 9498 leader_election.cc:302] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.247287 10630 raft_consensus.cc:2726] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.248584 9851 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.248700 9851 ts_tablet_manager.cc:1397] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260928 14:50:36.249415 9851 raft_consensus.cc:348] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.249657 9851 raft_consensus.cc:374] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.249716 9851 raft_consensus.cc:729] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.249904 9851 consensus_queue.cc:260] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.250530 9851 ts_tablet_manager.cc:1428] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.250968 9851 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.252548 9851 tablet_bootstrap.cc:654] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.253499 10386 raft_consensus.cc:2726] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:36.253887 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 117427us
I20260928 14:50:36.254350 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.255499 9848 tablet_bootstrap.cc:492] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.255527 9851 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.255635 9851 ts_tablet_manager.cc:1397] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260928 14:50:36.255761 9848 ts_tablet_manager.cc:1397] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260928 14:50:36.256430 9851 raft_consensus.cc:348] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.256650 9851 raft_consensus.cc:374] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.256459 9848 raft_consensus.cc:348] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.256722 9851 raft_consensus.cc:729] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.256825 9848 raft_consensus.cc:374] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.256922 9848 raft_consensus.cc:729] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.256917 9851 consensus_queue.cc:260] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.257342 9848 consensus_queue.cc:260] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.257754 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 09f04bf1357148818ea60b32cfd5f9cc
I20260928 14:50:36.258006 9848 ts_tablet_manager.cc:1428] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:36.258239 9848 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.259603 9848 tablet_bootstrap.cc:654] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.259905 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.260305 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.260457 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 3461b27174ca4bb184a3369d5de47bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:36.261053 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 09f04bf1357148818ea60b32cfd5f9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f04bf1357148818ea60b32cfd5f9cc already in progress: creating tablet
I20260928 14:50:36.261579 9851 ts_tablet_manager.cc:1428] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 14:50:36.261580 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 0e53b8b73b37464687d343493d186660 (table default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]) successfully deleted
I20260928 14:50:36.261514 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:36.261927 9851 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.262229 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 82b042c6ffc148939dcba9b710f198d3 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:36.262197 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1738a95895914cc4936a38e1d189d538" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.262676 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb3cc5b42524a4399d0bcf21c851fd8 already in progress: creating tablet
W20260928 14:50:36.262977 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3461b27174ca4bb184a3369d5de47bcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3461b27174ca4bb184a3369d5de47bcc already in progress: creating tablet
I20260928 14:50:36.263238 10386 raft_consensus.cc:482] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.263367 10386 raft_consensus.cc:504] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.263929 10386 leader_election.cc:288] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.263952 9851 tablet_bootstrap.cc:654] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.264285 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f04bf1357148818ea60b32cfd5f9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:36.264736 9219 leader_election.cc:341] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9a753aaf7f8c4498b6ba35fa27d8c537
W20260928 14:50:36.264820 9220 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:36.265084 9220 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.265161 9220 leader_election.cc:302] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.265245 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a753aaf7f8c4498b6ba35fa27d8c537" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.265410 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.266487 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 9a4a6c21a0824a93acaafa25e1b6e99c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:36.273485 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet aeab20d78f5b41b1b36c3bf379e2c797
I20260928 14:50:36.274029 8955 catalog_manager.cc:6565] ReplaceTablet: tablet aeab20d78f5b41b1b36c3bf379e2c797 deleted and replaced by tablet a9903241fd3b463094fff7bf9c76ed9b
I20260928 14:50:36.274269 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 with delete_type TABLET_DATA_DELETED (replaced by tablet a9903241fd3b463094fff7bf9c76ed9b) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.274994 9813 ts_tablet_manager.cc:1918] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:36.275013 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet aeab20d78f5b41b1b36c3bf379e2c797 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aeab20d78f5b41b1b36c3bf379e2c797 already in progress: creating tablet
I20260928 14:50:36.275079 9813 log.cc:1196] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/57e56077833e41dbacf54c1757ba6a38
I20260928 14:50:36.275329 9813 ts_tablet_manager.cc:1939] T 57e56077833e41dbacf54c1757ba6a38 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.275696 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 with delete_type TABLET_DATA_DELETED (replaced by tablet a9903241fd3b463094fff7bf9c76ed9b) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.275954 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 593) took 3792 ms. Trace:
I20260928 14:50:36.276026 9813 rpcz_store.cc:276] 0928 14:50:32.483682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.483816 (+ 134us) service_pool.cc:227] Handling call
0928 14:50:36.230601 (+3746785us) ts_tablet_manager.cc:1145] Deleting tablet 57e56077833e41dbacf54c1757ba6a38
0928 14:50:36.230610 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.271025 (+ 40415us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.274918 (+ 3893us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.275939 (+ 1021us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3717745}
I20260928 14:50:36.276402 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 594) took 3755 ms. Trace:
I20260928 14:50:36.276479 9813 rpcz_store.cc:276] 0928 14:50:32.520516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.520576 (+ 60us) service_pool.cc:227] Handling call
0928 14:50:36.276278 (+3755702us) ts_tablet_manager.cc:1145] Deleting tablet e53683279a0c4b41b9ea94e88a84cb94
0928 14:50:36.276297 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.276388 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3755504}
I20260928 14:50:36.276546 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 57e56077833e41dbacf54c1757ba6a38 (table default.Table_7e00ed21ddb54c429a68c09c19656d68 [id=4b76fc92f76049c784d3f82642063dea]) successfully deleted
I20260928 14:50:36.276777 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 596) took 3553 ms. Trace:
I20260928 14:50:36.276839 9813 rpcz_store.cc:276] 0928 14:50:32.723722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.723782 (+ 60us) service_pool.cc:227] Handling call
0928 14:50:36.276688 (+3552906us) ts_tablet_manager.cc:1145] Deleting tablet 2949cff5a7694015ad1708ed7fab3447
0928 14:50:36.276696 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.276765 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552685}
W20260928 14:50:36.277019 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e53683279a0c4b41b9ea94e88a84cb94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e53683279a0c4b41b9ea94e88a84cb94 already in progress: creating tablet
I20260928 14:50:36.277086 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 595) took 3553 ms. Trace:
I20260928 14:50:36.277143 9813 rpcz_store.cc:276] 0928 14:50:32.723576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.724114 (+ 538us) service_pool.cc:227] Handling call
0928 14:50:36.277009 (+3552895us) ts_tablet_manager.cc:1145] Deleting tablet 5a6755b697134b8e90e457b554b9599c
0928 14:50:36.277016 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.277075 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552673}
I20260928 14:50:36.277375 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 597) took 3553 ms. Trace:
I20260928 14:50:36.277400 10630 raft_consensus.cc:482] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.277536 10630 raft_consensus.cc:504] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:36.277746 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2949cff5a7694015ad1708ed7fab3447 already in progress: creating tablet
I20260928 14:50:36.277872 10386 raft_consensus.cc:2726] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:36.278026 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5a6755b697134b8e90e457b554b9599c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a6755b697134b8e90e457b554b9599c already in progress: creating tablet
I20260928 14:50:36.278101 10630 leader_election.cc:288] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:36.278338 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 09f04bf1357148818ea60b32cfd5f9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f04bf1357148818ea60b32cfd5f9cc already in progress: creating tablet
I20260928 14:50:36.278455 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet aeab20d78f5b41b1b36c3bf379e2c797 with delete_type TABLET_DATA_DELETED (replaced by tablet a9903241fd3b463094fff7bf9c76ed9b) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.278695 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.278867 9220 leader_election.cc:341] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.278827 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.278949 9220 leader_election.cc:302] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.279119 10386 raft_consensus.cc:2726] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:36.279238 9498 leader_election.cc:341] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:36.279390 9220 leader_election.cc:341] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:36.279467 9497 leader_election.cc:341] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.279594 9497 leader_election.cc:302] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:36.279755 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet aeab20d78f5b41b1b36c3bf379e2c797 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aeab20d78f5b41b1b36c3bf379e2c797 already in progress: creating tablet
I20260928 14:50:36.279999 10630 raft_consensus.cc:2726] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.280329 9855 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.280444 9855 ts_tablet_manager.cc:1397] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.019s
I20260928 14:50:36.280416 10386 raft_consensus.cc:482] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.280557 10386 raft_consensus.cc:504] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.281037 9855 raft_consensus.cc:348] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.281186 10386 leader_election.cc:288] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.281219 9855 raft_consensus.cc:374] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.281262 9855 raft_consensus.cc:729] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.281450 9855 consensus_queue.cc:260] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.281852 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d199c65d3b4040388360fd8302d7cb8c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.282420 9855 ts_tablet_manager.cc:1428] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 14:50:36.282447 9219 leader_election.cc:341] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:36.282637 9855 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:36.282852 9220 leader_election.cc:341] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.283018 9220 leader_election.cc:302] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.283245 10386 raft_consensus.cc:2726] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.284077 9855 tablet_bootstrap.cc:654] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.290750 9848 tablet_bootstrap.cc:492] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.290910 9848 ts_tablet_manager.cc:1397] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260928 14:50:36.291584 9848 raft_consensus.cc:348] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.291791 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet ca7fa45e25b0455e92412b844cd78cdc from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:36.291932 9848 raft_consensus.cc:374] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.292026 9848 raft_consensus.cc:729] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.292284 9848 consensus_queue.cc:260] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.292979 9848 ts_tablet_manager.cc:1428] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:36.293267 9848 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.293171 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c9da29b5882b442392a3f79e5a737ec0" } new_table_name: "default.Table_d373aade629d4a2580d70ce4c9ffb223" modify_external_catalogs: true
I20260928 14:50:36.293320 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6a14297d430c49208e7a05d1341ffab9" } modify_external_catalogs: true
I20260928 14:50:36.293547 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6a14297d430c49208e7a05d1341ffab9" } modify_external_catalogs: true
I20260928 14:50:36.294142 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f38371501cb347d3b36246f9a12070f8" } new_table_name: "default.Table_92419bafe3fe4c55bd4275a007fae26e" modify_external_catalogs: true
I20260928 14:50:36.294925 9848 tablet_bootstrap.cc:654] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.295519 9855 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.295624 9855 ts_tablet_manager.cc:1397] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260928 14:50:36.296218 9855 raft_consensus.cc:348] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.296391 9855 raft_consensus.cc:374] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.296435 9855 raft_consensus.cc:729] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.277438 9813 rpcz_store.cc:276] 0928 14:50:32.723876 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.724378 (+ 502us) service_pool.cc:227] Handling call
0928 14:50:36.277299 (+3552921us) ts_tablet_manager.cc:1145] Deleting tablet 157e807a962749028b1c8df00846295a
0928 14:50:36.277305 (+ 6us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.277361 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552745}
I20260928 14:50:36.296619 9855 consensus_queue.cc:260] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.297128 9855 ts_tablet_manager.cc:1428] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:36.297004 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_77bf464749b54bcfaa58cb2fb76b9b87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.297344 9855 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:36.297590 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77bf464749b54bcfaa58cb2fb76b9b87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.298661 9855 tablet_bootstrap.cc:654] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.298632 9428 raft_consensus.cc:3037] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.292083 8951 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_a4b0b314447f41eb8a531ae408712220 [id=d8c0c4feb9be4af4a6776f750cc243d4] alter complete (version 1)
I20260928 14:50:36.298777 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8de99502a21e4bd898e0642bd72a7aaa" } modify_external_catalogs: true
I20260928 14:50:36.298996 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8de99502a21e4bd898e0642bd72a7aaa" } modify_external_catalogs: true
I20260928 14:50:36.299595 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_deed66b243364250aaf9cb96c87c879f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.300133 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deed66b243364250aaf9cb96c87c879f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.300244 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3cda8f50c2ba4f1f82d4a182c7e76119" } new_table_name: "default.Table_9aa2a15124ab40d682b1da19d1713074" modify_external_catalogs: true
I20260928 14:50:36.303144 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.303361 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.303757 9815 tablet_replica.cc:330] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.303947 9815 raft_consensus.cc:2229] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.304107 9815 raft_consensus.cc:2258] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.304787 10630 raft_consensus.cc:482] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.304895 10630 raft_consensus.cc:504] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.304998 9815 ts_tablet_manager.cc:1905] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.305426 10630 leader_election.cc:288] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.306284 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea7b363d546c45ceb3efb9352cf184f4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.306773 9497 leader_election.cc:341] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:36.307132 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 157e807a962749028b1c8df00846295a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157e807a962749028b1c8df00846295a already in progress: creating tablet
I20260928 14:50:36.307858 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet b65fd0746d1b474e9fbebe6f09053743 with delete_type TABLET_DATA_DELETED (replaced by tablet d96492abf8cf459a992dd1d7b0226b57) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.308094 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet f3ac8adb23c5478fadb6cb6765459913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.308276 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b97883acb4adfa4091653545e894b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.309827 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea7b363d546c45ceb3efb9352cf184f4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.310305 9498 leader_election.cc:341] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.310405 9498 leader_election.cc:302] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.310695 10630 raft_consensus.cc:2726] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.312000 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 598) took 3588 ms. Trace:
I20260928 14:50:36.312419 9815 ts_tablet_manager.cc:1918] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.312625 9815 log.cc:1196] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:36.312685 9813 rpcz_store.cc:276] 0928 14:50:32.724053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.724135 (+ 82us) service_pool.cc:227] Handling call
0928 14:50:36.311885 (+3587750us) ts_tablet_manager.cc:1145] Deleting tablet 1f012857690f4f91a941a5f642b9c989
0928 14:50:36.311896 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.311981 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3586941}
I20260928 14:50:36.313007 9815 ts_tablet_manager.cc:1939] T ab71087d034c4bedb06df9e5ccefad45 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:36.313505 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1f012857690f4f91a941a5f642b9c989 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f012857690f4f91a941a5f642b9c989 already in progress: creating tablet
I20260928 14:50:36.314069 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ab71087d034c4bedb06df9e5ccefad45 (table default.Table_6e50a29433014e98b687ee424debf6d5 [id=c21ae162198d4e5393efc4d962fd68b1]) successfully deleted
I20260928 14:50:36.314628 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 599) took 3577 ms. Trace:
I20260928 14:50:36.314723 9813 rpcz_store.cc:276] 0928 14:50:32.737427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.737478 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:36.313286 (+3575808us) ts_tablet_manager.cc:1145] Deleting tablet 157e807a962749028b1c8df00846295a
0928 14:50:36.314532 (+ 1246us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.314612 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3575587}
I20260928 14:50:36.315006 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 600) took 3577 ms. Trace:
I20260928 14:50:36.315073 9813 rpcz_store.cc:276] 0928 14:50:32.737786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.737831 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:36.314921 (+3577090us) ts_tablet_manager.cc:1145] Deleting tablet 2949cff5a7694015ad1708ed7fab3447
0928 14:50:36.314930 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.314994 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3576812}
W20260928 14:50:36.315145 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 157e807a962749028b1c8df00846295a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157e807a962749028b1c8df00846295a already in progress: creating tablet
I20260928 14:50:36.315315 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 606) took 3530 ms. Trace:
I20260928 14:50:36.315372 9813 rpcz_store.cc:276] 0928 14:50:32.784788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:32.784837 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:36.315239 (+3530402us) ts_tablet_manager.cc:1145] Deleting tablet 7a2f051a09e143b8bb0ba3be81406b98
0928 14:50:36.315248 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.315303 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3530164}
I20260928 14:50:36.315591 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 619) took 2936 ms. Trace:
I20260928 14:50:36.315622 9815 tablet_replica.cc:330] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.315645 9813 rpcz_store.cc:276] 0928 14:50:33.379625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.379825 (+ 200us) service_pool.cc:227] Handling call
0928 14:50:36.315526 (+2935701us) ts_tablet_manager.cc:1145] Deleting tablet c51f5944c6534e9492594c39ae9796b2
0928 14:50:36.315534 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.315582 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2888862}
W20260928 14:50:36.315733 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2949cff5a7694015ad1708ed7fab3447 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2949cff5a7694015ad1708ed7fab3447 already in progress: creating tablet
I20260928 14:50:36.315789 9815 raft_consensus.cc:2229] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.315878 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 616) took 2936 ms. Trace:
I20260928 14:50:36.315905 9815 raft_consensus.cc:2258] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:36.315945 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7a2f051a09e143b8bb0ba3be81406b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a2f051a09e143b8bb0ba3be81406b98 already in progress: creating tablet
I20260928 14:50:36.315927 9813 rpcz_store.cc:276] 0928 14:50:33.379309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.379533 (+ 224us) service_pool.cc:227] Handling call
0928 14:50:36.315809 (+2936276us) ts_tablet_manager.cc:1145] Deleting tablet b8738a1591f644758f44fc720fd694a3
0928 14:50:36.315816 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.315868 (+ 52us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2880490}
I20260928 14:50:36.316099 9813 tablet_replica.cc:330] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:36.316241 9813 raft_consensus.cc:2229] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.316360 9813 raft_consensus.cc:2258] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:36.316840 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c51f5944c6534e9492594c39ae9796b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51f5944c6534e9492594c39ae9796b2 already in progress: creating tablet
W20260928 14:50:36.316874 9498 connection.cc:535] client connection to 127.8.181.61:41417 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:36.317077 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b8738a1591f644758f44fc720fd694a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8738a1591f644758f44fc720fd694a3 already in progress: creating tablet
I20260928 14:50:36.317585 9815 ts_tablet_manager.cc:1905] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.323133 9815 ts_tablet_manager.cc:1918] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.325752 9815 log.cc:1196] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ea7b363d546c45ceb3efb9352cf184f4
I20260928 14:50:36.326215 9815 ts_tablet_manager.cc:1939] T ea7b363d546c45ceb3efb9352cf184f4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:36.329114 9220 connection.cc:535] client connection to 127.8.181.61:41417 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 14:50:36.329763 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ea7b363d546c45ceb3efb9352cf184f4 (table default.Table_38e8d8c399254d78ba45f973e9064285 [id=c7a56fd7639749f79590b127587f602e]) successfully deleted
W20260928 14:50:36.332859 8940 connection.cc:535] client connection to 127.8.181.61:41417 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 14:50:36.332993 8940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 9 similar messages]
W20260928 14:50:36.333580 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3d6aa891123476b82eff842aefb565c consensus state has no leader
W20260928 14:50:36.345256 10788 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 14:50:36.318071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.181.61:41417 (local address 127.8.181.3:39213)
0928 14:50:36.344903 (+ 26832us) negotiation.cc:107] Waiting for socket to connect
0928 14:50:36.345004 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":26707,"threads_started":1}
W20260928 14:50:36.346189 10789 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 14:50:36.330394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.181.61:41417 (local address 127.8.181.1:38813)
0928 14:50:36.345827 (+ 15433us) negotiation.cc:107] Waiting for socket to connect
0928 14:50:36.345976 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":15306,"threads_started":1}
I20260928 14:50:36.346622 10630 raft_consensus.cc:482] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.346760 10630 raft_consensus.cc:504] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.347301 10630 leader_election.cc:288] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.347934 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8234670cb2604ba7b405ad7f70e03a2f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.348539 9497 leader_election.cc:341] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.349975 9568 raft_consensus.cc:1261] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:36.350471 10735 consensus_queue.cc:1035] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:36.366062 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_92faa3134f2b4070889eed0ea66a492c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.366681 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92faa3134f2b4070889eed0ea66a492c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.371094 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cc14ad35a4de45f19a8409e3a29b6bf9" } modify_external_catalogs: true
I20260928 14:50:36.371373 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cc14ad35a4de45f19a8409e3a29b6bf9" } modify_external_catalogs: true
W20260928 14:50:36.373015 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e59b8e736b6d4644a78a6d7570746e18 consensus state has no leader
I20260928 14:50:36.373407 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.373874 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:36.328891 9361 connection.cc:535] client connection to 127.8.181.61:41417 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 14:50:36.375932 9851 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.342795 10556 raft_consensus.cc:482] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.376072 9851 ts_tablet_manager.cc:1397] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.114s user 0.034s sys 0.036s
I20260928 14:50:36.376144 10556 raft_consensus.cc:504] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.376700 10556 leader_election.cc:288] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.376757 9851 raft_consensus.cc:348] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.376957 9851 raft_consensus.cc:374] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.377010 9851 raft_consensus.cc:729] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.377185 9851 consensus_queue.cc:260] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.346895 10759 tablet.cc:1722] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:36.377717 9851 ts_tablet_manager.cc:1428] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.377997 9851 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.379483 9851 tablet_bootstrap.cc:654] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.381805 9360 leader_election.cc:341] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 9648be4c626e44e0986c196704483955
I20260928 14:50:36.389735 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fb80509526ea4cbdb0f2308e95138278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.390225 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb80509526ea4cbdb0f2308e95138278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.390446 9851 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.390543 9851 ts_tablet_manager.cc:1397] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.003s
I20260928 14:50:36.391566 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_74ce8f6b336f44d2b882204b3edae67b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.391579 9851 raft_consensus.cc:348] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.391757 9851 raft_consensus.cc:374] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.391803 9851 raft_consensus.cc:729] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:36.392009 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74ce8f6b336f44d2b882204b3edae67b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.391975 9851 consensus_queue.cc:260] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.392454 9851 ts_tablet_manager.cc:1428] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:36.392699 9851 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.394098 9851 tablet_bootstrap.cc:654] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.394549 9360 leader_election.cc:341] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9648be4c626e44e0986c196704483955
I20260928 14:50:36.394659 9360 leader_election.cc:302] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.394992 10677 raft_consensus.cc:2726] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:36.396615 9220 consensus_peers.cc:487] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:36.373402 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8234670cb2604ba7b405ad7f70e03a2f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.397403 9498 leader_election.cc:341] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.397583 9498 leader_election.cc:302] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.398528 10630 raft_consensus.cc:2726] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.404759 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:36.405064 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eff9afcc868244aeb830fae2735da28d (table default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]). Expected version 2 got 0
I20260928 14:50:36.406771 8955 catalog_manager.cc:5495] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:36.407213 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:36.407470 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:36.408998 9813 ts_tablet_manager.cc:1905] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.412603 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 08cbf52445274313910166ba80c32630 (DEFAULT_TABLE table=default.Table_c473ccd6dd9c45258a6e10eed66828df [id=234004d851fa40bb96d708a0759f972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.412964 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08cbf52445274313910166ba80c32630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.417009 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b072b55c076c496b981860d100357f44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.417514 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b072b55c076c496b981860d100357f44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.419164 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2120286b0fdb44de96415255839b3445" } new_table_name: "default.Table_b229da0aeb9c4daca8603a0f4884894c" modify_external_catalogs: true
I20260928 14:50:36.419459 9848 tablet_bootstrap.cc:492] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.419561 9848 ts_tablet_manager.cc:1397] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.126s user 0.005s sys 0.001s
I20260928 14:50:36.423801 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 08cbf52445274313910166ba80c32630 (DEFAULT_TABLE table=default.Table_c473ccd6dd9c45258a6e10eed66828df [id=234004d851fa40bb96d708a0759f972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.424187 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08cbf52445274313910166ba80c32630. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.429986 8940 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417): Couldn't send request to peer 8d70b1b045bd4ec4b74be2dc2364ecba. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:36.431753 10677 raft_consensus.cc:482] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.431864 10677 raft_consensus.cc:504] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.432330 10677 leader_election.cc:288] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.434693 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:36.435374 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7aff7724868140b3b544d6b1f237b6fa
I20260928 14:50:36.435657 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]). Expected version 3 got 0
I20260928 14:50:36.435899 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:36.435966 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1fbc88b53052473895a2d2e63da9be50
I20260928 14:50:36.436511 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9a4a6c21a0824a93acaafa25e1b6e99c
I20260928 14:50:36.436836 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 9a4a6c21a0824a93acaafa25e1b6e99c deleted and replaced by tablet 3cc42a43c9d0483f846a7f11ff1554fe
I20260928 14:50:36.437139 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1e3a9f292618469c8d84da18059419b0
I20260928 14:50:36.437484 8948 catalog_manager.cc:6565] ReplaceTablet: tablet 1e3a9f292618469c8d84da18059419b0 deleted and replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e
W20260928 14:50:36.438261 9360 leader_election.cc:341] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:36.438374 8956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_03d36d3a614f49d0a4f8f39f923e2677 [id=758c0941b029421d8f865d8600a17049] alter complete (version 2)
W20260928 14:50:36.446595 9360 leader_election.cc:341] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:36.446712 9360 leader_election.cc:302] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.447142 10677 raft_consensus.cc:2726] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.448462 9855 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.448586 9855 ts_tablet_manager.cc:1397] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.151s user 0.019s sys 0.023s
I20260928 14:50:36.449335 10767 tablet.cc:1722] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:36.449309 9855 raft_consensus.cc:348] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.449498 9855 raft_consensus.cc:374] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.449568 9855 raft_consensus.cc:729] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.449738 9855 consensus_queue.cc:260] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.450237 9855 ts_tablet_manager.cc:1428] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.450474 9855 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.451293 10760 tablet.cc:1722] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:36.451954 9855 tablet_bootstrap.cc:654] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.458990 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.459519 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbc88b53052473895a2d2e63da9be50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.459748 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c with delete_type TABLET_DATA_DELETED (replaced by tablet 3cc42a43c9d0483f846a7f11ff1554fe) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.459864 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 9648be4c626e44e0986c196704483955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.459925 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.459977 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.460197 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aff7724868140b3b544d6b1f237b6fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.460466 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbc88b53052473895a2d2e63da9be50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.460441 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 6bff112215814b8ba3d6624bbec772e1 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.461041 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aff7724868140b3b544d6b1f237b6fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.461228 9405 tablet_service.cc:1467] Processing CreateTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb (DEFAULT_TABLE table=default.Table_78ef16fcfe2e4061882c68341df55233 [id=fe32b488d5a940bd872c6c7dab1e2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.461315 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f8db468ad3c4bba8c701c3d8feba9f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ef356a4c9d34af4b300d38eab49a569) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.461789 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c798c79511d749cd8105586d447298de (DEFAULT_TABLE table=default.Table_e3472c2548ac494e9aa3a10e042f6f0a [id=1db98780e273483389d26c1153aabec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.462191 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.462757 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.463174 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.464099 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c with delete_type TABLET_DATA_DELETED (replaced by tablet 3cc42a43c9d0483f846a7f11ff1554fe) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.464766 9815 tablet_replica.cc:330] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.464958 9815 raft_consensus.cc:2229] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.465098 9815 raft_consensus.cc:2258] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.465833 9815 ts_tablet_manager.cc:1905] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.466190 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 08cbf52445274313910166ba80c32630 (DEFAULT_TABLE table=default.Table_c473ccd6dd9c45258a6e10eed66828df [id=234004d851fa40bb96d708a0759f972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.466499 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08cbf52445274313910166ba80c32630. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.467981 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 already in progress: creating tablet
I20260928 14:50:36.468201 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_df4e804ab47e43f090495eb55315ed06" } modify_external_catalogs: true
W20260928 14:50:36.468457 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1fbc88b53052473895a2d2e63da9be50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fbc88b53052473895a2d2e63da9be50 already in progress: creating tablet
W20260928 14:50:36.468704 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7aff7724868140b3b544d6b1f237b6fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aff7724868140b3b544d6b1f237b6fa already in progress: creating tablet
W20260928 14:50:36.468930 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1e3a9f292618469c8d84da18059419b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3a9f292618469c8d84da18059419b0 already in progress: creating tablet
I20260928 14:50:36.469662 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.468425 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_df4e804ab47e43f090495eb55315ed06" } modify_external_catalogs: true
I20260928 14:50:36.469765 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.470305 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.470532 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aff7724868140b3b544d6b1f237b6fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.471319 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92419bafe3fe4c55bd4275a007fae26e" } modify_external_catalogs: true
I20260928 14:50:36.471475 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92419bafe3fe4c55bd4275a007fae26e" } modify_external_catalogs: true
I20260928 14:50:36.472163 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a2a8aa86e56f421b82a50a72786e472c [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 2 got 0
I20260928 14:50:36.472756 9538 tablet_service.cc:1467] Processing CreateTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb (DEFAULT_TABLE table=default.Table_78ef16fcfe2e4061882c68341df55233 [id=fe32b488d5a940bd872c6c7dab1e2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.420195 9848 raft_consensus.cc:348] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.472963 9848 raft_consensus.cc:374] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.473022 9848 raft_consensus.cc:729] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.473131 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d6d6db7a1484498c7496ddbdc29fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.473260 9848 consensus_queue.cc:260] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.473555 9815 ts_tablet_manager.cc:1918] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.473716 9815 log.cc:1196] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/59ced67c921e43e48bcb5195da212582
I20260928 14:50:36.473675 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1d7f35af447d4b17a752c1d9b1f2b218" } new_table_name: "default.Table_d4f15fcabf5a4d1db732802273495b51" modify_external_catalogs: true
I20260928 14:50:36.474385 9815 ts_tablet_manager.cc:1939] T 59ced67c921e43e48bcb5195da212582 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.475943 9848 ts_tablet_manager.cc:1428] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.056s user 0.001s sys 0.001s
I20260928 14:50:36.476006 9815 tablet_replica.cc:330] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.476181 9848 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.476336 9815 raft_consensus.cc:2229] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.476461 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbc88b53052473895a2d2e63da9be50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.476594 9815 raft_consensus.cc:2258] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.477751 9543 tablet_service.cc:1467] Processing CreateTablet for tablet c798c79511d749cd8105586d447298de (DEFAULT_TABLE table=default.Table_e3472c2548ac494e9aa3a10e042f6f0a [id=1db98780e273483389d26c1153aabec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.477764 9815 ts_tablet_manager.cc:1905] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.478150 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a4a6c21a0824a93acaafa25e1b6e99c with delete_type TABLET_DATA_DELETED (replaced by tablet 3cc42a43c9d0483f846a7f11ff1554fe) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.478658 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.479339 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.479506 9814 tablet_replica.cc:330] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.479679 9814 raft_consensus.cc:2229] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.479822 9814 raft_consensus.cc:2258] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.480274 9814 ts_tablet_manager.cc:1905] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.481961 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c798c79511d749cd8105586d447298de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.485826 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 6bff112215814b8ba3d6624bbec772e1 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.485903 9814 ts_tablet_manager.cc:1918] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.485992 9814 log.cc:1196] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9a753aaf7f8c4498b6ba35fa27d8c537
I20260928 14:50:36.486157 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bff112215814b8ba3d6624bbec772e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.486243 9814 ts_tablet_manager.cc:1939] T 9a753aaf7f8c4498b6ba35fa27d8c537 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.487756 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.488023 9814 tablet_replica.cc:330] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.488181 9814 raft_consensus.cc:2229] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.488301 9814 raft_consensus.cc:2258] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.488973 9814 ts_tablet_manager.cc:1905] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.494149 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.495481 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.496589 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.498057 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.499634 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.501334 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.502103 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 59ced67c921e43e48bcb5195da212582 (table default.Table_91fba5be108742dfadfae0e7c4aa61f6 [id=ca5392bf870e48a5bfd32b024c85a0b9]) successfully deleted
I20260928 14:50:36.503278 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.504173 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bff112215814b8ba3d6624bbec772e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.504101 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7cfd3e0904e14e86b1f17dcdd9dc7c94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.504412 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d6d6db7a1484498c7496ddbdc29fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.504535 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e53b8b73b37464687d343493d186660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:22 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:36.504586 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cfd3e0904e14e86b1f17dcdd9dc7c94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.502014 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d63bb9bf79f8478a94283ff271bade64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.505767 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d63bb9bf79f8478a94283ff271bade64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.507002 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c798c79511d749cd8105586d447298de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.509640 10630 raft_consensus.cc:482] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.509754 10630 raft_consensus.cc:504] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.510290 10630 leader_election.cc:288] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.510911 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.511485 9497 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.513809 9814 ts_tablet_manager.cc:1918] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.513965 9814 log.cc:1196] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:36.514349 9814 ts_tablet_manager.cc:1939] T ca7fa45e25b0455e92412b844cd78cdc P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.515563 10677 raft_consensus.cc:482] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.515755 9814 tablet_replica.cc:330] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.515679 10677 raft_consensus.cc:504] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.515916 9814 raft_consensus.cc:2229] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.516036 9814 raft_consensus.cc:2258] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.516196 10677 leader_election.cc:288] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.518026 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:36.520380 9851 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.520500 9851 ts_tablet_manager.cc:1397] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.128s user 0.018s sys 0.037s
I20260928 14:50:36.520946 9814 ts_tablet_manager.cc:1905] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.521186 9851 raft_consensus.cc:348] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.521385 9851 raft_consensus.cc:374] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.521443 9851 raft_consensus.cc:729] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.521513 9815 ts_tablet_manager.cc:1918] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.521636 9815 log.cc:1196] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8234670cb2604ba7b405ad7f70e03a2f
I20260928 14:50:36.521652 9851 consensus_queue.cc:260] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.521921 9815 ts_tablet_manager.cc:1939] T 8234670cb2604ba7b405ad7f70e03a2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.523904 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8234670cb2604ba7b405ad7f70e03a2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
I20260928 14:50:36.524369 9851 ts_tablet_manager.cc:1428] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:36.524613 9851 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:36.525689 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd266b1e19c748f0b743840d44838958 (table default.Table_8a80cd47d41d45419b08ee3777bd0c49 [id=b92aea95f5ce443a8f3c1100fe06d1ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd266b1e19c748f0b743840d44838958 consensus state has no leader
I20260928 14:50:36.526005 9851 tablet_bootstrap.cc:654] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.526357 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9a4a6c21a0824a93acaafa25e1b6e99c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4a6c21a0824a93acaafa25e1b6e99c already in progress: creating tablet
I20260928 14:50:36.531452 10630 raft_consensus.cc:482] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.531569 10630 raft_consensus.cc:504] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.532084 10630 leader_election.cc:288] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.532313 9851 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.532423 9851 ts_tablet_manager.cc:1397] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260928 14:50:36.532578 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:36.532899 9814 ts_tablet_manager.cc:1918] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.532986 9814 log.cc:1196] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/1738a95895914cc4936a38e1d189d538
W20260928 14:50:36.533077 9497 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.533114 9851 raft_consensus.cc:348] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.533272 9814 ts_tablet_manager.cc:1939] T 1738a95895914cc4936a38e1d189d538 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.533288 9851 raft_consensus.cc:374] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.533339 9851 raft_consensus.cc:729] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.533514 9851 consensus_queue.cc:260] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.534037 9814 tablet_replica.cc:330] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.534258 9814 raft_consensus.cc:2229] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.534435 9814 raft_consensus.cc:2258] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.534927 9814 ts_tablet_manager.cc:1905] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.537329 9851 ts_tablet_manager.cc:1428] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:36.540383 9851 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.541922 9851 tablet_bootstrap.cc:654] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.542730 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a2a8aa86e56f421b82a50a72786e472c" } new_table_name: "default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae" modify_external_catalogs: true
W20260928 14:50:36.544157 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 657661b2935b4c1481d8d064427cefbb consensus state has no leader
I20260928 14:50:36.544670 8956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_92419bafe3fe4c55bd4275a007fae26e [id=1692d8fdf9b240f6a1662de9319db005] alter complete (version 4)
I20260928 14:50:36.545143 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9f8702d1414e418e9b4ec21e704f42e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.545430 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8c99043954b44135b9b0bf8d933aed70" } new_table_name: "default.Table_ab7397ce67c74b9cbd9006d89f613d26" modify_external_catalogs: true
W20260928 14:50:36.545768 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f8702d1414e418e9b4ec21e704f42e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.546957 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1a2ab53321d74f28aa5453729e12f9d1
I20260928 14:50:36.547686 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.547588 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8f7f37ac7f7d49e89f6dc96130a356f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.548081 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f7f37ac7f7d49e89f6dc96130a356f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:36.549692 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce402f07c965421dae73355892c328b3 consensus state has no leader
I20260928 14:50:36.555310 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:36.557049 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1a2ab53321d74f28aa5453729e12f9d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a2ab53321d74f28aa5453729e12f9d1 already in progress: creating tablet
I20260928 14:50:36.571195 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.572248 9498 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.572562 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.576967 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fb3a35c7785c4d9688f871b588345ff6" } new_table_name: "default.Table_f26ec6b306324d17822c998752ec5188" modify_external_catalogs: true
I20260928 14:50:36.578763 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:36.579591 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 962a5dee53514f7ab5a63242f7d70446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:36.581070 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f54c1b1f9054e1c9adfda720784e5a8 consensus state has no leader
W20260928 14:50:36.582038 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 151f556d50bc400a9ed4cfbdbbfc84aa consensus state has no leader
W20260928 14:50:36.583019 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96e5111ae94740feb9dd57c7f4f12b2c consensus state has no leader
I20260928 14:50:36.587261 9814 ts_tablet_manager.cc:1918] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.592262 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_63eaefa1d8b94d39b12e005aa93071e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.593011 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63eaefa1d8b94d39b12e005aa93071e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.593633 9814 log.cc:1196] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:36.593581 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dd6a6d295c8340ed89d704184bb78a67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.594053 9814 ts_tablet_manager.cc:1939] T e89035a3d41a4af78a8e7afbdb89c7e0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:36.594219 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd6a6d295c8340ed89d704184bb78a67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.594973 9814 tablet_replica.cc:330] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.595177 9814 raft_consensus.cc:2229] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.595321 9814 raft_consensus.cc:2258] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.596020 9814 ts_tablet_manager.cc:1905] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.601639 9814 ts_tablet_manager.cc:1918] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.601943 10677 raft_consensus.cc:482] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.602080 10677 raft_consensus.cc:504] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.602643 10677 leader_election.cc:288] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.602828 9814 log.cc:1196] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:36.603209 9814 ts_tablet_manager.cc:1939] T afe58ef9809540cb942e3ec44296e36f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.603452 9851 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.603582 9851 ts_tablet_manager.cc:1397] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.063s user 0.043s sys 0.011s
I20260928 14:50:36.604147 9814 tablet_replica.cc:330] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.604363 9814 raft_consensus.cc:2229] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.604382 9851 raft_consensus.cc:348] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.604568 9851 raft_consensus.cc:374] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.604687 9851 raft_consensus.cc:729] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.604897 9851 consensus_queue.cc:260] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.605399 9851 ts_tablet_manager.cc:1428] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:36.605690 9851 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.607138 9851 tablet_bootstrap.cc:654] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.611213 9360 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 0e53b8b73b37464687d343493d186660
I20260928 14:50:36.604535 9814 raft_consensus.cc:2258] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.613200 9814 ts_tablet_manager.cc:1905] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.618566 9814 ts_tablet_manager.cc:1918] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.618898 9814 log.cc:1196] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cbd9f9cb48a945d19420a8bdb9bb9576
I20260928 14:50:36.619234 9814 ts_tablet_manager.cc:1939] T cbd9f9cb48a945d19420a8bdb9bb9576 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.619498 9851 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.619617 9851 ts_tablet_manager.cc:1397] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260928 14:50:36.620086 9814 tablet_replica.cc:330] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.620326 9814 raft_consensus.cc:2229] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.620301 9851 raft_consensus.cc:348] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.620489 9851 raft_consensus.cc:374] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.620556 9851 raft_consensus.cc:729] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.620739 9851 consensus_queue.cc:260] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.621333 9851 ts_tablet_manager.cc:1428] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.621663 9851 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.624838 9851 tablet_bootstrap.cc:654] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.620721 9814 raft_consensus.cc:2258] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.625787 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ba13ee7a68284a0d8ab81d5b234980bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.626186 9814 ts_tablet_manager.cc:1905] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:36.626400 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba13ee7a68284a0d8ab81d5b234980bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.627818 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 (DEFAULT_TABLE table=default.Table_92faa3134f2b4070889eed0ea66a492c [id=3003967200024677afb2bfe13b7b4862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.628196 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d263b3af1ef402b95affbfcd2aa7ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.631193 9814 ts_tablet_manager.cc:1918] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.631275 9814 log.cc:1196] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:36.631518 9814 ts_tablet_manager.cc:1939] T 5f348f9e962748a0992d85b9d3d72aeb P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.631879 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8329927f074163871a1cbe4e0e3c46 (DEFAULT_TABLE table=default.Table_77bf464749b54bcfaa58cb2fb76b9b87 [id=b980558047a14665829a406e0ef8eee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.632176 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8329927f074163871a1cbe4e0e3c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.632225 9814 tablet_replica.cc:330] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.632367 9814 raft_consensus.cc:2229] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.632483 9814 raft_consensus.cc:2258] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.632886 9814 ts_tablet_manager.cc:1905] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.633056 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1a0a47f5370a40a4a8a1d262ef3fed21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.635527 10693 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c253b9f3f43c4b8ba7cd5c7d4edac656" member_type: VOTER last_known_addr { host: "127.8.181.62" port: 43149 } } peers { permanent_uuid: "8d70b1b045bd4ec4b74be2dc2364ecba" member_type: VOTER last_known_addr { host: "127.8.181.61" port: 41417 } } peers { permanent_uuid: "c6b99976d8024a79a0603523b9d32f29" member_type: VOTER last_known_addr { host: "127.8.181.60" port: 39777 } } }
I20260928 14:50:36.635854 10693 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 [sys.catalog]: This master's current role is: LEADER
I20260928 14:50:36.635991 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 72099e766c574246b38acb34ee369d2e (DEFAULT_TABLE table=default.Table_86f2a5aadc32486db869dfe9fc1e6d58 [id=6262637b59374219b7a5a6cf54bcd815]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:36.636161 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a0a47f5370a40a4a8a1d262ef3fed21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.636340 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72099e766c574246b38acb34ee369d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.641796 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 434b85d465f7443fa84043128f18e4c1 (DEFAULT_TABLE table=default.Table_f46823ee6d474a4f8e5b00016a0c0bbe [id=448cace1351741e9a46e9624ffe6d68f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.642087 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434b85d465f7443fa84043128f18e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.646390 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 7e37fa525dd543aea4ae0f55ed2813f4 (DEFAULT_TABLE table=default.Table_74ce8f6b336f44d2b882204b3edae67b [id=38a06314c58d4cd3b47f659dc341af81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.646731 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e37fa525dd543aea4ae0f55ed2813f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.650135 9814 ts_tablet_manager.cc:1918] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.650238 9814 log.cc:1196] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:36.650514 9814 ts_tablet_manager.cc:1939] T d199c65d3b4040388360fd8302d7cb8c P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.651257 9814 tablet_replica.cc:330] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.651417 9814 raft_consensus.cc:2229] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.651540 9814 raft_consensus.cc:2258] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.653908 9814 ts_tablet_manager.cc:1905] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.655908 9498 leader_election.cc:302] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.580924 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 962a5dee53514f7ab5a63242f7d70446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.626113 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 7e37fa525dd543aea4ae0f55ed2813f4 (DEFAULT_TABLE table=default.Table_74ce8f6b336f44d2b882204b3edae67b [id=38a06314c58d4cd3b47f659dc341af81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.656694 9815 tablet_replica.cc:330] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.656818 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e37fa525dd543aea4ae0f55ed2813f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.656865 9815 raft_consensus.cc:2229] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.626453 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 (DEFAULT_TABLE table=default.Table_92faa3134f2b4070889eed0ea66a492c [id=3003967200024677afb2bfe13b7b4862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.657660 10630 raft_consensus.cc:2726] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.657742 9815 raft_consensus.cc:2258] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.657783 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d263b3af1ef402b95affbfcd2aa7ed0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.657972 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 85736us
I20260928 14:50:36.658659 9815 ts_tablet_manager.cc:1905] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.659725 10630 raft_consensus.cc:482] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.659842 10630 raft_consensus.cc:504] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.660447 10630 leader_election.cc:288] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.626742 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8329927f074163871a1cbe4e0e3c46 (DEFAULT_TABLE table=default.Table_77bf464749b54bcfaa58cb2fb76b9b87 [id=b980558047a14665829a406e0ef8eee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.661779 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8329927f074163871a1cbe4e0e3c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.626982 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 72099e766c574246b38acb34ee369d2e (DEFAULT_TABLE table=default.Table_86f2a5aadc32486db869dfe9fc1e6d58 [id=6262637b59374219b7a5a6cf54bcd815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.665771 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72099e766c574246b38acb34ee369d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.667445 9815 ts_tablet_manager.cc:1918] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:36.667529 9815 log.cc:1196] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:36.667865 9815 ts_tablet_manager.cc:1939] T 962a5dee53514f7ab5a63242f7d70446 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:36.650574 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 434b85d465f7443fa84043128f18e4c1 (DEFAULT_TABLE table=default.Table_f46823ee6d474a4f8e5b00016a0c0bbe [id=448cace1351741e9a46e9624ffe6d68f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.669796 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434b85d465f7443fa84043128f18e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.675760 9814 ts_tablet_manager.cc:1918] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.675891 9814 log.cc:1196] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/767958659f4f450497eb5f2a3902993e
I20260928 14:50:36.676184 9814 ts_tablet_manager.cc:1939] T 767958659f4f450497eb5f2a3902993e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.680590 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9afcc868244aeb830fae2735da28d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:36.681280 9497 leader_election.cc:341] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.681674 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_92419bafe3fe4c55bd4275a007fae26e [id=1692d8fdf9b240f6a1662de9319db005]) successfully deleted
I20260928 14:50:36.682428 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b201177c711e44c5b8800158642374e3" } modify_external_catalogs: true
I20260928 14:50:36.682751 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b201177c711e44c5b8800158642374e3" } modify_external_catalogs: true
I20260928 14:50:36.685418 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 (DEFAULT_TABLE table=default.Table_fb80509526ea4cbdb0f2308e95138278 [id=0c8e66be54e940999a2a4dee9bf9083d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.686159 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7dcd72b94fb2427d9e4e57a1cbb291ee" } modify_external_catalogs: true
I20260928 14:50:36.686440 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7dcd72b94fb2427d9e4e57a1cbb291ee" } modify_external_catalogs: true
I20260928 14:50:36.687795 9389 tablet_service.cc:1467] Processing CreateTablet for tablet a9903241fd3b463094fff7bf9c76ed9b (DEFAULT_TABLE table=default.Table_2ef88ab43d2c4684b5abea68667a8686 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.689594 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d593318244002b103f29f10fd02b2 (DEFAULT_TABLE table=default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e [id=b527673a24f8490498dfebc3073b69dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.698195 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet edf76b53ded84392a39c73d7e653615d
I20260928 14:50:36.699214 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5d0fbca4e50f401d8c88395a7002e74d" } modify_external_catalogs: true
I20260928 14:50:36.699470 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5d0fbca4e50f401d8c88395a7002e74d" } modify_external_catalogs: true
I20260928 14:50:36.706552 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c073b27ed9d14c178caa3080ff0737ff
I20260928 14:50:36.707693 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet c073b27ed9d14c178caa3080ff0737ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.708156 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2fdb3daaea744a8b9170325440e81ee7
I20260928 14:50:36.709007 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.711587 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.711901 9814 tablet_replica.cc:330] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.712116 9814 raft_consensus.cc:2229] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.712275 9814 raft_consensus.cc:2258] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.713045 9814 ts_tablet_manager.cc:1905] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.714136 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.716518 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 (DEFAULT_TABLE table=default.Table_fb80509526ea4cbdb0f2308e95138278 [id=0c8e66be54e940999a2a4dee9bf9083d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.717126 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.717366 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0904b4dbbbd2417a88cba0e67e5a31a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.717646 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet c073b27ed9d14c178caa3080ff0737ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.719329 9814 ts_tablet_manager.cc:1918] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.719426 9814 log.cc:1196] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/63cf6b4c153f4fbdb4ffe16f5c91da7a
I20260928 14:50:36.719712 9814 ts_tablet_manager.cc:1939] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.720506 9814 tablet_replica.cc:330] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.720678 9814 raft_consensus.cc:2229] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.720817 9814 raft_consensus.cc:2258] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.721470 9814 ts_tablet_manager.cc:1905] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.722289 9542 tablet_service.cc:1467] Processing CreateTablet for tablet a9903241fd3b463094fff7bf9c76ed9b (DEFAULT_TABLE table=default.Table_2ef88ab43d2c4684b5abea68667a8686 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.722913 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9903241fd3b463094fff7bf9c76ed9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.724195 9498 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.724766 10556 raft_consensus.cc:482] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.724884 10556 raft_consensus.cc:504] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:36.725420 10556 leader_election.cc:288] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:36.726152 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:36.727093 9814 ts_tablet_manager.cc:1918] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.727192 9814 log.cc:1196] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/b9f843006a1e43a49f177433c7a3e1ea
I20260928 14:50:36.727490 9814 ts_tablet_manager.cc:1939] T b9f843006a1e43a49f177433c7a3e1ea P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.729041 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 3cc42a43c9d0483f846a7f11ff1554fe (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.729784 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.725037 9855 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.730368 9855 ts_tablet_manager.cc:1397] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.280s user 0.060s sys 0.118s
I20260928 14:50:36.730437 9814 tablet_replica.cc:330] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.730485 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 514630efd793439fb757ab7f48c93198 (DEFAULT_TABLE table=default.Table_deed66b243364250aaf9cb96c87c879f [id=9fc44ab8edc041cc878941d5069f6fc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.730587 9814 raft_consensus.cc:2229] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.730700 9814 raft_consensus.cc:2258] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.730849 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.729831 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 514630efd793439fb757ab7f48c93198 (DEFAULT_TABLE table=default.Table_deed66b243364250aaf9cb96c87c879f [id=9fc44ab8edc041cc878941d5069f6fc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.731033 9855 raft_consensus.cc:348] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.731220 9855 raft_consensus.cc:374] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.731277 9855 raft_consensus.cc:729] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.730129 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 3cc42a43c9d0483f846a7f11ff1554fe (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.731446 9855 consensus_queue.cc:260] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.731891 9855 ts_tablet_manager.cc:1428] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.732039 9814 ts_tablet_manager.cc:1905] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.732193 9855 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.731230 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514630efd793439fb757ab7f48c93198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.737557 9855 tablet_bootstrap.cc:654] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.738981 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6bff112215814b8ba3d6624bbec772e1 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.739375 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bff112215814b8ba3d6624bbec772e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.741381 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cc42a43c9d0483f846a7f11ff1554fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.742298 9855 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.742409 9855 ts_tablet_manager.cc:1397] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260928 14:50:36.743062 9855 raft_consensus.cc:348] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.743242 9855 raft_consensus.cc:374] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.743283 9855 raft_consensus.cc:729] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.743450 9855 consensus_queue.cc:260] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.743917 9855 ts_tablet_manager.cc:1428] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:36.745369 9855 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.747056 9855 tablet_bootstrap.cc:654] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.748535 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.750747 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 (DEFAULT_TABLE table=default.Table_9b3cdddf432a4e949f2bf5a224730779 [id=658d0532501e46e9b5c8a0558f836abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.752007 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 64ca2326a46e41cb8a0830bee45ba79e (DEFAULT_TABLE table=default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:36.753189 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2fdb3daaea744a8b9170325440e81ee7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fdb3daaea744a8b9170325440e81ee7 already in progress: creating tablet
I20260928 14:50:36.753584 9814 ts_tablet_manager.cc:1918] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.753692 9814 log.cc:1196] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d806161b858145e1a4fa946587ae1529
I20260928 14:50:36.753968 9814 ts_tablet_manager.cc:1939] T d806161b858145e1a4fa946587ae1529 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:36.754176 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c073b27ed9d14c178caa3080ff0737ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c073b27ed9d14c178caa3080ff0737ff already in progress: creating tablet
W20260928 14:50:36.756237 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet edf76b53ded84392a39c73d7e653615d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edf76b53ded84392a39c73d7e653615d already in progress: creating tablet
I20260928 14:50:36.759135 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d593318244002b103f29f10fd02b2 (DEFAULT_TABLE table=default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e [id=b527673a24f8490498dfebc3073b69dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.759539 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d593318244002b103f29f10fd02b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.760511 9251 tablet_service.cc:1467] Processing CreateTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb (DEFAULT_TABLE table=default.Table_78ef16fcfe2e4061882c68341df55233 [id=fe32b488d5a940bd872c6c7dab1e2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.760848 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d6d6db7a1484498c7496ddbdc29fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.764637 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2ab53321d74f28aa5453729e12f9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.765767 9264 tablet_service.cc:1467] Processing CreateTablet for tablet c798c79511d749cd8105586d447298de (DEFAULT_TABLE table=default.Table_e3472c2548ac494e9aa3a10e042f6f0a [id=1db98780e273483389d26c1153aabec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.766114 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c798c79511d749cd8105586d447298de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.767235 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 962a5dee53514f7ab5a63242f7d70446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.767431 9814 tablet_replica.cc:330] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.767592 9814 raft_consensus.cc:2229] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:36.767838 9814 raft_consensus.cc:2258] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.768507 9814 ts_tablet_manager.cc:1905] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.769374 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.771283 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.772336 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0904b4dbbbd2417a88cba0e67e5a31a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.772596 10552 raft_consensus.cc:482] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.772725 10552 raft_consensus.cc:504] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.773247 10552 leader_election.cc:288] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.773833 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ee19746a004a8d95a573e84f2e06b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.774245 9219 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:36.774326 9814 ts_tablet_manager.cc:1918] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:36.774405 9814 log.cc:1196] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:36.774844 9814 ts_tablet_manager.cc:1939] T 962a5dee53514f7ab5a63242f7d70446 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.775602 9814 tablet_replica.cc:330] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.775799 9814 raft_consensus.cc:2229] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.776031 9814 raft_consensus.cc:2258] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.776736 9814 ts_tablet_manager.cc:1905] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.777031 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9903241fd3b463094fff7bf9c76ed9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.780520 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d593318244002b103f29f10fd02b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.784905 9814 ts_tablet_manager.cc:1918] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.785403 9814 log.cc:1196] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c5c6b0867466459ca14413559800ff64
I20260928 14:50:36.785854 9814 ts_tablet_manager.cc:1939] T c5c6b0867466459ca14413559800ff64 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.786926 9814 tablet_replica.cc:330] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.787871 9814 raft_consensus.cc:2229] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.787963 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cc42a43c9d0483f846a7f11ff1554fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.788270 9814 raft_consensus.cc:2258] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.789215 9814 ts_tablet_manager.cc:1905] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.789363 9813 ts_tablet_manager.cc:1918] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.789539 9813 log.cc:1196] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/fd24e60a0e944f6086ff9c9fbe2e8180
I20260928 14:50:36.789875 9813 ts_tablet_manager.cc:1939] T fd24e60a0e944f6086ff9c9fbe2e8180 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.793967 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 7e37fa525dd543aea4ae0f55ed2813f4 (DEFAULT_TABLE table=default.Table_74ce8f6b336f44d2b882204b3edae67b [id=38a06314c58d4cd3b47f659dc341af81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.794076 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8329927f074163871a1cbe4e0e3c46 (DEFAULT_TABLE table=default.Table_77bf464749b54bcfaa58cb2fb76b9b87 [id=b980558047a14665829a406e0ef8eee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.794303 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e37fa525dd543aea4ae0f55ed2813f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.794466 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8329927f074163871a1cbe4e0e3c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.796810 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 (DEFAULT_TABLE table=default.Table_92faa3134f2b4070889eed0ea66a492c [id=3003967200024677afb2bfe13b7b4862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.797097 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d263b3af1ef402b95affbfcd2aa7ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.799706 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 72099e766c574246b38acb34ee369d2e (DEFAULT_TABLE table=default.Table_86f2a5aadc32486db869dfe9fc1e6d58 [id=6262637b59374219b7a5a6cf54bcd815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.799971 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72099e766c574246b38acb34ee369d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.801801 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.804229 9814 ts_tablet_manager.cc:1918] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.805979 9814 log.cc:1196] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:36.806428 9814 ts_tablet_manager.cc:1939] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.807225 9814 tablet_replica.cc:330] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.807909 9814 raft_consensus.cc:2229] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.808275 9814 raft_consensus.cc:2258] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.809150 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 3cc42a43c9d0483f846a7f11ff1554fe (DEFAULT_TABLE table=default.Table_96b6e8f2c5cd403da0aeaae9a7daba11 [id=9421cae9932f403ead0751ce144010cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.809223 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 (DEFAULT_TABLE table=default.Table_fb80509526ea4cbdb0f2308e95138278 [id=0c8e66be54e940999a2a4dee9bf9083d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.809448 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cc42a43c9d0483f846a7f11ff1554fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.573096 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadb919c4554e5c89f8bb19cf3ddd75" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:36.809610 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0904b4dbbbd2417a88cba0e67e5a31a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.809772 9568 raft_consensus.cc:2379] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:36.810581 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 514630efd793439fb757ab7f48c93198 (DEFAULT_TABLE table=default.Table_deed66b243364250aaf9cb96c87c879f [id=9fc44ab8edc041cc878941d5069f6fc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.810859 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514630efd793439fb757ab7f48c93198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.814786 9253 tablet_service.cc:1467] Processing CreateTablet for tablet a9903241fd3b463094fff7bf9c76ed9b (DEFAULT_TABLE table=default.Table_2ef88ab43d2c4684b5abea68667a8686 [id=fd9b9733f0ff4618be7b688a382323a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.815070 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9903241fd3b463094fff7bf9c76ed9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.815042 9814 ts_tablet_manager.cc:1905] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.823390 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6397496f537745d7800ee7ebb76ce3a6" } new_table_name: "default.Table_01fb8b545e2648849deb8c293b3b9cd6" modify_external_catalogs: true
I20260928 14:50:36.823786 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f9a6762f650e4839b51bed6814860eef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.824184 9814 ts_tablet_manager.cc:1918] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.824275 9814 log.cc:1196] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cf9342e920ae48278ab3f3c6d639fc94
W20260928 14:50:36.824354 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9a6762f650e4839b51bed6814860eef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.824939 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_68e8720b58b54dd3af381526ec156fa3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.825413 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68e8720b58b54dd3af381526ec156fa3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.826716 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_22f2a27e142e4b97a331706f380ad184" } new_table_name: "default.Table_5adea8b633fd4e14815af00798dfed4b" modify_external_catalogs: true
I20260928 14:50:36.824576 9814 ts_tablet_manager.cc:1939] T cf9342e920ae48278ab3f3c6d639fc94 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.827919 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_96bb0f27ebd4452697caa25a15d1e9c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.828365 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96bb0f27ebd4452697caa25a15d1e9c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.828963 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d00fe9fe6909464c8a640c3835b41e9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.829324 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812" } modify_external_catalogs: true
W20260928 14:50:36.829438 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d00fe9fe6909464c8a640c3835b41e9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.795594 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514630efd793439fb757ab7f48c93198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.829862 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 632) took 3329 ms. Trace:
I20260928 14:50:36.829937 9813 rpcz_store.cc:276] 0928 14:50:33.500452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.500520 (+ 68us) service_pool.cc:227] Handling call
0928 14:50:36.316072 (+2815552us) ts_tablet_manager.cc:1145] Deleting tablet fd24e60a0e944f6086ff9c9fbe2e8180
0928 14:50:36.316079 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.716701 (+400622us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.789296 (+ 72595us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.829848 (+ 40552us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2804046}
I20260928 14:50:36.830273 9813 tablet_replica.cc:330] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:36.830435 9813 raft_consensus.cc:2229] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.830590 9813 raft_consensus.cc:2258] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.831056 9813 ts_tablet_manager.cc:1905] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.829514 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_17bd44a39c5c4b4ebb809ba0ecb0f812" } modify_external_catalogs: true
I20260928 14:50:36.831331 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_05cd1ada5b9a44ebb16bfd31fe99a519" } new_table_name: "default.Table_15b982ba466a44da9677e93de728c4dc" modify_external_catalogs: true
I20260928 14:50:36.829718 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0ec043b67faf4e26b3d57fae00217781" } new_table_name: "default.Table_6216d1a7c83244c0bd051eabe9b615c3" modify_external_catalogs: true
I20260928 14:50:36.830675 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet fd24e60a0e944f6086ff9c9fbe2e8180 (table default.Table_c10738b4aa7a42c2a6eef90a1999483a [id=9ef3939e8d864755819b15d57ed3b443]) successfully deleted
I20260928 14:50:36.831041 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1320db9993414adfa520046892472dc5" } modify_external_catalogs: true
I20260928 14:50:36.835705 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64ca2326a46e41cb8a0830bee45ba79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.818528 9848 tablet_bootstrap.cc:654] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.730403 9498 leader_election.cc:302] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.840739 10630 raft_consensus.cc:2726] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:36.841029 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 117459us
I20260928 14:50:36.841650 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:36.842123 9360 leader_election.cc:341] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 0e53b8b73b37464687d343493d186660
I20260928 14:50:36.842243 9360 leader_election.cc:302] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.842355 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9afcc868244aeb830fae2735da28d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:36.842437 10556 raft_consensus.cc:2726] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.848515 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 434b85d465f7443fa84043128f18e4c1 (DEFAULT_TABLE table=default.Table_f46823ee6d474a4f8e5b00016a0c0bbe [id=448cace1351741e9a46e9624ffe6d68f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:36.849046 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21ffc5bee62845519a4b7ee8c914e70d consensus state has no leader
I20260928 14:50:36.850659 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434b85d465f7443fa84043128f18e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.851058 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1320db9993414adfa520046892472dc5" } modify_external_catalogs: true
I20260928 14:50:36.854516 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38143067447e44d483568617ab9d9e13" } new_table_name: "default.Table_41d7639fe62a44ceb2de51eab13fa220" modify_external_catalogs: true
I20260928 14:50:36.855816 9360 leader_election.cc:302] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.856025 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.856140 10556 raft_consensus.cc:3037] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.856408 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet c073b27ed9d14c178caa3080ff0737ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.856691 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fdb3daaea744a8b9170325440e81ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:36.857136 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d593318244002b103f29f10fd02b2 (DEFAULT_TABLE table=default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e [id=b527673a24f8490498dfebc3073b69dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.857462 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d593318244002b103f29f10fd02b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.858816 10556 raft_consensus.cc:2726] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.860224 9855 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:36.860433 9855 ts_tablet_manager.cc:1397] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.115s user 0.006s sys 0.003s
I20260928 14:50:36.860730 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 64ca2326a46e41cb8a0830bee45ba79e (DEFAULT_TABLE table=default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.861055 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64ca2326a46e41cb8a0830bee45ba79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.861392 9855 raft_consensus.cc:348] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.861716 9855 raft_consensus.cc:374] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.861815 9855 raft_consensus.cc:729] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.862046 9855 consensus_queue.cc:260] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.862727 9855 ts_tablet_manager.cc:1428] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 14:50:36.863623 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 820a60a83d2a4c32bdb23e600cf60b0d consensus state has no leader
I20260928 14:50:36.864023 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e2aecd527654497da271e99118373258"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.864141 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 (DEFAULT_TABLE table=default.Table_9b3cdddf432a4e949f2bf5a224730779 [id=658d0532501e46e9b5c8a0558f836abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.864429 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ee19746a004a8d95a573e84f2e06b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:36.864526 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2aecd527654497da271e99118373258 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:36.865339 9422 raft_consensus.cc:3037] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.866325 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_20eb3a4cb9204173930667e149a18ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:36.866429 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e3c8ef3e20451dbf91b671655974e5" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.866819 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20eb3a4cb9204173930667e149a18ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:36.867503 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aff7eb9a7ff4ed79305806c30c30627 consensus state has no leader
I20260928 14:50:36.867843 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_49c6b3a78d8c4a1884368286ae9121ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:36.868083 9220 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.868177 9220 leader_election.cc:302] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:36.868263 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49c6b3a78d8c4a1884368286ae9121ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:36.868314 9220 raft_consensus.cc:2670] T 69e3c8ef3e20451dbf91b671655974e5 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:36.869275 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:36.869947 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72cab768a1194a9c9ef3e3ab15d0f449 consensus state has no leader
W20260928 14:50:36.872356 9498 leader_election.cc:341] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.872462 9498 leader_election.cc:302] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.872663 10630 raft_consensus.cc:2726] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.873138 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 (DEFAULT_TABLE table=default.Table_9b3cdddf432a4e949f2bf5a224730779 [id=658d0532501e46e9b5c8a0558f836abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.873477 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 64ca2326a46e41cb8a0830bee45ba79e (DEFAULT_TABLE table=default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:36.876065 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:36.876359 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94ac5cd43c05479f8516fdc0c30cbf22" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:36.876457 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e00bf3d07eeb42219d79326705b3e440
I20260928 14:50:36.877468 9360 leader_election.cc:302] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:36.877866 10556 raft_consensus.cc:2726] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:36.878615 9815 tablet_replica.cc:330] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:36.878842 9815 raft_consensus.cc:2229] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.879017 9815 raft_consensus.cc:2258] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.882352 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:36.882566 9814 tablet_replica.cc:330] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:36.882723 9814 raft_consensus.cc:2229] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.882834 9814 raft_consensus.cc:2258] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.883829 8916 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
/tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.61:41417
--webserver_interface=127.8.181.61
--webserver_port=36355
--builtin_ntp_servers=127.8.181.20:39469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 14:50:36.888278 8948 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:36.888733 9813 ts_tablet_manager.cc:1918] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.888828 9813 log.cc:1196] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/066df778654449bda96f68b5035c4d73
I20260928 14:50:36.889081 9813 ts_tablet_manager.cc:1939] T 066df778654449bda96f68b5035c4d73 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.889328 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 631) took 3388 ms. Trace:
I20260928 14:50:36.890875 9814 ts_tablet_manager.cc:1905] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.895284 9815 ts_tablet_manager.cc:1905] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.895955 9813 rpcz_store.cc:276] 0928 14:50:33.500369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.500855 (+ 486us) service_pool.cc:227] Handling call
0928 14:50:36.830232 (+3329377us) ts_tablet_manager.cc:1145] Deleting tablet 066df778654449bda96f68b5035c4d73
0928 14:50:36.830242 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.885924 (+ 55682us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.888661 (+ 2737us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.889314 (+ 653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3314204}
I20260928 14:50:36.896763 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 066df778654449bda96f68b5035c4d73 (table default.Table_878c137d7b9a413691d0488b19f1441c [id=f1cbc2153e6d42a084c948564e3ac26d]) successfully deleted
I20260928 14:50:36.897086 9813 tablet_replica.cc:330] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:36.899837 9220 consensus_peers.cc:487] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:36.900556 9813 raft_consensus.cc:2229] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:36.900754 9813 raft_consensus.cc:2258] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:36.901513 9813 ts_tablet_manager.cc:1905] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:36.902509 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e99b221268b4c33ab6e32f341eb2d6e consensus state has no leader
I20260928 14:50:36.903216 9814 ts_tablet_manager.cc:1918] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.908350 9813 ts_tablet_manager.cc:1918] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:36.909598 9814 log.cc:1196] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5b695c68118b49359f1899d30208b1b7
I20260928 14:50:36.909991 9814 ts_tablet_manager.cc:1939] T 5b695c68118b49359f1899d30208b1b7 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:36.918360 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ee19746a004a8d95a573e84f2e06b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.922379 9813 log.cc:1196] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6a828130854b4e4e8c44b2b45260e50e
I20260928 14:50:36.922785 9813 ts_tablet_manager.cc:1939] T 6a828130854b4e4e8c44b2b45260e50e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:36.924149 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64ca2326a46e41cb8a0830bee45ba79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:36.928176 9855 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.931109 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 630) took 3430 ms. Trace:
I20260928 14:50:36.931270 9813 rpcz_store.cc:276] 0928 14:50:33.500280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.500890 (+ 610us) service_pool.cc:227] Handling call
0928 14:50:36.897032 (+3396142us) ts_tablet_manager.cc:1145] Deleting tablet 6a828130854b4e4e8c44b2b45260e50e
0928 14:50:36.897042 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.905928 (+ 8886us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.908288 (+ 2360us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:36.931089 (+ 22801us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3377052}
I20260928 14:50:36.931833 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6a828130854b4e4e8c44b2b45260e50e (table default.Table_4f67958edd6b445693683ebf4f469972 [id=135455fa96ab4b05ae173bd269ba5269]) successfully deleted
I20260928 14:50:36.931963 9851 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.927834 9848 tablet_bootstrap.cc:492] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.932080 9851 ts_tablet_manager.cc:1397] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.310s user 0.056s sys 0.085s
I20260928 14:50:36.932260 9848 ts_tablet_manager.cc:1397] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.456s user 0.002s sys 0.002s
I20260928 14:50:36.932746 9851 raft_consensus.cc:348] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.932981 9851 raft_consensus.cc:374] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.933059 9851 raft_consensus.cc:729] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.933285 9851 consensus_queue.cc:260] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.933792 9851 ts_tablet_manager.cc:1428] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:36.934140 9851 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.934557 9848 raft_consensus.cc:348] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.934823 9848 raft_consensus.cc:374] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.934914 9848 raft_consensus.cc:729] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.935146 9848 consensus_queue.cc:260] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.935662 9851 tablet_bootstrap.cc:654] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.936058 9848 ts_tablet_manager.cc:1428] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:36.936599 9848 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.939754 10386 raft_consensus.cc:482] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.939894 10386 raft_consensus.cc:504] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.940423 10386 leader_election.cc:288] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:36.940681 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:36.941078 9220 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.941067 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:36.941322 9568 raft_consensus.cc:2454] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:36.941697 9219 leader_election.cc:302] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.942184 10386 raft_consensus.cc:2781] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:36.942267 10386 raft_consensus.cc:482] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:36.942348 10386 raft_consensus.cc:3037] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.944732 10386 raft_consensus.cc:504] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.946321 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:36.946383 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f9b6cbf2d949839216e807130b2eb9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:36.946494 9567 raft_consensus.cc:3037] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:36.946784 9220 leader_election.cc:341] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:36.948294 9851 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.948405 9851 ts_tablet_manager.cc:1397] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20260928 14:50:36.948920 9567 raft_consensus.cc:2454] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:36.949066 9851 raft_consensus.cc:348] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.949306 9851 raft_consensus.cc:374] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.949401 9851 raft_consensus.cc:729] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.949661 9219 leader_election.cc:302] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:36.949645 9851 consensus_queue.cc:260] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.949919 10552 raft_consensus.cc:2781] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:36.950171 9851 ts_tablet_manager.cc:1428] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:36.950407 9851 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.951241 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet e00bf3d07eeb42219d79326705b3e440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:36.952116 10386 leader_election.cc:288] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:36.952381 9851 tablet_bootstrap.cc:654] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.958452 9851 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.958564 9851 ts_tablet_manager.cc:1397] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260928 14:50:36.959227 9851 raft_consensus.cc:348] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.959415 9851 raft_consensus.cc:374] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.959461 9851 raft_consensus.cc:729] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.959632 9851 consensus_queue.cc:260] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.960457 9851 ts_tablet_manager.cc:1428] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:36.960690 9851 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:36.875905 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 already in progress: creating tablet
W20260928 14:50:36.961421 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 85505.4us
I20260928 14:50:36.961792 9855 tablet_bootstrap.cc:654] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.962522 9851 tablet_bootstrap.cc:654] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.962968 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7aff7724868140b3b544d6b1f237b6fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aff7724868140b3b544d6b1f237b6fa already in progress: creating tablet
I20260928 14:50:36.936331 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 641) took 3364 ms. Trace:
I20260928 14:50:36.965689 9813 rpcz_store.cc:276] 0928 14:50:33.572249 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.711542 (+139293us) service_pool.cc:227] Handling call
0928 14:50:36.936220 (+3224678us) ts_tablet_manager.cc:1145] Deleting tablet 05a9e2d2794545eab75daf61d75272c6
0928 14:50:36.936231 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.936315 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3224351}
W20260928 14:50:36.965788 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1fbc88b53052473895a2d2e63da9be50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fbc88b53052473895a2d2e63da9be50 already in progress: creating tablet
W20260928 14:50:36.966012 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9a4a6c21a0824a93acaafa25e1b6e99c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4a6c21a0824a93acaafa25e1b6e99c already in progress: creating tablet
W20260928 14:50:36.966200 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1e3a9f292618469c8d84da18059419b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3a9f292618469c8d84da18059419b0 already in progress: creating tablet
W20260928 14:50:36.966306 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 05a9e2d2794545eab75daf61d75272c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05a9e2d2794545eab75daf61d75272c6 already in progress: creating tablet
I20260928 14:50:36.966357 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (table default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]) successfully deleted
I20260928 14:50:36.966526 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ca7fa45e25b0455e92412b844cd78cdc (table default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]) successfully deleted
I20260928 14:50:36.966681 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 1738a95895914cc4936a38e1d189d538 (table default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]) successfully deleted
I20260928 14:50:36.966835 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e89035a3d41a4af78a8e7afbdb89c7e0 (table default.Table_81ca6df5fc2849cab83083e994d3627a [id=23a200906c414328a1fdd9624c105637]) successfully deleted
I20260928 14:50:36.966826 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 642) took 3392 ms. Trace:
I20260928 14:50:36.966974 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet afe58ef9809540cb942e3ec44296e36f (table default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]) successfully deleted
I20260928 14:50:36.966954 9813 rpcz_store.cc:276] 0928 14:50:33.574868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.712008 (+137140us) service_pool.cc:227] Handling call
0928 14:50:36.966669 (+3254661us) ts_tablet_manager.cc:1145] Deleting tablet 49d69e4ad9554da9871800c8b392851c
0928 14:50:36.966680 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.966809 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3254303}
I20260928 14:50:36.967137 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cbd9f9cb48a945d19420a8bdb9bb9576 (table default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]) successfully deleted
I20260928 14:50:36.967281 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5f348f9e962748a0992d85b9d3d72aeb (table default.Table_ec53a95de3d2420e8fb0c19d712a61aa [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:36.967442 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d199c65d3b4040388360fd8302d7cb8c (table default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]) successfully deleted
W20260928 14:50:36.967499 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 49d69e4ad9554da9871800c8b392851c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49d69e4ad9554da9871800c8b392851c already in progress: creating tablet
I20260928 14:50:36.967865 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 643) took 3355 ms. Trace:
I20260928 14:50:36.967971 9813 rpcz_store.cc:276] 0928 14:50:33.611948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.712406 (+100458us) service_pool.cc:227] Handling call
0928 14:50:36.967774 (+3255368us) ts_tablet_manager.cc:1145] Deleting tablet f81dfe4d10424288b8b450c62d10a92e
0928 14:50:36.967783 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.967851 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3094840}
W20260928 14:50:36.968410 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f81dfe4d10424288b8b450c62d10a92e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f81dfe4d10424288b8b450c62d10a92e already in progress: creating tablet
I20260928 14:50:36.968477 10630 raft_consensus.cc:482] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:36.968582 10630 raft_consensus.cc:504] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.968768 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 640) took 3404 ms. Trace:
I20260928 14:50:36.969129 9848 tablet_bootstrap.cc:654] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.969110 10630 leader_election.cc:288] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.968829 9813 rpcz_store.cc:276] 0928 14:50:33.563984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:33.676571 (+112587us) service_pool.cc:227] Handling call
0928 14:50:36.968675 (+3292104us) ts_tablet_manager.cc:1145] Deleting tablet 148e81f8add349f2b233862a7049e54c
0928 14:50:36.968685 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.968754 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2922426}
I20260928 14:50:36.969939 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:36.970189 9285 raft_consensus.cc:2454] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
W20260928 14:50:36.970252 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 148e81f8add349f2b233862a7049e54c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148e81f8add349f2b233862a7049e54c already in progress: creating tablet
I20260928 14:50:36.970602 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 653) took 2928 ms. Trace:
I20260928 14:50:36.970626 9497 leader_election.cc:302] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:36.970880 10630 raft_consensus.cc:2781] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:36.970942 10630 raft_consensus.cc:482] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:36.970993 10630 raft_consensus.cc:3037] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.971576 9813 rpcz_store.cc:276] 0928 14:50:34.042313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.257321 (+215008us) service_pool.cc:227] Handling call
0928 14:50:36.970497 (+2713176us) ts_tablet_manager.cc:1145] Deleting tablet bc47ae6fbfca4fc0b0b053d0134a49d0
0928 14:50:36.970506 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.970587 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699720}
W20260928 14:50:36.971958 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ae6fbfca4fc0b0b053d0134a49d0 already in progress: creating tablet
I20260928 14:50:36.972249 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 655) took 2929 ms. Trace:
I20260928 14:50:36.972316 9813 rpcz_store.cc:276] 0928 14:50:34.042543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.271127 (+228584us) service_pool.cc:227] Handling call
0928 14:50:36.972159 (+2701032us) ts_tablet_manager.cc:1145] Deleting tablet 24c45934c64642c2b171cb42544728bc
0928 14:50:36.972168 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.972235 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2700848}
I20260928 14:50:36.972656 9855 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:36.972684 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 24c45934c64642c2b171cb42544728bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24c45934c64642c2b171cb42544728bc already in progress: creating tablet
I20260928 14:50:36.972754 9855 ts_tablet_manager.cc:1397] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.002s
I20260928 14:50:36.972987 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 652) took 2930 ms. Trace:
I20260928 14:50:36.973052 9813 rpcz_store.cc:276] 0928 14:50:34.042167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.255012 (+212845us) service_pool.cc:227] Handling call
0928 14:50:36.972900 (+2717888us) ts_tablet_manager.cc:1145] Deleting tablet d96492abf8cf459a992dd1d7b0226b57
0928 14:50:36.972909 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.972974 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2692251}
I20260928 14:50:36.973289 10630 raft_consensus.cc:504] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:36.973417 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d96492abf8cf459a992dd1d7b0226b57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d96492abf8cf459a992dd1d7b0226b57 already in progress: creating tablet
I20260928 14:50:36.973436 9855 raft_consensus.cc:348] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.973623 9855 raft_consensus.cc:374] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.973670 9855 raft_consensus.cc:729] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.973838 9855 consensus_queue.cc:260] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.974355 10630 leader_election.cc:288] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:36.974802 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:36.974958 9281 raft_consensus.cc:3037] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:36.975148 10552 raft_consensus.cc:686] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:36.975378 10552 consensus_queue.cc:237] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:36.976022 9851 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.976132 9851 ts_tablet_manager.cc:1397] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.005s
I20260928 14:50:36.976778 9851 raft_consensus.cc:348] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.976948 9851 raft_consensus.cc:374] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.976989 9851 raft_consensus.cc:729] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.977164 9851 consensus_queue.cc:260] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.977335 9281 raft_consensus.cc:2454] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:36.977589 9851 ts_tablet_manager.cc:1428] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:36.977707 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 657) took 2895 ms. Trace:
I20260928 14:50:36.977866 9497 leader_election.cc:302] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:36.977823 9813 rpcz_store.cc:276] 0928 14:50:34.082250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.280670 (+198420us) service_pool.cc:227] Handling call
0928 14:50:36.977614 (+2696944us) ts_tablet_manager.cc:1145] Deleting tablet 92d1100b862b4170807be02a39307359
0928 14:50:36.977623 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.977692 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2696792}
I20260928 14:50:36.977814 9851 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:36.978183 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 92d1100b862b4170807be02a39307359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1100b862b4170807be02a39307359 already in progress: creating tablet
I20260928 14:50:36.978493 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 656) took 2935 ms. Trace:
I20260928 14:50:36.978555 9813 rpcz_store.cc:276] 0928 14:50:34.074581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.271328 (+196747us) service_pool.cc:227] Handling call
0928 14:50:36.978410 (+2707082us) ts_tablet_manager.cc:1145] Deleting tablet 2df12117111548beb5d570436e2d6de2
0928 14:50:36.978418 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.978480 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2672994}
W20260928 14:50:36.978915 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2df12117111548beb5d570436e2d6de2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df12117111548beb5d570436e2d6de2 already in progress: creating tablet
I20260928 14:50:36.979218 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 660) took 2777 ms. Trace:
I20260928 14:50:36.979283 9813 rpcz_store.cc:276] 0928 14:50:34.201940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.315022 (+113082us) service_pool.cc:227] Handling call
0928 14:50:36.979114 (+2664092us) ts_tablet_manager.cc:1145] Deleting tablet e92b08254f4041e482e7fa1935dd7071
0928 14:50:36.979123 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.979190 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2636917}
I20260928 14:50:36.979393 9851 tablet_bootstrap.cc:654] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:36.979625 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e92b08254f4041e482e7fa1935dd7071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e92b08254f4041e482e7fa1935dd7071 already in progress: creating tablet
I20260928 14:50:36.979918 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 662) took 2773 ms. Trace:
I20260928 14:50:36.979990 9813 rpcz_store.cc:276] 0928 14:50:34.206675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.326605 (+119930us) service_pool.cc:227] Handling call
0928 14:50:36.979829 (+2653224us) ts_tablet_manager.cc:1145] Deleting tablet d34a235b38aa4e9ba328a7f542342653
0928 14:50:36.979838 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.979905 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2628606}
W20260928 14:50:36.980427 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d34a235b38aa4e9ba328a7f542342653 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d34a235b38aa4e9ba328a7f542342653 already in progress: creating tablet
I20260928 14:50:36.980443 10822 raft_consensus.cc:2781] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:36.980538 10822 raft_consensus.cc:686] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:36.980784 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 663) took 2617 ms. Trace:
I20260928 14:50:36.980726 10822 consensus_queue.cc:237] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.980931 9813 rpcz_store.cc:276] 0928 14:50:34.363387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.378991 (+ 15604us) service_pool.cc:227] Handling call
0928 14:50:36.980695 (+2601704us) ts_tablet_manager.cc:1145] Deleting tablet aaacc1f839914859b23ae755042e02d8
0928 14:50:36.980704 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.980769 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2561421}
W20260928 14:50:36.981544 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet aaacc1f839914859b23ae755042e02d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aaacc1f839914859b23ae755042e02d8 already in progress: creating tablet
I20260928 14:50:36.981828 9855 ts_tablet_manager.cc:1428] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:36.981956 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 665) took 2484 ms. Trace:
I20260928 14:50:36.982069 9813 rpcz_store.cc:276] 0928 14:50:34.497180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.497235 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:36.981816 (+2484581us) ts_tablet_manager.cc:1145] Deleting tablet 9e72d815a218451b884604a1f334d632
0928 14:50:36.981825 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:36.981937 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2484369}
W20260928 14:50:36.982499 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9e72d815a218451b884604a1f334d632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e72d815a218451b884604a1f334d632 already in progress: creating tablet
I20260928 14:50:36.983515 9855 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:36.983708 9813 tablet_replica.cc:330] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:36.984652 9813 raft_consensus.cc:2229] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:36.984823 9855 tablet_bootstrap.cc:654] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.984453 9848 tablet_bootstrap.cc:492] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:36.985037 9848 ts_tablet_manager.cc:1397] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260928 14:50:36.985776 9848 raft_consensus.cc:348] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.986016 9848 raft_consensus.cc:374] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.986116 9848 raft_consensus.cc:729] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.986361 9848 consensus_queue.cc:260] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.987329 9848 ts_tablet_manager.cc:1428] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:36.987599 9848 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:36.988790 9848 tablet_bootstrap.cc:654] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:36.992049 10386 consensus_queue.cc:1035] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:36.992375 8956 catalog_manager.cc:5495] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:36.993296 9851 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:36.993424 9851 ts_tablet_manager.cc:1397] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260928 14:50:36.994104 9851 raft_consensus.cc:348] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.994297 9851 raft_consensus.cc:374] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:36.994340 9851 raft_consensus.cc:729] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:36.994503 9851 consensus_queue.cc:260] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:36.995211 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:36.997658 9851 ts_tablet_manager.cc:1428] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:36.997901 9851 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:36.999341 9851 tablet_bootstrap.cc:654] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.013477 10735 consensus_queue.cc:1035] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:37.013885 10735 consensus_queue.cc:1035] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:37.016793 9851 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.016911 9851 ts_tablet_manager.cc:1397] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260928 14:50:37.017594 9851 raft_consensus.cc:348] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.017795 9851 raft_consensus.cc:374] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.017858 9851 raft_consensus.cc:729] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.018035 9851 consensus_queue.cc:260] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.018502 9851 ts_tablet_manager.cc:1428] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:37.024621 9851 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.025345 10630 raft_consensus.cc:482] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.025488 10630 raft_consensus.cc:504] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.026033 10630 leader_election.cc:288] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.026216 9851 tablet_bootstrap.cc:654] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.032169 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.032985 9497 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.035557 9813 raft_consensus.cc:2258] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.036109 9813 ts_tablet_manager.cc:1905] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.040391 9851 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.040509 9851 ts_tablet_manager.cc:1397] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s
I20260928 14:50:37.041249 9851 raft_consensus.cc:348] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.041442 9851 raft_consensus.cc:374] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.041491 9851 raft_consensus.cc:729] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.041709 9851 consensus_queue.cc:260] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.042248 9851 ts_tablet_manager.cc:1428] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:37.042699 9813 ts_tablet_manager.cc:1918] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:37.042892 9813 log.cc:1196] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f81f1875265642c3a428e658dca558d0
I20260928 14:50:37.043524 9813 ts_tablet_manager.cc:1939] T f81f1875265642c3a428e658dca558d0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.044456 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 664) took 2547 ms. Trace:
I20260928 14:50:37.044620 9813 rpcz_store.cc:276] 0928 14:50:34.497031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.515037 (+ 18006us) service_pool.cc:227] Handling call
0928 14:50:36.983670 (+2468633us) ts_tablet_manager.cc:1145] Deleting tablet f81f1875265642c3a428e658dca558d0
0928 14:50:36.983680 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.039159 (+ 55479us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.042612 (+ 3453us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.044433 (+ 1821us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2468425}
I20260928 14:50:37.045231 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f81f1875265642c3a428e658dca558d0 (table default.Table_039a4d4fbb964bdb995a4b30b21ef7bf [id=5ac524ecad68439eb40c058be3ee262a]) successfully deleted
I20260928 14:50:37.045763 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 666) took 2522 ms. Trace:
I20260928 14:50:37.045899 9813 rpcz_store.cc:276] 0928 14:50:34.523535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.533826 (+ 10291us) service_pool.cc:227] Handling call
0928 14:50:37.045619 (+2511793us) ts_tablet_manager.cc:1145] Deleting tablet 59ced67c921e43e48bcb5195da212582
0928 14:50:37.045633 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.045743 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2511607}
W20260928 14:50:37.046648 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 59ced67c921e43e48bcb5195da212582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ced67c921e43e48bcb5195da212582 already in progress: creating tablet
I20260928 14:50:37.047195 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 667) took 2348 ms. Trace:
I20260928 14:50:37.047326 9813 rpcz_store.cc:276] 0928 14:50:34.699235 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.699283 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:37.047072 (+2347789us) ts_tablet_manager.cc:1145] Deleting tablet 622a7af04be44ddebc1af16fcc6325ae
0928 14:50:37.047086 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.047177 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347617}
W20260928 14:50:37.047777 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 622a7af04be44ddebc1af16fcc6325ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622a7af04be44ddebc1af16fcc6325ae already in progress: creating tablet
I20260928 14:50:37.048241 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 668) took 2348 ms. Trace:
I20260928 14:50:37.048355 9813 rpcz_store.cc:276] 0928 14:50:34.699605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.699646 (+ 41us) service_pool.cc:227] Handling call
0928 14:50:37.048134 (+2348488us) ts_tablet_manager.cc:1145] Deleting tablet ea7b363d546c45ceb3efb9352cf184f4
0928 14:50:37.048146 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.048225 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348346}
W20260928 14:50:37.048805 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ea7b363d546c45ceb3efb9352cf184f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea7b363d546c45ceb3efb9352cf184f4 already in progress: creating tablet
I20260928 14:50:37.049190 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 670) took 2237 ms. Trace:
I20260928 14:50:37.049304 9813 rpcz_store.cc:276] 0928 14:50:34.812028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.812098 (+ 70us) service_pool.cc:227] Handling call
0928 14:50:37.049084 (+2236986us) ts_tablet_manager.cc:1145] Deleting tablet af22f23ff3864620bfefb31b9e899036
0928 14:50:37.049096 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.049175 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2211385}
W20260928 14:50:37.049763 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet af22f23ff3864620bfefb31b9e899036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af22f23ff3864620bfefb31b9e899036 already in progress: creating tablet
I20260928 14:50:37.050148 9813 tablet_replica.cc:330] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.050705 9813 raft_consensus.cc:2229] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.050971 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.051321 9813 raft_consensus.cc:2258] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.051896 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b0e3b18c724493a44c99d990013f34" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:37.052196 9813 ts_tablet_manager.cc:1905] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:36.967600 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 767958659f4f450497eb5f2a3902993e (table default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]) successfully deleted
W20260928 14:50:37.053097 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 85476.9us
I20260928 14:50:37.053362 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
I20260928 14:50:37.053692 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet b9f843006a1e43a49f177433c7a3e1ea (table default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]) successfully deleted
I20260928 14:50:37.054106 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d806161b858145e1a4fa946587ae1529 (table default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]) successfully deleted
W20260928 14:50:37.054395 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1a2ab53321d74f28aa5453729e12f9d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a2ab53321d74f28aa5453729e12f9d1 already in progress: creating tablet
I20260928 14:50:37.054598 9851 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.054920 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_92419bafe3fe4c55bd4275a007fae26e [id=1692d8fdf9b240f6a1662de9319db005]) successfully deleted
I20260928 14:50:37.055212 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c5c6b0867466459ca14413559800ff64 (table default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]) successfully deleted
I20260928 14:50:37.055809 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 69e3c8ef3e20451dbf91b671655974e5 (table default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]) successfully deleted
I20260928 14:50:37.056005 9851 tablet_bootstrap.cc:654] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.056524 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cf9342e920ae48278ab3f3c6d639fc94 (table default.Table_bd5ccd4f42694ce1b58645b61e1a380f [id=9793280eca254a92865bde9e52fe4588]) successfully deleted
W20260928 14:50:37.060127 9498 leader_election.cc:341] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.060482 9851 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.060637 9851 ts_tablet_manager.cc:1397] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
W20260928 14:50:37.060935 9498 leader_election.cc:341] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.061374 9851 raft_consensus.cc:348] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.061651 9851 raft_consensus.cc:374] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.061718 9851 raft_consensus.cc:729] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.061916 9851 consensus_queue.cc:260] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.063735 9855 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.065641 9855 ts_tablet_manager.cc:1397] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.010s
I20260928 14:50:37.066383 9855 raft_consensus.cc:348] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.066622 9855 raft_consensus.cc:374] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.066682 9855 raft_consensus.cc:729] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.066910 9855 consensus_queue.cc:260] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.067767 9855 ts_tablet_manager.cc:1428] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:37.068046 9855 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.069810 9855 tablet_bootstrap.cc:654] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.062459 9851 ts_tablet_manager.cc:1428] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:37.071370 9851 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.067773 9815 ts_tablet_manager.cc:1918] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.072306 9815 log.cc:1196] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:37.072649 9815 ts_tablet_manager.cc:1939] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.054169 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.070118 9848 tablet_bootstrap.cc:492] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.074776 9848 ts_tablet_manager.cc:1397] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.087s user 0.018s sys 0.001s
I20260928 14:50:37.075204 9851 tablet_bootstrap.cc:654] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.075551 9848 raft_consensus.cc:348] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.075752 9848 raft_consensus.cc:374] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.075873 9848 raft_consensus.cc:729] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.076305 9848 consensus_queue.cc:260] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.077116 9848 ts_tablet_manager.cc:1428] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.077433 9848 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.079056 9848 tablet_bootstrap.cc:654] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.083571 9851 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.083694 9851 ts_tablet_manager.cc:1397] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260928 14:50:37.084100 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5b695c68118b49359f1899d30208b1b7 (table default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]) successfully deleted
I20260928 14:50:37.084329 9851 raft_consensus.cc:348] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.084589 9851 raft_consensus.cc:374] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.084651 9851 raft_consensus.cc:729] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:37.084913 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet edf76b53ded84392a39c73d7e653615d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edf76b53ded84392a39c73d7e653615d already in progress: creating tablet
I20260928 14:50:37.084841 9851 consensus_queue.cc:260] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:37.085459 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c073b27ed9d14c178caa3080ff0737ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c073b27ed9d14c178caa3080ff0737ff already in progress: creating tablet
I20260928 14:50:37.086484 9855 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.086619 9855 ts_tablet_manager.cc:1397] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
W20260928 14:50:37.086833 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2fdb3daaea744a8b9170325440e81ee7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fdb3daaea744a8b9170325440e81ee7 already in progress: creating tablet
I20260928 14:50:37.087352 9855 raft_consensus.cc:348] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.087574 9855 raft_consensus.cc:374] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.087638 9855 raft_consensus.cc:729] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.087528 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_537173ecbd8545f3ba14e0fd8c26e60e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.087828 9855 consensus_queue.cc:260] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.088433 9855 ts_tablet_manager.cc:1428] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:37.088667 9851 ts_tablet_manager.cc:1428] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260928 14:50:37.088668 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_537173ecbd8545f3ba14e0fd8c26e60e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.089602 9855 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.090723 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6d36d12d26784400a70cee63450cf110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.091161 9855 tablet_bootstrap.cc:654] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.091226 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d36d12d26784400a70cee63450cf110 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.091822 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet e00bf3d07eeb42219d79326705b3e440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.091908 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet e00bf3d07eeb42219d79326705b3e440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.092186 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 09f92d1f0e69409a8ef355d550cfb52c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.092432 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f04c05cdad04261a1e2ae7e044ddbfb from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.092717 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab7397ce67c74b9cbd9006d89f613d26" } modify_external_catalogs: true
I20260928 14:50:37.092880 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ab7397ce67c74b9cbd9006d89f613d26" } modify_external_catalogs: true
I20260928 14:50:37.093367 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8b65474a1b4b4d50bdce1171e7645814" } modify_external_catalogs: true
I20260928 14:50:37.093538 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8b65474a1b4b4d50bdce1171e7645814" } modify_external_catalogs: true
I20260928 14:50:37.093706 9848 tablet_bootstrap.cc:492] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.093818 9848 ts_tablet_manager.cc:1397] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260928 14:50:37.094228 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c0fd7600a4cc43e097236ff0f5cd78f9" } modify_external_catalogs: true
I20260928 14:50:37.094394 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c0fd7600a4cc43e097236ff0f5cd78f9" } modify_external_catalogs: true
I20260928 14:50:37.094496 9848 raft_consensus.cc:348] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.094698 9848 raft_consensus.cc:374] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.094755 9848 raft_consensus.cc:729] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.094935 9848 consensus_queue.cc:260] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.094991 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c2b58c2fedfe482aa60fc8268d18df36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.095424 9848 ts_tablet_manager.cc:1428] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260928 14:50:37.095456 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b58c2fedfe482aa60fc8268d18df36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.100317 9851 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.100770 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.101012 9814 tablet_replica.cc:330] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.101204 9814 raft_consensus.cc:2229] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.101356 9814 raft_consensus.cc:2258] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.101619 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.102161 9814 ts_tablet_manager.cc:1905] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.103066 9851 tablet_bootstrap.cc:654] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.108503 9814 ts_tablet_manager.cc:1918] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.108662 9814 log.cc:1196] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f1dacb0eef514609bcaf503ccc9845e3
I20260928 14:50:37.109025 9814 ts_tablet_manager.cc:1939] T f1dacb0eef514609bcaf503ccc9845e3 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.110106 9814 tablet_replica.cc:330] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.110358 9814 raft_consensus.cc:2229] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.110539 9814 raft_consensus.cc:2258] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.111315 9814 ts_tablet_manager.cc:1905] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.112147 9855 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.112286 9855 ts_tablet_manager.cc:1397] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20260928 14:50:37.113114 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 6bff112215814b8ba3d6624bbec772e1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.113122 9855 raft_consensus.cc:348] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.113319 9855 raft_consensus.cc:374] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.113379 9855 raft_consensus.cc:729] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.113576 9855 consensus_queue.cc:260] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.114109 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 9dd00b9377b245a29d2a6735248112bc from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.114200 9855 ts_tablet_manager.cc:1428] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:37.114466 9855 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.114503 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (table default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]) successfully deleted
W20260928 14:50:37.114749 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e00bf3d07eeb42219d79326705b3e440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00bf3d07eeb42219d79326705b3e440 already in progress: creating tablet
I20260928 14:50:37.116024 9855 tablet_bootstrap.cc:654] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.121670 9813 ts_tablet_manager.cc:1918] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.121902 9813 log.cc:1196] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/88015bcd867e40e5b9263930e820074a
W20260928 14:50:37.122437 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e00bf3d07eeb42219d79326705b3e440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00bf3d07eeb42219d79326705b3e440 already in progress: creating tablet
I20260928 14:50:37.122848 9813 ts_tablet_manager.cc:1939] T 88015bcd867e40e5b9263930e820074a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.124953 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f1dacb0eef514609bcaf503ccc9845e3 (table default.Table_179a0cdc7fb945369cf32b7380fb39fe [id=406fbbcbe232457bbe03bfe66ec127f3]) successfully deleted
I20260928 14:50:37.128257 9851 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.128432 9851 ts_tablet_manager.cc:1397] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.001s
I20260928 14:50:37.129185 9851 raft_consensus.cc:348] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.129457 9851 raft_consensus.cc:374] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.129667 9851 raft_consensus.cc:729] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.129933 9851 consensus_queue.cc:260] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.130465 9851 ts_tablet_manager.cc:1428] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.131649 9851 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.134478 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:37.134763 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:37.136029 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2898a032e1488b98c31b5e83371a71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.136792 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dbb8d20e6b3347098f4550902d7d6ce4" } new_table_name: "default.Table_46d9270039b54ce2bf37ad096b1afb95" modify_external_catalogs: true
I20260928 14:50:37.134343 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.134546 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.142932 9851 tablet_bootstrap.cc:654] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.143251 9814 ts_tablet_manager.cc:1918] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.143348 9814 log.cc:1196] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7ef356a4c9d34af4b300d38eab49a569
I20260928 14:50:37.143649 9814 ts_tablet_manager.cc:1939] T 7ef356a4c9d34af4b300d38eab49a569 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.144651 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac1562423dd45748bc9ad324f432fb7 (DEFAULT_TABLE table=default.Table_63eaefa1d8b94d39b12e005aa93071e7 [id=721cbd2efc1f44679599e359f9752ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.144909 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7ef356a4c9d34af4b300d38eab49a569 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
I20260928 14:50:37.145027 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac1562423dd45748bc9ad324f432fb7 (DEFAULT_TABLE table=default.Table_63eaefa1d8b94d39b12e005aa93071e7 [id=721cbd2efc1f44679599e359f9752ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.145385 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac1562423dd45748bc9ad324f432fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.146123 9814 tablet_replica.cc:330] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.146328 9814 raft_consensus.cc:2229] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.146561 9814 raft_consensus.cc:2258] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.146777 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 01dd30e15c31498299ca5f5a3b2770e9 (table default.Table_a392303bc8344306bf5c1d8815194bf4 [id=b58aea2205304defa62befcee84dfa0f]). Expected version 1 got 0
I20260928 14:50:37.148177 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac1562423dd45748bc9ad324f432fb7 (DEFAULT_TABLE table=default.Table_63eaefa1d8b94d39b12e005aa93071e7 [id=721cbd2efc1f44679599e359f9752ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.148521 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac1562423dd45748bc9ad324f432fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.149844 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 903e831b51e14c789fb28f90881d935a (DEFAULT_TABLE table=default.Table_8f7f37ac7f7d49e89f6dc96130a356f7 [id=47338eb6d75d41c7a5039509e1389ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.150138 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903e831b51e14c789fb28f90881d935a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.153620 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f79fcac805b42ba8b66949fbdfeb8f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.153966 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.154181 9815 tablet_replica.cc:330] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.154342 9815 raft_consensus.cc:2229] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.154458 9815 raft_consensus.cc:2258] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.155246 9815 ts_tablet_manager.cc:1905] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.157166 9814 ts_tablet_manager.cc:1905] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.160984 10817 raft_consensus.cc:482] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.161170 10817 raft_consensus.cc:504] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.162274 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:37.162282 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.162469 9568 raft_consensus.cc:2454] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:37.162688 10817 leader_election.cc:288] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:37.162738 9220 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.162915 9219 leader_election.cc:302] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.163323 9814 ts_tablet_manager.cc:1918] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.163421 9814 log.cc:1196] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:37.163726 9814 ts_tablet_manager.cc:1939] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.163970 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:37.164297 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:37.164520 9815 ts_tablet_manager.cc:1918] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.164670 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (table default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]) successfully deleted
I20260928 14:50:37.164816 9815 log.cc:1196] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:37.164623 8949 catalog_manager.cc:5495] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:37.164944 9814 tablet_replica.cc:330] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.165112 9814 raft_consensus.cc:2229] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.165232 9814 raft_consensus.cc:2258] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.165653 9815 ts_tablet_manager.cc:1939] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.165990 9814 ts_tablet_manager.cc:1905] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.166765 10817 raft_consensus.cc:2781] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:37.167364 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (table default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]) successfully deleted
I20260928 14:50:37.167047 10817 raft_consensus.cc:482] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:37.167820 10817 raft_consensus.cc:3037] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.171837 10839 tablet.cc:1722] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:37.171676 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 903e831b51e14c789fb28f90881d935a (DEFAULT_TABLE table=default.Table_8f7f37ac7f7d49e89f6dc96130a356f7 [id=47338eb6d75d41c7a5039509e1389ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.174506 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 903e831b51e14c789fb28f90881d935a (DEFAULT_TABLE table=default.Table_8f7f37ac7f7d49e89f6dc96130a356f7 [id=47338eb6d75d41c7a5039509e1389ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.174943 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903e831b51e14c789fb28f90881d935a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.180505 9848 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.181095 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 60ede1d7f93047b08e043aa32213cd05 (DEFAULT_TABLE table=default.Table_ba13ee7a68284a0d8ab81d5b234980bf [id=4a75237f98c24530a3a7dac8fe252986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.181517 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ede1d7f93047b08e043aa32213cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.181968 9848 tablet_bootstrap.cc:654] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.185441 9814 ts_tablet_manager.cc:1918] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.186233 9814 log.cc:1196] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5fc978ea3a194282aacc6ede22076c21
I20260928 14:50:37.186734 9814 ts_tablet_manager.cc:1939] T 5fc978ea3a194282aacc6ede22076c21 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.188074 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 675) took 2309 ms. Trace:
I20260928 14:50:37.188146 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5fc978ea3a194282aacc6ede22076c21 (table default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]) successfully deleted
I20260928 14:50:37.188211 9813 rpcz_store.cc:276] 0928 14:50:34.878129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.878208 (+ 79us) service_pool.cc:227] Handling call
0928 14:50:37.050104 (+2171896us) ts_tablet_manager.cc:1145] Deleting tablet 88015bcd867e40e5b9263930e820074a
0928 14:50:37.050116 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.093204 (+ 43088us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.121571 (+ 28367us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.188046 (+ 66475us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2171700}
I20260928 14:50:37.188745 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 672) took 2310 ms. Trace:
I20260928 14:50:37.188882 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 88015bcd867e40e5b9263930e820074a (table default.Table_67d8c754b00c4bc083809df338bf770a [id=7fd5a79e3eaa4dbc8db6bf05ff22aa36]) successfully deleted
I20260928 14:50:37.188869 9813 rpcz_store.cc:276] 0928 14:50:34.877820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.890298 (+ 12478us) service_pool.cc:227] Handling call
0928 14:50:37.188625 (+2298327us) ts_tablet_manager.cc:1145] Deleting tablet a2d5a67ec9ce403d91ef1f6d52380b96
0928 14:50:37.188635 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.188730 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2298109}
I20260928 14:50:37.189177 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 674) took 2311 ms. Trace:
I20260928 14:50:37.189239 9813 rpcz_store.cc:276] 0928 14:50:34.878027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:34.895462 (+ 17435us) service_pool.cc:227] Handling call
0928 14:50:37.189090 (+2293628us) ts_tablet_manager.cc:1145] Deleting tablet 6e5ad3ee185f47c3b8b3deb4ac354f51
0928 14:50:37.189099 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.189165 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2278521}
W20260928 14:50:37.189427 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a2d5a67ec9ce403d91ef1f6d52380b96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2d5a67ec9ce403d91ef1f6d52380b96 already in progress: creating tablet
I20260928 14:50:37.189468 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 686) took 2081 ms. Trace:
I20260928 14:50:37.189540 9813 rpcz_store.cc:276] 0928 14:50:35.107980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.108844 (+ 864us) service_pool.cc:227] Handling call
0928 14:50:37.189400 (+2080556us) ts_tablet_manager.cc:1145] Deleting tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f
0928 14:50:37.189407 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.189459 (+ 52us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2080260}
I20260928 14:50:37.189730 9813 tablet_replica.cc:330] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.189939 9813 raft_consensus.cc:2229] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:37.190027 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 already in progress: creating tablet
I20260928 14:50:37.190124 9813 raft_consensus.cc:2258] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:37.190277 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f already in progress: creating tablet
I20260928 14:50:37.190563 9813 ts_tablet_manager.cc:1905] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.192145 10630 raft_consensus.cc:482] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.192313 10630 raft_consensus.cc:504] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.192893 10630 leader_election.cc:288] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.193624 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.194443 9497 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:37.195333 9498 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.195472 9498 leader_election.cc:302] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.195935 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 60ede1d7f93047b08e043aa32213cd05 (DEFAULT_TABLE table=default.Table_ba13ee7a68284a0d8ab81d5b234980bf [id=4a75237f98c24530a3a7dac8fe252986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.199538 10677 raft_consensus.cc:482] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.199700 10677 raft_consensus.cc:504] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.200852 10677 leader_election.cc:288] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.201104 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.199681 10817 raft_consensus.cc:504] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.202394 9256 tablet_service.cc:1467] Processing CreateTablet for tablet ffa3fa2fab7c46419e5b13a933631295 (DEFAULT_TABLE table=default.Table_9f8702d1414e418e9b4ec21e704f42e2 [id=42cf26c806aa4fd88202ec7a4da43b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.204316 10677 raft_consensus.cc:482] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.204481 10677 raft_consensus.cc:504] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.206785 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac1562423dd45748bc9ad324f432fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.206449 9405 tablet_service.cc:1467] Processing CreateTablet for tablet ffa3fa2fab7c46419e5b13a933631295 (DEFAULT_TABLE table=default.Table_9f8702d1414e418e9b4ec21e704f42e2 [id=42cf26c806aa4fd88202ec7a4da43b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.207264 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa3fa2fab7c46419e5b13a933631295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.205636 10677 leader_election.cc:288] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.207509 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ede1d7f93047b08e043aa32213cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.207686 10386 raft_consensus.cc:482] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.207828 10386 raft_consensus.cc:504] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.208346 10386 leader_election.cc:288] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:37.209882 9219 leader_election.cc:341] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:37.210289 10848 tablet.cc:1722] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:37.211843 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba281355b2f44b77a4ff99d49c084162" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.212239 9220 leader_election.cc:341] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.212324 9220 leader_election.cc:302] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.212623 10386 raft_consensus.cc:2726] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.213656 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903e831b51e14c789fb28f90881d935a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.220546 9360 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:37.222280 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:37.222708 9220 leader_election.cc:341] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.222893 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa3fa2fab7c46419e5b13a933631295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.227257 10817 leader_election.cc:288] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:37.227452 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.227790 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5a14312acc4de39e72ac15cf74fcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.228389 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.228861 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5a14312acc4de39e72ac15cf74fcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.231612 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 531ebf7e1f6c4ed385f77e5360384b16 (DEFAULT_TABLE table=default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b [id=a9a508e1f7f34416abecb1067d79bd67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.231937 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 531ebf7e1f6c4ed385f77e5360384b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.232700 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 531ebf7e1f6c4ed385f77e5360384b16 (DEFAULT_TABLE table=default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b [id=a9a508e1f7f34416abecb1067d79bd67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.233058 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 531ebf7e1f6c4ed385f77e5360384b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.245481 9261 tablet_service.cc:1467] Processing CreateTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed (DEFAULT_TABLE table=default.Table_b072b55c076c496b981860d100357f44 [id=b3107a46df0a4c618dc400c822f6cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.245896 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.248811 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66096599d4c5458db2af10eb9bac947b consensus state has no leader
I20260928 14:50:37.248888 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 09f92d1f0e69409a8ef355d550cfb52c
I20260928 14:50:37.249284 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 09f92d1f0e69409a8ef355d550cfb52c deleted and replaced by tablet 7172211cb181487a98a1562c371635ef
I20260928 14:50:37.252646 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 02d0fce7d3444063a6dcfec9538f4f66
I20260928 14:50:37.253225 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_70b9cb8130704fd18757a75e660fdff0" } new_table_name: "default.Table_52258893962143c899c6c1266d78916f" modify_external_catalogs: true
I20260928 14:50:37.254093 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.254617 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 151f556d50bc400a9ed4cfbdbbfc84aa
I20260928 14:50:37.255164 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_86f2a5aadc32486db869dfe9fc1e6d58" } new_table_name: "default.Table_b2d22944e23f419c973b10049b217b0f" modify_external_catalogs: true
I20260928 14:50:37.255373 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.256172 9851 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.256294 9851 ts_tablet_manager.cc:1397] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.003s
I20260928 14:50:37.257009 9851 raft_consensus.cc:348] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.257182 9851 raft_consensus.cc:374] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.257234 9851 raft_consensus.cc:729] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.257604 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.257411 9851 consensus_queue.cc:260] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.258101 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.258175 9851 ts_tablet_manager.cc:1428] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.258473 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8d4c62e8168e4db684e75af5228f1201"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.258975 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d4c62e8168e4db684e75af5228f1201 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.259250 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c with delete_type TABLET_DATA_DELETED (replaced by tablet 7172211cb181487a98a1562c371635ef) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:37.259899 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 151f556d50bc400a9ed4cfbdbbfc84aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 151f556d50bc400a9ed4cfbdbbfc84aa already in progress: creating tablet
W20260928 14:50:37.260178 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 02d0fce7d3444063a6dcfec9538f4f66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02d0fce7d3444063a6dcfec9538f4f66 already in progress: creating tablet
W20260928 14:50:37.260425 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 09f92d1f0e69409a8ef355d550cfb52c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f92d1f0e69409a8ef355d550cfb52c already in progress: creating tablet
I20260928 14:50:37.260553 9400 tablet_service.cc:1467] Processing CreateTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed (DEFAULT_TABLE table=default.Table_b072b55c076c496b981860d100357f44 [id=b3107a46df0a4c618dc400c822f6cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.260881 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.261503 9851 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.263113 9851 tablet_bootstrap.cc:654] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.264341 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 02952f7c70ff42068c0e066018329453 (DEFAULT_TABLE table=default.Table_1a0a47f5370a40a4a8a1d262ef3fed21 [id=bf6f7c5232ea446f88bc903a1603436a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.264547 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c with delete_type TABLET_DATA_DELETED (replaced by tablet 7172211cb181487a98a1562c371635ef) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.264792 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02952f7c70ff42068c0e066018329453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.264808 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 02952f7c70ff42068c0e066018329453 (DEFAULT_TABLE table=default.Table_1a0a47f5370a40a4a8a1d262ef3fed21 [id=bf6f7c5232ea446f88bc903a1603436a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.265128 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02952f7c70ff42068c0e066018329453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.199060 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 60ede1d7f93047b08e043aa32213cd05 (DEFAULT_TABLE table=default.Table_ba13ee7a68284a0d8ab81d5b234980bf [id=4a75237f98c24530a3a7dac8fe252986]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:37.269107 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 73773.4us
I20260928 14:50:37.269181 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60ede1d7f93047b08e043aa32213cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.269387 10822 raft_consensus.cc:2726] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.269634 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.272994 9855 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.273145 9855 ts_tablet_manager.cc:1397] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.159s user 0.024s sys 0.015s
I20260928 14:50:37.222499 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:37.273622 9568 raft_consensus.cc:3037] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.273888 9855 raft_consensus.cc:348] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.274060 9855 raft_consensus.cc:374] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.274102 9855 raft_consensus.cc:729] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.274291 9855 consensus_queue.cc:260] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.275892 9568 raft_consensus.cc:2454] T c556381a95fa42e284dab68a7f401e63 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:37.226379 9542 tablet_service.cc:1467] Processing CreateTablet for tablet ffa3fa2fab7c46419e5b13a933631295 (DEFAULT_TABLE table=default.Table_9f8702d1414e418e9b4ec21e704f42e2 [id=42cf26c806aa4fd88202ec7a4da43b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.276340 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa3fa2fab7c46419e5b13a933631295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.278815 9855 ts_tablet_manager.cc:1428] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260928 14:50:37.279054 9855 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.279589 9219 leader_election.cc:302] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.280455 9855 tablet_bootstrap.cc:654] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.281551 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d21f615343473a95cd1f5040aebc79" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:37.283228 10386 raft_consensus.cc:2781] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:37.283360 10386 raft_consensus.cc:686] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:37.283555 10386 consensus_queue.cc:237] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.283938 10817 raft_consensus.cc:482] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.284039 10817 raft_consensus.cc:504] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:37.285620 9219 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:37.286157 10817 leader_election.cc:288] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.230595 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.239683 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 531ebf7e1f6c4ed385f77e5360384b16 (DEFAULT_TABLE table=default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b [id=a9a508e1f7f34416abecb1067d79bd67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.286358 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cadfdf093ab04b61af441cff6c9c510b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.286631 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 531ebf7e1f6c4ed385f77e5360384b16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.288707 9498 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.288800 9498 leader_election.cc:302] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.251771 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f92d1f0e69409a8ef355d550cfb52c with delete_type TABLET_DATA_DELETED (replaced by tablet 7172211cb181487a98a1562c371635ef) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.252880 9534 tablet_service.cc:1467] Processing CreateTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed (DEFAULT_TABLE table=default.Table_b072b55c076c496b981860d100357f44 [id=b3107a46df0a4c618dc400c822f6cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.254359 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d0fce7d3444063a6dcfec9538f4f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.255821 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 151f556d50bc400a9ed4cfbdbbfc84aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.289865 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.290365 10850 tablet.cc:1722] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:37.291244 10822 raft_consensus.cc:2726] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:37.293861 9220 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.293957 9220 leader_election.cc:302] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:37.294824 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 09f92d1f0e69409a8ef355d550cfb52c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f92d1f0e69409a8ef355d550cfb52c already in progress: creating tablet
W20260928 14:50:37.295277 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 02d0fce7d3444063a6dcfec9538f4f66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02d0fce7d3444063a6dcfec9538f4f66 already in progress: creating tablet
W20260928 14:50:37.295516 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 151f556d50bc400a9ed4cfbdbbfc84aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 151f556d50bc400a9ed4cfbdbbfc84aa already in progress: creating tablet
I20260928 14:50:37.295908 10677 raft_consensus.cc:482] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.296018 10677 raft_consensus.cc:504] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.296905 10677 leader_election.cc:288] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.297694 9848 tablet_bootstrap.cc:492] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.297869 9848 ts_tablet_manager.cc:1397] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.000s
I20260928 14:50:37.298585 9848 raft_consensus.cc:348] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:37.298858 9848 raft_consensus.cc:374] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.298961 9848 raft_consensus.cc:729] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.299018 10386 raft_consensus.cc:2726] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.299220 9848 consensus_queue.cc:260] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:37.300175 9848 ts_tablet_manager.cc:1428] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:37.301127 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5a14312acc4de39e72ac15cf74fcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.300489 9848 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.303373 9848 tablet_bootstrap.cc:654] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.305335 9360 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:37.309378 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 02952f7c70ff42068c0e066018329453 (DEFAULT_TABLE table=default.Table_1a0a47f5370a40a4a8a1d262ef3fed21 [id=bf6f7c5232ea446f88bc903a1603436a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.309813 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02952f7c70ff42068c0e066018329453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.311004 9360 leader_election.cc:302] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:37.311525 9360 leader_election.cc:341] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8f79fcac805b42ba8b66949fbdfeb8f6
I20260928 14:50:37.311625 9360 leader_election.cc:302] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.311896 10813 raft_consensus.cc:2726] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.312011 10813 raft_consensus.cc:2726] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:37.314029 9360 leader_election.cc:341] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:37.314131 9360 leader_election.cc:302] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.314438 10813 raft_consensus.cc:2726] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.314399 9251 tablet_service.cc:1467] Processing CreateTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc (DEFAULT_TABLE table=default.Table_dd6a6d295c8340ed89d704184bb78a67 [id=2ce00cd4c7af42949c4d833e536b60ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.314739 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba96eb0f6c0141ee96e30496cbb19edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.315371 9538 tablet_service.cc:1467] Processing CreateTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc (DEFAULT_TABLE table=default.Table_dd6a6d295c8340ed89d704184bb78a67 [id=2ce00cd4c7af42949c4d833e536b60ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.315639 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba96eb0f6c0141ee96e30496cbb19edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.318449 9813 ts_tablet_manager.cc:1918] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.318610 9813 log.cc:1196] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/3c2b819b194d4373a59a3e94267361c1
I20260928 14:50:37.318972 9813 ts_tablet_manager.cc:1939] T 3c2b819b194d4373a59a3e94267361c1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.319746 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 687) took 2205 ms. Trace:
I20260928 14:50:37.320041 9813 rpcz_store.cc:276] 0928 14:50:35.113983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.119186 (+ 5203us) service_pool.cc:227] Handling call
0928 14:50:37.189699 (+2070513us) ts_tablet_manager.cc:1145] Deleting tablet 3c2b819b194d4373a59a3e94267361c1
0928 14:50:37.189707 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.229253 (+ 39546us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.318359 (+ 89106us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.319727 (+ 1368us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2064027}
I20260928 14:50:37.320490 9813 tablet_replica.cc:330] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.320645 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 3c2b819b194d4373a59a3e94267361c1 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
I20260928 14:50:37.321125 9813 raft_consensus.cc:2229] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.324779 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2b92039b9a484a768efa3714b58248ef
I20260928 14:50:37.333143 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:37.333479 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 9f04c05cdad04261a1e2ae7e044ddbfb deleted and replaced by tablet 99e54a175c104f9db590e6fd9ef72838
I20260928 14:50:37.333925 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3a9c2739592a40cbaad31dd1fab6cdcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.334437 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a9c2739592a40cbaad31dd1fab6cdcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.335511 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e5cb151d58f545d9b1e6f652a0627ab9
I20260928 14:50:37.335579 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6bff112215814b8ba3d6624bbec772e1
I20260928 14:50:37.335990 8950 catalog_manager.cc:6565] ReplaceTablet: tablet 6bff112215814b8ba3d6624bbec772e1 deleted and replaced by tablet 6b35670ba2044b58a524847f77d4f822
I20260928 14:50:37.336027 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_db0f7c5aa84347d0890c3d590e0d4262" } new_table_name: "default.Table_00e707318baf4eba804d087dd4489c97" modify_external_catalogs: true
I20260928 14:50:37.336339 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cfec9f0b9b0f4287bcba0cd09123f4cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.336912 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfec9f0b9b0f4287bcba0cd09123f4cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.337098 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9dd00b9377b245a29d2a6735248112bc
I20260928 14:50:37.337419 8951 catalog_manager.cc:6565] ReplaceTablet: tablet 9dd00b9377b245a29d2a6735248112bc deleted and replaced by tablet c69091fb32fc47a6a4648f1b4b11356f
I20260928 14:50:37.337603 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet ca7fa45e25b0455e92412b844cd78cdc from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.338093 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_02e5b36a67804830879c207d98f45dda" } modify_external_catalogs: true
I20260928 14:50:37.338263 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_02e5b36a67804830879c207d98f45dda" } modify_external_catalogs: true
W20260928 14:50:37.339367 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb9c9ea18f2046a080aca899f51f6759 consensus state has no leader
I20260928 14:50:37.339653 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_74ce8f6b336f44d2b882204b3edae67b" } new_table_name: "default.Table_6ed5cdcb675541eca4e4e659fecabc93" modify_external_catalogs: true
W20260928 14:50:37.340755 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72099e766c574246b38acb34ee369d2e consensus state has no leader
I20260928 14:50:37.341128 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bff112215814b8ba3d6624bbec772e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b35670ba2044b58a524847f77d4f822) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.341142 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_06baad6c6fe448b2a3cd1e0bb6c8f71d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.341658 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06baad6c6fe448b2a3cd1e0bb6c8f71d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.341976 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd00b9377b245a29d2a6735248112bc with delete_type TABLET_DATA_DELETED (replaced by tablet c69091fb32fc47a6a4648f1b4b11356f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.342584 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.342753 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.344173 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.344297 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.344421 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.344579 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd00b9377b245a29d2a6735248112bc with delete_type TABLET_DATA_DELETED (replaced by tablet c69091fb32fc47a6a4648f1b4b11356f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.345163 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bff112215814b8ba3d6624bbec772e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b35670ba2044b58a524847f77d4f822) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.345103 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5b331f1608b64602b1a450728d95f2a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.345552 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b331f1608b64602b1a450728d95f2a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.348701 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
I20260928 14:50:37.348862 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:37.349021 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:37.350493 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.350739 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.350924 9814 tablet_replica.cc:330] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:37.350999 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.351095 9814 raft_consensus.cc:2229] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.351248 9814 raft_consensus.cc:2258] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.351277 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:37.351365 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2b92039b9a484a768efa3714b58248ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b92039b9a484a768efa3714b58248ef already in progress: creating tablet
W20260928 14:50:37.351595 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9f04c05cdad04261a1e2ae7e044ddbfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f04c05cdad04261a1e2ae7e044ddbfb already in progress: creating tablet
I20260928 14:50:37.351645 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:37.351817 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e5cb151d58f545d9b1e6f652a0627ab9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5cb151d58f545d9b1e6f652a0627ab9 already in progress: creating tablet
W20260928 14:50:37.352017 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9dd00b9377b245a29d2a6735248112bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dd00b9377b245a29d2a6735248112bc already in progress: creating tablet
I20260928 14:50:37.352137 9814 ts_tablet_manager.cc:1905] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:37.352252 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6bff112215814b8ba3d6624bbec772e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bff112215814b8ba3d6624bbec772e1 already in progress: creating tablet
W20260928 14:50:37.352471 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6bff112215814b8ba3d6624bbec772e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bff112215814b8ba3d6624bbec772e1 already in progress: creating tablet
W20260928 14:50:37.352658 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9dd00b9377b245a29d2a6735248112bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dd00b9377b245a29d2a6735248112bc already in progress: creating tablet
W20260928 14:50:37.352845 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9f04c05cdad04261a1e2ae7e044ddbfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f04c05cdad04261a1e2ae7e044ddbfb already in progress: creating tablet
W20260928 14:50:37.353022 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e5cb151d58f545d9b1e6f652a0627ab9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5cb151d58f545d9b1e6f652a0627ab9 already in progress: creating tablet
I20260928 14:50:37.357796 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
I20260928 14:50:37.358034 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 5fcdce2cb90344e0a1e0e68d703e9034 (DEFAULT_TABLE table=default.Table_7cfd3e0904e14e86b1f17dcdd9dc7c94 [id=81651ab2460543cd8d695f4ac0b17e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.358398 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fcdce2cb90344e0a1e0e68d703e9034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.358346 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 5fcdce2cb90344e0a1e0e68d703e9034 (DEFAULT_TABLE table=default.Table_7cfd3e0904e14e86b1f17dcdd9dc7c94 [id=81651ab2460543cd8d695f4ac0b17e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.358695 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fcdce2cb90344e0a1e0e68d703e9034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.358723 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.358922 9815 tablet_replica.cc:330] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.359087 9815 raft_consensus.cc:2229] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.359210 9815 raft_consensus.cc:2258] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.359622 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.362229 9815 ts_tablet_manager.cc:1905] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.362354 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.363566 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.366185 8949 catalog_manager.cc:5495] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:37.369077 9815 ts_tablet_manager.cc:1918] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.369176 9815 log.cc:1196] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:37.369412 9815 ts_tablet_manager.cc:1939] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.370103 9851 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.370283 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]) successfully deleted
I20260928 14:50:37.370316 9851 ts_tablet_manager.cc:1397] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.109s user 0.000s sys 0.003s
I20260928 14:50:37.370605 9815 tablet_replica.cc:330] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.370813 9815 raft_consensus.cc:2229] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.370991 9815 raft_consensus.cc:2258] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.370965 9851 raft_consensus.cc:348] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.371150 9851 raft_consensus.cc:374] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.371204 9851 raft_consensus.cc:729] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.357800 9814 ts_tablet_manager.cc:1918] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.371393 9814 log.cc:1196] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:37.371659 9814 ts_tablet_manager.cc:1939] T cadfdf093ab04b61af441cff6c9c510b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.371939 9815 ts_tablet_manager.cc:1905] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.372485 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cadfdf093ab04b61af441cff6c9c510b (table default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]) successfully deleted
I20260928 14:50:37.372539 9851 consensus_queue.cc:260] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.373027 9851 ts_tablet_manager.cc:1428] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260928 14:50:37.373799 9814 tablet_replica.cc:330] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.374023 9851 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.375883 9851 tablet_bootstrap.cc:654] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.376462 9814 raft_consensus.cc:2229] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.376643 9814 raft_consensus.cc:2258] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.377357 9814 ts_tablet_manager.cc:1905] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.377449 9855 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.377579 9855 ts_tablet_manager.cc:1397] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.099s user 0.008s sys 0.021s
I20260928 14:50:37.378311 9855 raft_consensus.cc:348] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.378509 9855 raft_consensus.cc:374] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.378561 9855 raft_consensus.cc:729] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.378732 9855 consensus_queue.cc:260] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.379321 9855 ts_tablet_manager.cc:1428] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:37.379648 9855 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.322567 9402 tablet_service.cc:1467] Processing CreateTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc (DEFAULT_TABLE table=default.Table_dd6a6d295c8340ed89d704184bb78a67 [id=2ce00cd4c7af42949c4d833e536b60ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.382361 9855 tablet_bootstrap.cc:654] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.382651 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba96eb0f6c0141ee96e30496cbb19edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.327708 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.344048 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.344187 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bff112215814b8ba3d6624bbec772e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b35670ba2044b58a524847f77d4f822) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.344285 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd00b9377b245a29d2a6735248112bc with delete_type TABLET_DATA_DELETED (replaced by tablet c69091fb32fc47a6a4648f1b4b11356f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.347770 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.355501 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 5fcdce2cb90344e0a1e0e68d703e9034 (DEFAULT_TABLE table=default.Table_7cfd3e0904e14e86b1f17dcdd9dc7c94 [id=81651ab2460543cd8d695f4ac0b17e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.386179 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fcdce2cb90344e0a1e0e68d703e9034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.387571 10817 raft_consensus.cc:482] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.387707 10817 raft_consensus.cc:504] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.388717 10817 leader_election.cc:288] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.389668 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:37.389869 9567 raft_consensus.cc:2454] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:37.390177 9815 ts_tablet_manager.cc:1918] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.390293 9851 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.390427 9851 ts_tablet_manager.cc:1397] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.005s
I20260928 14:50:37.390484 9219 leader_election.cc:302] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:37.390564 9815 log.cc:1196] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/82a58b7387564863a2141a722003c5d1
I20260928 14:50:37.390723 10817 raft_consensus.cc:2781] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:37.390784 10817 raft_consensus.cc:482] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:37.390839 10817 raft_consensus.cc:3037] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.390856 9815 ts_tablet_manager.cc:1939] T 82a58b7387564863a2141a722003c5d1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.391090 9851 raft_consensus.cc:348] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.391258 9851 raft_consensus.cc:374] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.391297 9851 raft_consensus.cc:729] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.391455 9851 consensus_queue.cc:260] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.391822 9851 ts_tablet_manager.cc:1428] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:37.392055 9851 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.393137 10817 raft_consensus.cc:504] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.393272 9851 tablet_bootstrap.cc:654] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.394002 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 82a58b7387564863a2141a722003c5d1 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:37.394086 10817 leader_election.cc:288] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.394795 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:37.395337 9220 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.395606 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
W20260928 14:50:37.395689 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2b92039b9a484a768efa3714b58248ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b92039b9a484a768efa3714b58248ef already in progress: creating tablet
I20260928 14:50:37.395764 9567 raft_consensus.cc:3037] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.396685 10630 raft_consensus.cc:482] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.396807 10630 raft_consensus.cc:504] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.397383 10630 leader_election.cc:288] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.398103 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.398191 9567 raft_consensus.cc:2454] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:37.398587 9497 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.398690 9219 leader_election.cc:302] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
W20260928 14:50:37.399323 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 because the tablet was not found. No further retry: Not found: Tablet not found: 286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:37.399488 10817 raft_consensus.cc:2781] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:37.399704 10817 raft_consensus.cc:686] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:37.399963 10817 consensus_queue.cc:237] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.400034 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.400748 9498 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.400905 9498 leader_election.cc:302] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.403014 9814 ts_tablet_manager.cc:1918] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.403103 9814 log.cc:1196] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/a19995a0d8af4d3ca562bade80ce006f
I20260928 14:50:37.402436 9855 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.403299 9855 ts_tablet_manager.cc:1397] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.016s
I20260928 14:50:37.403331 10630 raft_consensus.cc:2726] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.403856 9814 ts_tablet_manager.cc:1939] T a19995a0d8af4d3ca562bade80ce006f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.404069 9855 raft_consensus.cc:348] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.404256 9855 raft_consensus.cc:374] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.404376 9855 raft_consensus.cc:729] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.404587 9855 consensus_queue.cc:260] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.404922 9814 tablet_replica.cc:330] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.405107 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet a19995a0d8af4d3ca562bade80ce006f (table default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]) successfully deleted
I20260928 14:50:37.405128 9814 raft_consensus.cc:2229] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.405254 9814 raft_consensus.cc:2258] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.405658 9855 ts_tablet_manager.cc:1428] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.406023 9855 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.407495 9855 tablet_bootstrap.cc:654] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.409675 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa9167742a94a0ab586e15205a0ccdc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.413100 9848 tablet_bootstrap.cc:492] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.413327 9848 ts_tablet_manager.cc:1397] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260928 14:50:37.414156 9848 raft_consensus.cc:348] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.406363 9851 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.415001 9851 ts_tablet_manager.cc:1397] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260928 14:50:37.415045 9855 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.415148 9855 ts_tablet_manager.cc:1397] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260928 14:50:37.415469 9848 raft_consensus.cc:374] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.415656 9848 raft_consensus.cc:729] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.415616 9851 raft_consensus.cc:348] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.415815 9851 raft_consensus.cc:374] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.415726 9855 raft_consensus.cc:348] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.415872 9851 raft_consensus.cc:729] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.415918 9855 raft_consensus.cc:374] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.415975 9855 raft_consensus.cc:729] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.416040 9851 consensus_queue.cc:260] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.416137 9855 consensus_queue.cc:260] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.416527 9851 ts_tablet_manager.cc:1428] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:37.416560 9855 ts_tablet_manager.cc:1428] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:37.416771 9851 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.416781 9855 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.416548 9813 raft_consensus.cc:2258] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:37.410115 9220 leader_election.cc:341] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.418210 9855 tablet_bootstrap.cc:654] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.416719 9848 consensus_queue.cc:260] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.421768 8952 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188] alter complete (version 2)
I20260928 14:50:37.422819 9813 ts_tablet_manager.cc:1905] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.423120 9851 tablet_bootstrap.cc:654] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.427559 9848 ts_tablet_manager.cc:1428] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260928 14:50:37.434477 9848 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.437913 10817 raft_consensus.cc:482] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.438131 10817 raft_consensus.cc:504] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:37.439845 9219 leader_election.cc:341] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1f012857690f4f91a941a5f642b9c989
I20260928 14:50:37.440056 10817 leader_election.cc:288] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:37.437908 9814 ts_tablet_manager.cc:1905] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.441113 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f012857690f4f91a941a5f642b9c989" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.441623 9220 leader_election.cc:341] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.441718 9220 leader_election.cc:302] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.442210 10817 raft_consensus.cc:2726] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.442965 9848 tablet_bootstrap.cc:654] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.448392 9851 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.448516 9851 ts_tablet_manager.cc:1397] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260928 14:50:37.449211 9851 raft_consensus.cc:348] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.449401 9851 raft_consensus.cc:374] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.449455 9851 raft_consensus.cc:729] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.449674 9851 consensus_queue.cc:260] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.450798 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b914e3c8243490d92378a8765d6390f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.452592 9851 ts_tablet_manager.cc:1428] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:37.453511 9851 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.456686 9814 ts_tablet_manager.cc:1918] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.456841 9814 log.cc:1196] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:37.457183 9814 ts_tablet_manager.cc:1939] T ba281355b2f44b77a4ff99d49c084162 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.458285 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ba281355b2f44b77a4ff99d49c084162 (table default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]) successfully deleted
W20260928 14:50:37.459170 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a669313e134147bd87e4d65311e242a8 consensus state has no leader
I20260928 14:50:37.459340 9813 ts_tablet_manager.cc:1918] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.460896 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0be40c5bb8bc44b7a36723ee98a49249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.461395 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0be40c5bb8bc44b7a36723ee98a49249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.461978 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_77feeb1f7cce4d099a5d4263cc2da2a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.462458 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77feeb1f7cce4d099a5d4263cc2da2a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.462965 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3b75816a9816497ca6bc6ba8e5c5eb3d
I20260928 14:50:37.463617 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ed8fca0fd85f47eb89303762f2f363e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.464103 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed8fca0fd85f47eb89303762f2f363e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.465317 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296732efcb349ab9cc87e3ff1e11fd0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f012857690f4f91a941a5f642b9c989) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.465840 9848 tablet_bootstrap.cc:492] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.466147 9848 ts_tablet_manager.cc:1397] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260928 14:50:37.468770 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.468935 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.469555 10630 raft_consensus.cc:482] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.469491 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_147ccdd8fd7b46d6a1795605ede946e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.469619 9848 raft_consensus.cc:348] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.469688 10630 raft_consensus.cc:504] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.469810 9848 raft_consensus.cc:374] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.469849 9848 raft_consensus.cc:729] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:37.469991 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_147ccdd8fd7b46d6a1795605ede946e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.470046 9848 consensus_queue.cc:260] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.470228 10630 leader_election.cc:288] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.470762 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.471249 9498 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.473210 9848 ts_tablet_manager.cc:1428] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260928 14:50:37.473333 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.474435 9497 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.474539 9497 leader_election.cc:302] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:37.475310 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b75816a9816497ca6bc6ba8e5c5eb3d already in progress: creating tablet
I20260928 14:50:37.476502 10630 raft_consensus.cc:2726] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.476733 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.478324 9851 tablet_bootstrap.cc:654] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.478495 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e37fa525dd543aea4ae0f55ed2813f4 consensus state has no leader
I20260928 14:50:37.478852 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1a4386a2fcb74bed9056deabd39257e6" } modify_external_catalogs: true
I20260928 14:50:37.479029 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1a4386a2fcb74bed9056deabd39257e6" } modify_external_catalogs: true
I20260928 14:50:37.479679 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_63cbd45ae23a4ee7ac51f928b7613600" } modify_external_catalogs: true
I20260928 14:50:37.479868 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_63cbd45ae23a4ee7ac51f928b7613600" } modify_external_catalogs: true
I20260928 14:50:37.480592 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5eaa39cffce14b8c943fc61ddef2edb7" } new_table_name: "default.Table_ed36dc3cdd8e4d7dbcad55d996184a4f" modify_external_catalogs: true
I20260928 14:50:37.480893 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:37.482122 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 852b70b1f7444ad2ab92d66d580a0db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.482553 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:37.486518 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b75816a9816497ca6bc6ba8e5c5eb3d already in progress: creating tablet
I20260928 14:50:37.487071 10630 raft_consensus.cc:482] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.487180 10630 raft_consensus.cc:504] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.487696 10630 leader_election.cc:288] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.487731 9848 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.488184 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.488757 9498 leader_election.cc:341] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.489226 9848 tablet_bootstrap.cc:654] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.489274 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.489832 9497 leader_election.cc:341] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.489928 9497 leader_election.cc:302] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.490270 10630 raft_consensus.cc:2726] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.490562 9814 tablet_replica.cc:330] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.490841 10630 raft_consensus.cc:482] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.490964 10630 raft_consensus.cc:504] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.491451 10630 leader_election.cc:288] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.491992 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.490115 9813 log.cc:1196] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ca5c040fa6ba4e2785959874a3346bf7
W20260928 14:50:37.492475 9498 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.492726 9813 ts_tablet_manager.cc:1939] T ca5c040fa6ba4e2785959874a3346bf7 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.493070 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 688) took 2346 ms. Trace:
I20260928 14:50:37.493192 9813 rpcz_store.cc:276] 0928 14:50:35.146269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.147148 (+ 879us) service_pool.cc:227] Handling call
0928 14:50:37.320447 (+2173299us) ts_tablet_manager.cc:1145] Deleting tablet ca5c040fa6ba4e2785959874a3346bf7
0928 14:50:37.320459 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.451320 (+130861us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.459262 (+ 7942us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.493057 (+ 33795us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2173117}
I20260928 14:50:37.493312 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.493789 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ca5c040fa6ba4e2785959874a3346bf7 (table default.Table_c2ea7b972a3441858741b741d8452bd7 [id=8fe8d4808cbe43a3ad3d3f217582b27c]) successfully deleted
W20260928 14:50:37.493811 9497 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.493894 9497 leader_election.cc:302] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.494139 9813 tablet_replica.cc:330] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.494211 10630 raft_consensus.cc:2726] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.494349 9813 raft_consensus.cc:2229] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.494547 9814 raft_consensus.cc:2229] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.495381 9814 raft_consensus.cc:2258] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.496335 9814 ts_tablet_manager.cc:1905] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.500238 9855 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.500417 9855 ts_tablet_manager.cc:1397] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.084s user 0.008s sys 0.000s
I20260928 14:50:37.501098 9855 raft_consensus.cc:348] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.501542 9855 raft_consensus.cc:374] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.501722 9855 raft_consensus.cc:729] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.502050 9855 consensus_queue.cc:260] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.494496 9813 raft_consensus.cc:2258] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.508832 9855 ts_tablet_manager.cc:1428] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 14:50:37.509106 9855 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.509382 9813 ts_tablet_manager.cc:1905] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.510412 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 9cb3cc5b42524a4399d0bcf21c851fd8 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.512665 9855 tablet_bootstrap.cc:654] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.513515 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ff596370c52465ca7c531b8760af5c8 consensus state has no leader
I20260928 14:50:37.514202 9851 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.514338 9851 ts_tablet_manager.cc:1397] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.001s
I20260928 14:50:37.514642 10817 raft_consensus.cc:482] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.514750 10817 raft_consensus.cc:504] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.514976 9851 raft_consensus.cc:348] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.515161 9851 raft_consensus.cc:374] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.515215 9851 raft_consensus.cc:729] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.515326 10817 leader_election.cc:288] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.515391 9851 consensus_queue.cc:260] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.515866 9851 ts_tablet_manager.cc:1428] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:37.516135 9851 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.516110 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:37.516285 9567 raft_consensus.cc:2454] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:37.517561 9219 leader_election.cc:302] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:37.517668 9851 tablet_bootstrap.cc:654] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.517903 10735 raft_consensus.cc:2781] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:37.517967 10735 raft_consensus.cc:482] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:37.518033 10735 raft_consensus.cc:3037] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.516548 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.520831 9220 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.522146 10735 raft_consensus.cc:504] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.522678 10735 leader_election.cc:288] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.523140 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:37.523293 9567 raft_consensus.cc:3037] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:37.525352 9851 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.525447 9851 ts_tablet_manager.cc:1397] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260928 14:50:37.525718 9567 raft_consensus.cc:2454] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:37.526101 9219 leader_election.cc:302] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:37.526136 9851 raft_consensus.cc:348] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.526330 9851 raft_consensus.cc:374] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.526381 9851 raft_consensus.cc:729] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.526604 9851 consensus_queue.cc:260] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.526723 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:37.527067 9851 ts_tablet_manager.cc:1428] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:37.527127 10817 raft_consensus.cc:2781] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:37.527225 10817 raft_consensus.cc:686] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:37.528575 10630 raft_consensus.cc:482] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.528697 10630 raft_consensus.cc:504] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.529194 10630 leader_election.cc:288] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.530081 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b8584ba1914c3390aee99baaee289e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.530517 9498 leader_election.cc:341] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.527352 9851 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.527441 10817 consensus_queue.cc:237] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:37.527951 9220 leader_election.cc:341] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.529978 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b8584ba1914c3390aee99baaee289e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.532267 9851 tablet_bootstrap.cc:654] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.532466 9497 leader_election.cc:341] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.532554 9497 leader_election.cc:302] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.532848 10630 raft_consensus.cc:2726] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.535102 9813 ts_tablet_manager.cc:1918] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.535202 9813 log.cc:1196] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/c85735981779438197f2c0f489681b96
I20260928 14:50:37.535679 9813 ts_tablet_manager.cc:1939] T c85735981779438197f2c0f489681b96 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.536366 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 689) took 2385 ms. Trace:
I20260928 14:50:37.536490 9813 rpcz_store.cc:276] 0928 14:50:35.150692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.150990 (+ 298us) service_pool.cc:227] Handling call
0928 14:50:37.494100 (+2343110us) ts_tablet_manager.cc:1145] Deleting tablet c85735981779438197f2c0f489681b96
0928 14:50:37.494110 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.525201 (+ 31091us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.535019 (+ 9818us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.536349 (+ 1330us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2342823}
I20260928 14:50:37.536980 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet c85735981779438197f2c0f489681b96 (table default.Table_8404ce5ed5f045669de5e3f460d848bb [id=82e00aa8cf194a2c8789d623d0788c98]) successfully deleted
I20260928 14:50:37.537369 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 692) took 2309 ms. Trace:
I20260928 14:50:37.537489 9813 rpcz_store.cc:276] 0928 14:50:35.227804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.228033 (+ 229us) service_pool.cc:227] Handling call
0928 14:50:37.537267 (+2309234us) ts_tablet_manager.cc:1145] Deleting tablet 52993ae8b63d4fbaa8cf38720af3dea5
0928 14:50:37.537277 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.537355 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309032}
W20260928 14:50:37.537984 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 52993ae8b63d4fbaa8cf38720af3dea5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52993ae8b63d4fbaa8cf38720af3dea5 already in progress: creating tablet
I20260928 14:50:37.538353 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 693) took 2310 ms. Trace:
I20260928 14:50:37.538460 9813 rpcz_store.cc:276] 0928 14:50:35.227979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.228275 (+ 296us) service_pool.cc:227] Handling call
0928 14:50:37.538257 (+2309982us) ts_tablet_manager.cc:1145] Deleting tablet 3348f5a55ef34af88611077aab447f83
0928 14:50:37.538267 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.538339 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309756}
W20260928 14:50:37.539486 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3348f5a55ef34af88611077aab447f83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3348f5a55ef34af88611077aab447f83 already in progress: creating tablet
I20260928 14:50:37.539849 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 691) took 2312 ms. Trace:
I20260928 14:50:37.539955 9813 rpcz_store.cc:276] 0928 14:50:35.227002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.228976 (+ 1974us) service_pool.cc:227] Handling call
0928 14:50:37.539746 (+2310770us) ts_tablet_manager.cc:1145] Deleting tablet 43c887b7c4e8434a9342d49145fde3ae
0928 14:50:37.539755 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.539835 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309033}
W20260928 14:50:37.540378 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 43c887b7c4e8434a9342d49145fde3ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43c887b7c4e8434a9342d49145fde3ae already in progress: creating tablet
W20260928 14:50:37.540629 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7e37fa525dd543aea4ae0f55ed2813f4 (table default.Table_6ed5cdcb675541eca4e4e659fecabc93 [id=38a06314c58d4cd3b47f659dc341af81], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e37fa525dd543aea4ae0f55ed2813f4 consensus state has no leader
I20260928 14:50:37.540940 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 701) took 2247 ms. Trace:
I20260928 14:50:37.541798 9813 rpcz_store.cc:276] 0928 14:50:35.293317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.293360 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:37.540846 (+2247486us) ts_tablet_manager.cc:1145] Deleting tablet 5e5ceda898274189b81b9172cdbc7bb7
0928 14:50:37.540856 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.540925 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2247331}
W20260928 14:50:37.542284 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5e5ceda898274189b81b9172cdbc7bb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5ceda898274189b81b9172cdbc7bb7 already in progress: creating tablet
I20260928 14:50:37.543897 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_96bb0f27ebd4452697caa25a15d1e9c2" } modify_external_catalogs: true
I20260928 14:50:37.544109 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cfec9f0b9b0f4287bcba0cd09123f4cf" } modify_external_catalogs: true
I20260928 14:50:37.544265 10630 raft_consensus.cc:482] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.544305 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cfec9f0b9b0f4287bcba0cd09123f4cf" } modify_external_catalogs: true
I20260928 14:50:37.544374 10630 raft_consensus.cc:504] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.544878 10630 leader_election.cc:288] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.545406 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bd5ccd4f42694ce1b58645b61e1a380f" } new_table_name: "default.Table_80bae2129fb24491b999a368ecb99d3f" modify_external_catalogs: true
I20260928 14:50:37.545544 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.545982 9497 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.546186 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.546622 9498 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.546713 9498 leader_election.cc:302] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.547044 10630 raft_consensus.cc:2726] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.551306 9855 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.551486 9855 ts_tablet_manager.cc:1397] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260928 14:50:37.552165 9855 raft_consensus.cc:348] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.544121 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_96bb0f27ebd4452697caa25a15d1e9c2" } modify_external_catalogs: true
I20260928 14:50:37.552395 9855 raft_consensus.cc:374] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.552490 9855 raft_consensus.cc:729] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.552734 9855 consensus_queue.cc:260] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.553083 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8071c3ffdde14e4ea2b4f2eae4596529" } new_table_name: "default.Table_41fcada969964258a48a44db603216b5" modify_external_catalogs: true
I20260928 14:50:37.554127 9855 ts_tablet_manager.cc:1428] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:37.554358 9855 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.540654 9814 ts_tablet_manager.cc:1918] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.556162 9814 log.cc:1196] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/274ab65ebc2d41db9dc5d8a0139f9bc9
I20260928 14:50:37.556540 9814 ts_tablet_manager.cc:1939] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.558215 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (table default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]) successfully deleted
I20260928 14:50:37.558991 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]). Expected version 2 got 0
I20260928 14:50:37.559232 8949 catalog_manager.cc:5495] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:37.559659 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:37.559895 9855 tablet_bootstrap.cc:654] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.560662 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 88d6b4482e7b42fca17e5b917e1c1bed (table default.Table_6dacb88cb9c74873a8f69da29a43fed9 [id=27d3ad1dac4641e2b16e86da4d16ea0e]). Expected version 1 got 0
I20260928 14:50:37.560765 8954 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0ebba8dd7f274680a915c06f6d1636ac
I20260928 14:50:37.561980 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.562723 9251 tablet_service.cc:1467] Processing CreateTablet for tablet d2f6e4db075945c3a6ee24be764b8738 (DEFAULT_TABLE table=default.Table_6d36d12d26784400a70cee63450cf110 [id=bd0d637e79f94b32a19be3b4a0cb3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.563053 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2f6e4db075945c3a6ee24be764b8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.565595 9851 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.565703 9851 ts_tablet_manager.cc:1397] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.003s
I20260928 14:50:37.565817 9815 tablet_replica.cc:330] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.565979 9815 raft_consensus.cc:2229] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.566097 9815 raft_consensus.cc:2258] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.568055 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 705) took 2268 ms. Trace:
I20260928 14:50:37.569682 9815 ts_tablet_manager.cc:1905] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.568444 9813 rpcz_store.cc:276] 0928 14:50:35.299442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:35.299493 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:37.567934 (+2268441us) ts_tablet_manager.cc:1145] Deleting tablet f92d30a7102f49828227b1428e2224da
0928 14:50:37.567948 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.568035 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2242761}
W20260928 14:50:37.570017 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f92d30a7102f49828227b1428e2224da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92d30a7102f49828227b1428e2224da already in progress: creating tablet
I20260928 14:50:37.570255 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 731) took 1471 ms. Trace:
I20260928 14:50:37.570330 9813 rpcz_store.cc:276] 0928 14:50:36.098338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.098407 (+ 69us) service_pool.cc:227] Handling call
0928 14:50:37.570154 (+1471747us) ts_tablet_manager.cc:1145] Deleting tablet 9cb3cc5b42524a4399d0bcf21c851fd8
0928 14:50:37.570164 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.570238 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1454712}
W20260928 14:50:37.570698 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb3cc5b42524a4399d0bcf21c851fd8 already in progress: creating tablet
I20260928 14:50:37.571168 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 732) took 1348 ms. Trace:
I20260928 14:50:37.571246 9813 rpcz_store.cc:276] 0928 14:50:36.222341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.222508 (+ 167us) service_pool.cc:227] Handling call
0928 14:50:37.571076 (+1348568us) ts_tablet_manager.cc:1145] Deleting tablet 3461b27174ca4bb184a3369d5de47bcc
0928 14:50:37.571084 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.571153 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348347}
W20260928 14:50:37.571570 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3461b27174ca4bb184a3369d5de47bcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3461b27174ca4bb184a3369d5de47bcc already in progress: creating tablet
I20260928 14:50:37.571538 9851 raft_consensus.cc:348] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.571727 9851 raft_consensus.cc:374] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.571820 9851 raft_consensus.cc:729] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.572045 9851 consensus_queue.cc:260] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.572666 9851 ts_tablet_manager.cc:1428] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:37.573977 9851 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.574163 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d2f6e4db075945c3a6ee24be764b8738 (DEFAULT_TABLE table=default.Table_6d36d12d26784400a70cee63450cf110 [id=bd0d637e79f94b32a19be3b4a0cb3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.574673 9549 tablet_service.cc:1467] Processing CreateTablet for tablet d2f6e4db075945c3a6ee24be764b8738 (DEFAULT_TABLE table=default.Table_6d36d12d26784400a70cee63450cf110 [id=bd0d637e79f94b32a19be3b4a0cb3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.574990 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2f6e4db075945c3a6ee24be764b8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.575207 9815 ts_tablet_manager.cc:1918] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.575520 9815 log.cc:1196] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:37.575740 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 4325f2f6dec94231b3972ff9e247e80d (DEFAULT_TABLE table=default.Table_c2b58c2fedfe482aa60fc8268d18df36 [id=8eb59948fb514c19856f00b6f9037914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.575999 9815 ts_tablet_manager.cc:1939] T 9f04c05cdad04261a1e2ae7e044ddbfb P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.576673 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc (DEFAULT_TABLE table=default.Table_537173ecbd8545f3ba14e0fd8c26e60e [id=f76bfc4a9cf24997bd98771109fb873f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.577682 9851 tablet_bootstrap.cc:654] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.577684 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2f6e4db075945c3a6ee24be764b8738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.578512 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.581669 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4325f2f6dec94231b3972ff9e247e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.583957 9848 tablet_bootstrap.cc:492] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.584064 9848 ts_tablet_manager.cc:1397] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.000s
I20260928 14:50:37.584798 9848 raft_consensus.cc:348] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.584975 9848 raft_consensus.cc:374] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.585027 9848 raft_consensus.cc:729] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.585258 9848 consensus_queue.cc:260] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.586720 9848 ts_tablet_manager.cc:1428] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:37.590245 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 81ef55984cab462082310e195afbe516 (DEFAULT_TABLE table=default.Table_f9a6762f650e4839b51bed6814860eef [id=b5b16867d8fc430087750af675464902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.590500 9396 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64096ca3c490a909131c92e0846a0 (DEFAULT_TABLE table=default.Table_20eb3a4cb9204173930667e149a18ecb [id=184736ae0f1f4a34b8faf537b119a22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.590878 9389 tablet_service.cc:1467] Processing CreateTablet for tablet c124bbf1244745b78ecc7c99f373f265 (DEFAULT_TABLE table=default.Table_68e8720b58b54dd3af381526ec156fa3 [id=881478d2f0f942768904d51fa4826051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.591243 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 2087e6a79207498595b8104a069225c0 (DEFAULT_TABLE table=default.Table_d00fe9fe6909464c8a640c3835b41e9d [id=dcb873ff3c0b46b4ac7a22605e735836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.591591 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 (DEFAULT_TABLE table=default.Table_96bb0f27ebd4452697caa25a15d1e9c2 [id=ed6f0b9d6c9345e5a48db4dd39c4e8b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.591913 9395 tablet_service.cc:1467] Processing CreateTablet for tablet ca9a7f49a6f04e9b876b30058453bd53 (DEFAULT_TABLE table=default.Table_49c6b3a78d8c4a1884368286ae9121ce [id=b748ce523b894176a8932166e40f8fdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.592248 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 99e54a175c104f9db590e6fd9ef72838 (DEFAULT_TABLE table=default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.592549 9408 tablet_service.cc:1467] Processing CreateTablet for tablet e0293fd4baf946579b82c73a35b06fcc (DEFAULT_TABLE table=default.Table_e2aecd527654497da271e99118373258 [id=4aaf4e3cd4ad4ba3bfe0233420b13853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.593348 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 4325f2f6dec94231b3972ff9e247e80d (DEFAULT_TABLE table=default.Table_c2b58c2fedfe482aa60fc8268d18df36 [id=8eb59948fb514c19856f00b6f9037914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.593719 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4325f2f6dec94231b3972ff9e247e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.594061 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 81ef55984cab462082310e195afbe516 (DEFAULT_TABLE table=default.Table_f9a6762f650e4839b51bed6814860eef [id=b5b16867d8fc430087750af675464902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594321 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 6b35670ba2044b58a524847f77d4f822 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594563 9538 tablet_service.cc:1467] Processing CreateTablet for tablet c124bbf1244745b78ecc7c99f373f265 (DEFAULT_TABLE table=default.Table_68e8720b58b54dd3af381526ec156fa3 [id=881478d2f0f942768904d51fa4826051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594648 9537 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64096ca3c490a909131c92e0846a0 (DEFAULT_TABLE table=default.Table_20eb3a4cb9204173930667e149a18ecb [id=184736ae0f1f4a34b8faf537b119a22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594831 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 (DEFAULT_TABLE table=default.Table_8d4c62e8168e4db684e75af5228f1201 [id=ffbf35092f0947d1aa51886988b79bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594969 9529 tablet_service.cc:1467] Processing CreateTablet for tablet e0293fd4baf946579b82c73a35b06fcc (DEFAULT_TABLE table=default.Table_e2aecd527654497da271e99118373258 [id=4aaf4e3cd4ad4ba3bfe0233420b13853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.595080 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 2087e6a79207498595b8104a069225c0 (DEFAULT_TABLE table=default.Table_d00fe9fe6909464c8a640c3835b41e9d [id=dcb873ff3c0b46b4ac7a22605e735836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.595482 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 (DEFAULT_TABLE table=default.Table_96bb0f27ebd4452697caa25a15d1e9c2 [id=ed6f0b9d6c9345e5a48db4dd39c4e8b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.595872 9542 tablet_service.cc:1467] Processing CreateTablet for tablet ca9a7f49a6f04e9b876b30058453bd53 (DEFAULT_TABLE table=default.Table_49c6b3a78d8c4a1884368286ae9121ce [id=b748ce523b894176a8932166e40f8fdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.596282 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 99e54a175c104f9db590e6fd9ef72838 (DEFAULT_TABLE table=default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.596962 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9f04c05cdad04261a1e2ae7e044ddbfb (table default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]) successfully deleted
I20260928 14:50:37.594389 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc (DEFAULT_TABLE table=default.Table_537173ecbd8545f3ba14e0fd8c26e60e [id=f76bfc4a9cf24997bd98771109fb873f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.594390 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ef55984cab462082310e195afbe516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.597842 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b35670ba2044b58a524847f77d4f822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.598037 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0293fd4baf946579b82c73a35b06fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.598326 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9a7f49a6f04e9b876b30058453bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.598987 9855 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.599084 9855 ts_tablet_manager.cc:1397] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260928 14:50:37.599728 9855 raft_consensus.cc:348] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.599895 9855 raft_consensus.cc:374] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.599941 9855 raft_consensus.cc:729] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.600133 9855 consensus_queue.cc:260] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.600700 9855 ts_tablet_manager.cc:1428] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.601038 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4117a5bc71ab4993bebe7d817ba46031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.601612 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d6aa0e87854c48b52bbb20b10702d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.601696 9855 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.601887 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c124bbf1244745b78ecc7c99f373f265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.603693 9855 tablet_bootstrap.cc:654] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.605553 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e54a175c104f9db590e6fd9ef72838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.607755 10813 raft_consensus.cc:482] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.607889 10813 raft_consensus.cc:504] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.608429 10813 leader_election.cc:288] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.608557 10813 raft_consensus.cc:482] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.608647 10813 raft_consensus.cc:504] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.609117 10813 leader_election.cc:288] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.609874 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2087e6a79207498595b8104a069225c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.612702 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ef55984cab462082310e195afbe516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.613641 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.616458 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64096ca3c490a909131c92e0846a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.616791 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 78379bd4cfce46fa812374f046d9d329 (table default.Table_af4830aab30c4fccb57822e100e21564 [id=4808092de350419bba3b7bffa8967276]). Expected version 1 got 0
I20260928 14:50:37.617699 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64096ca3c490a909131c92e0846a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.619258 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_409ae5199a3841c4bac091a68a5b864e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.619858 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_409ae5199a3841c4bac091a68a5b864e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.621701 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c124bbf1244745b78ecc7c99f373f265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.624256 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 4325f2f6dec94231b3972ff9e247e80d (DEFAULT_TABLE table=default.Table_c2b58c2fedfe482aa60fc8268d18df36 [id=8eb59948fb514c19856f00b6f9037914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.624547 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 2087e6a79207498595b8104a069225c0 (DEFAULT_TABLE table=default.Table_d00fe9fe6909464c8a640c3835b41e9d [id=dcb873ff3c0b46b4ac7a22605e735836]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.624689 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4325f2f6dec94231b3972ff9e247e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.624930 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2087e6a79207498595b8104a069225c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.625205 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc (DEFAULT_TABLE table=default.Table_537173ecbd8545f3ba14e0fd8c26e60e [id=f76bfc4a9cf24997bd98771109fb873f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.625247 9254 tablet_service.cc:1467] Processing CreateTablet for tablet c124bbf1244745b78ecc7c99f373f265 (DEFAULT_TABLE table=default.Table_68e8720b58b54dd3af381526ec156fa3 [id=881478d2f0f942768904d51fa4826051]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.625651 9261 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64096ca3c490a909131c92e0846a0 (DEFAULT_TABLE table=default.Table_20eb3a4cb9204173930667e149a18ecb [id=184736ae0f1f4a34b8faf537b119a22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.625989 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 81ef55984cab462082310e195afbe516 (DEFAULT_TABLE table=default.Table_f9a6762f650e4839b51bed6814860eef [id=b5b16867d8fc430087750af675464902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.626303 9250 tablet_service.cc:1467] Processing CreateTablet for tablet ca9a7f49a6f04e9b876b30058453bd53 (DEFAULT_TABLE table=default.Table_49c6b3a78d8c4a1884368286ae9121ce [id=b748ce523b894176a8932166e40f8fdb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:37.626554 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab6ccac2580049a5a615d8d36a44f373 consensus state has no leader
I20260928 14:50:37.626681 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 (DEFAULT_TABLE table=default.Table_8d4c62e8168e4db684e75af5228f1201 [id=ffbf35092f0947d1aa51886988b79bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.627030 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 7172211cb181487a98a1562c371635ef (DEFAULT_TABLE table=default.Table_505b9299e8c0438187bc0f61239bfae2 [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.627404 9257 tablet_service.cc:1467] Processing CreateTablet for tablet c69091fb32fc47a6a4648f1b4b11356f (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.627751 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.629824 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 (DEFAULT_TABLE table=default.Table_96bb0f27ebd4452697caa25a15d1e9c2 [id=ed6f0b9d6c9345e5a48db4dd39c4e8b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.630223 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 99e54a175c104f9db590e6fd9ef72838 (DEFAULT_TABLE table=default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.630656 9249 tablet_service.cc:1467] Processing CreateTablet for tablet e0293fd4baf946579b82c73a35b06fcc (DEFAULT_TABLE table=default.Table_e2aecd527654497da271e99118373258 [id=4aaf4e3cd4ad4ba3bfe0233420b13853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.631031 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 6b35670ba2044b58a524847f77d4f822 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.632074 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c124bbf1244745b78ecc7c99f373f265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.632232 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2087e6a79207498595b8104a069225c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.632685 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39091da7a6fb4aceadd3434bd304c268 consensus state has no leader
I20260928 14:50:37.633764 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e54a175c104f9db590e6fd9ef72838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.637642 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d6aa0e87854c48b52bbb20b10702d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.639173 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2967f173bf154bc79bd00e409122f16b
W20260928 14:50:37.643689 9360 leader_election.cc:341] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 852b70b1f7444ad2ab92d66d580a0db7
W20260928 14:50:37.643859 9360 leader_election.cc:341] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 8f2898a032e1488b98c31b5e83371a71
W20260928 14:50:37.643975 9360 leader_election.cc:341] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 852b70b1f7444ad2ab92d66d580a0db7
I20260928 14:50:37.644037 9360 leader_election.cc:302] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:37.644363 9360 leader_election.cc:341] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8f2898a032e1488b98c31b5e83371a71
I20260928 14:50:37.644433 9360 leader_election.cc:302] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.644680 10813 raft_consensus.cc:2726] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.644798 10813 raft_consensus.cc:2726] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.646090 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 69ef1340deca4f00a250c390afcb5064
I20260928 14:50:37.646723 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet 2967f173bf154bc79bd00e409122f16b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.646842 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 6b35670ba2044b58a524847f77d4f822 (DEFAULT_TABLE table=default.Table_06137559c56b4a89bf8f49323ac5b93a [id=d470d9aa470e4a54956f10b0e6ec0aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.647159 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b35670ba2044b58a524847f77d4f822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.648869 9538 tablet_service.cc:1467] Processing CreateTablet for tablet c69091fb32fc47a6a4648f1b4b11356f (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.649188 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69091fb32fc47a6a4648f1b4b11356f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.649804 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 (DEFAULT_TABLE table=default.Table_8d4c62e8168e4db684e75af5228f1201 [id=ffbf35092f0947d1aa51886988b79bc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.650104 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4117a5bc71ab4993bebe7d817ba46031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.651505 9848 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.652824 9848 tablet_bootstrap.cc:654] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.653113 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ef1340deca4f00a250c390afcb5064 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.653641 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0293fd4baf946579b82c73a35b06fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.653748 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 7172211cb181487a98a1562c371635ef (DEFAULT_TABLE table=default.Table_505b9299e8c0438187bc0f61239bfae2 [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.654017 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7172211cb181487a98a1562c371635ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.657747 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b35670ba2044b58a524847f77d4f822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.657774 9404 tablet_service.cc:1467] Processing CreateTablet for tablet c69091fb32fc47a6a4648f1b4b11356f (DEFAULT_TABLE table=default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.658054 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69091fb32fc47a6a4648f1b4b11356f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.661629 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet b9f843006a1e43a49f177433c7a3e1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.662479 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9a7f49a6f04e9b876b30058453bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.664908 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 36d6aa0e87854c48b52bbb20b10702d6
I20260928 14:50:37.666088 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.666375 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81ef55984cab462082310e195afbe516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.667055 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d6aa0e87854c48b52bbb20b10702d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.669710 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9a7f49a6f04e9b876b30058453bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.670024 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69091fb32fc47a6a4648f1b4b11356f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.673782 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7172211cb181487a98a1562c371635ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.676262 10677 raft_consensus.cc:482] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.676369 10677 raft_consensus.cc:504] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.676884 10677 leader_election.cc:288] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:37.677449 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0293fd4baf946579b82c73a35b06fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.678995 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 733) took 1419 ms. Trace:
I20260928 14:50:37.679071 9813 rpcz_store.cc:276] 0928 14:50:36.259738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.259804 (+ 66us) service_pool.cc:227] Handling call
0928 14:50:37.591588 (+1331784us) ts_tablet_manager.cc:1145] Deleting tablet 09f04bf1357148818ea60b32cfd5f9cc
0928 14:50:37.666873 (+ 75285us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.678980 (+ 12107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331526}
W20260928 14:50:37.679435 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 09f04bf1357148818ea60b32cfd5f9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f04bf1357148818ea60b32cfd5f9cc already in progress: creating tablet
I20260928 14:50:37.679487 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 734) took 1403 ms. Trace:
I20260928 14:50:37.679548 9813 rpcz_store.cc:276] 0928 14:50:36.275569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.275633 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:37.679388 (+1403755us) ts_tablet_manager.cc:1145] Deleting tablet aeab20d78f5b41b1b36c3bf379e2c797
0928 14:50:37.679397 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.679473 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403565}
I20260928 14:50:37.679883 9813 tablet_replica.cc:330] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:37.679852 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet aeab20d78f5b41b1b36c3bf379e2c797 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aeab20d78f5b41b1b36c3bf379e2c797 already in progress: creating tablet
I20260928 14:50:37.680045 9813 raft_consensus.cc:2229] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.680161 9813 raft_consensus.cc:2258] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.681311 9813 ts_tablet_manager.cc:1905] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.681437 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4117a5bc71ab4993bebe7d817ba46031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.681797 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64096ca3c490a909131c92e0846a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.684581 9851 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.684736 9851 ts_tablet_manager.cc:1397] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.014s
I20260928 14:50:37.685446 9851 raft_consensus.cc:348] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.685657 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e54a175c104f9db590e6fd9ef72838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.685703 9851 raft_consensus.cc:374] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.685767 9851 raft_consensus.cc:729] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.685973 9851 consensus_queue.cc:260] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.686240 9848 tablet_bootstrap.cc:492] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.686360 9848 ts_tablet_manager.cc:1397] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260928 14:50:37.686702 9851 ts_tablet_manager.cc:1428] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:37.686960 9851 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.687050 9848 raft_consensus.cc:348] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.687222 9848 raft_consensus.cc:374] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.687270 9848 raft_consensus.cc:729] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.687477 9848 consensus_queue.cc:260] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.688192 9848 ts_tablet_manager.cc:1428] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.688445 9848 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.689671 9848 tablet_bootstrap.cc:654] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:37.701709 9360 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 8296732efcb349ab9cc87e3ff1e11fd0
W20260928 14:50:37.701924 9360 leader_election.cc:341] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:37.701998 9360 leader_election.cc:302] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.702170 10677 raft_consensus.cc:2726] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.703935 9851 tablet_bootstrap.cc:654] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.705354 9855 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.705470 9855 ts_tablet_manager.cc:1397] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.012s
I20260928 14:50:37.706389 9855 raft_consensus.cc:348] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.706596 9855 raft_consensus.cc:374] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.706668 9855 raft_consensus.cc:729] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.707139 9855 consensus_queue.cc:260] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.713681 9855 ts_tablet_manager.cc:1428] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:37.716413 9813 ts_tablet_manager.cc:1918] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.716568 9813 log.cc:1196] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/b65fd0746d1b474e9fbebe6f09053743
I20260928 14:50:37.717000 9813 ts_tablet_manager.cc:1939] T b65fd0746d1b474e9fbebe6f09053743 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.717515 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 735) took 1410 ms. Trace:
I20260928 14:50:37.717689 9813 rpcz_store.cc:276] 0928 14:50:36.307434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.307798 (+ 364us) service_pool.cc:227] Handling call
0928 14:50:37.679847 (+1372049us) ts_tablet_manager.cc:1145] Deleting tablet b65fd0746d1b474e9fbebe6f09053743
0928 14:50:37.679856 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.708353 (+ 28497us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.716339 (+ 7986us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.717500 (+ 1161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1371875}
I20260928 14:50:37.718066 9855 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.718317 9813 tablet_replica.cc:330] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.718537 9813 raft_consensus.cc:2229] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.718544 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet b65fd0746d1b474e9fbebe6f09053743 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:37.718731 9813 raft_consensus.cc:2258] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.719342 9813 ts_tablet_manager.cc:1905] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.719467 9855 tablet_bootstrap.cc:654] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.722990 9851 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.723124 9851 ts_tablet_manager.cc:1397] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.002s
I20260928 14:50:37.723819 9851 raft_consensus.cc:348] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.724025 9851 raft_consensus.cc:374] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.724119 9851 raft_consensus.cc:729] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.724303 9851 consensus_queue.cc:260] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.725039 9851 ts_tablet_manager.cc:1428] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:37.726436 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.726706 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ef1340deca4f00a250c390afcb5064 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.727113 9851 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.728564 9851 tablet_bootstrap.cc:654] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.729138 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6795ae14f0b0489799a67da3c1a29565"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.729775 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6795ae14f0b0489799a67da3c1a29565 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.730042 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d6aa0e87854c48b52bbb20b10702d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.730535 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.730731 9814 tablet_replica.cc:330] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.730938 9814 raft_consensus.cc:2229] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.730906 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4eb26c3abd79418aa8f0ebb0a76ff9be" } new_table_name: "default.Table_758fb7897c9747cebaf90a970a4d9939" modify_external_catalogs: true
I20260928 14:50:37.731093 9814 raft_consensus.cc:2258] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.731822 9814 ts_tablet_manager.cc:1905] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.732082 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_17d6c76dc8614d8dae2cf9c971111123"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.732585 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17d6c76dc8614d8dae2cf9c971111123 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.733618 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_82daf59a1acc4e2fac99cb20233e41cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.734076 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82daf59a1acc4e2fac99cb20233e41cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.734442 10630 raft_consensus.cc:482] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.734557 10630 raft_consensus.cc:504] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.735059 10630 leader_election.cc:288] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.735057 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b811f325d4094e6da33f9ee8aec3e2d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.735489 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b811f325d4094e6da33f9ee8aec3e2d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.735576 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.736186 9498 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.736456 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e1dc57786cab4958ad9086275ae478b1" } new_table_name: "default.Table_b7a36b3c53714adb84c872fbbca33a72" modify_external_catalogs: true
I20260928 14:50:37.737386 9814 ts_tablet_manager.cc:1918] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.737638 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f012857690f4f91a941a5f642b9c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.737545 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_981f3c2507b14b5fb64a0f1c271bd483"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.737855 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.737977 9814 log.cc:1196] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ad844de91e4040c3a8ae4873c0fa6ba4
W20260928 14:50:37.738031 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_981f3c2507b14b5fb64a0f1c271bd483 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.738358 9814 ts_tablet_manager.cc:1939] T ad844de91e4040c3a8ae4873c0fa6ba4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.738973 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4e86b9df2c224f9083cc99ffe56ecbb4" } modify_external_catalogs: true
I20260928 14:50:37.739151 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4e86b9df2c224f9083cc99ffe56ecbb4" } modify_external_catalogs: true
I20260928 14:50:37.739233 9814 tablet_replica.cc:330] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.739459 9814 raft_consensus.cc:2229] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.739637 9814 raft_consensus.cc:2258] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.740347 9814 ts_tablet_manager.cc:1905] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.743796 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:37.744163 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:37.744534 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:37.744815 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:37.745029 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet cdadb919c4554e5c89f8bb19cf3ddd75 (table default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba]). Expected version 2 got 0
I20260928 14:50:37.745277 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]). Expected version 2 got 0
I20260928 14:50:37.747892 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:37.748391 9497 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.748502 9497 leader_election.cc:302] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.748832 10630 raft_consensus.cc:2726] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.748858 9848 tablet_bootstrap.cc:492] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.749037 9848 ts_tablet_manager.cc:1397] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260928 14:50:37.745505 8949 catalog_manager.cc:5495] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:37.749665 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
I20260928 14:50:37.749964 9848 raft_consensus.cc:348] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.750204 9848 raft_consensus.cc:374] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.750325 9848 raft_consensus.cc:729] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.750558 9848 consensus_queue.cc:260] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.751358 9848 ts_tablet_manager.cc:1428] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:37.751657 9848 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.753262 9848 tablet_bootstrap.cc:654] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.754026 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 732d57c3584148f080e76dffb6b3b146 (DEFAULT_TABLE table=default.Table_3a9c2739592a40cbaad31dd1fab6cdcd [id=19c04962e15c4d2283d35e25582b4aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.754395 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732d57c3584148f080e76dffb6b3b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.757939 9401 tablet_service.cc:1467] Processing CreateTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 (DEFAULT_TABLE table=default.Table_0be40c5bb8bc44b7a36723ee98a49249 [id=13f2887b03b94be198c805fc8a17cacd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.758251 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3c4cca0f2d148ccaa69cdfe09591cb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.763193 9498 consensus_peers.cc:487] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:37.765996 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0b9be5c4dd84957ac2729b5d7d7fe95 consensus state has no leader
I20260928 14:50:37.782024 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 435d9ae33a424abc83b24adbd9bd1fff (DEFAULT_TABLE table=default.Table_ed8fca0fd85f47eb89303762f2f363e7 [id=bc771da07b094653bcc02a0f525df5e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.782543 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435d9ae33a424abc83b24adbd9bd1fff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.787868 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 301278ef2eed4a26b3f72a581027f828 consensus state has no leader
I20260928 14:50:37.788679 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 4ff870b182fd4cf49895fddbe2cdcf0a (DEFAULT_TABLE table=default.Table_77feeb1f7cce4d099a5d4263cc2da2a4 [id=d297d06089884c93a3c564b4d5e25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.789095 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ff870b182fd4cf49895fddbe2cdcf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.793782 9399 tablet_service.cc:1467] Processing CreateTablet for tablet c4720313dae144c6b49c81a07333e7c5 (DEFAULT_TABLE table=default.Table_06baad6c6fe448b2a3cd1e0bb6c8f71d [id=80ca83c4e33f41b5a7307a99abcb908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.794416 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4720313dae144c6b49c81a07333e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.797746 9394 tablet_service.cc:1467] Processing CreateTablet for tablet f3cb1ec9ee0d42d795abc962b093d0dc (DEFAULT_TABLE table=default.Table_5b331f1608b64602b1a450728d95f2a7 [id=da9c48b48e2a4262af510b3bad3a48f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.798254 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3cb1ec9ee0d42d795abc962b093d0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.798547 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.798832 9815 tablet_replica.cc:330] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.799065 9815 raft_consensus.cc:2229] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.799258 9815 raft_consensus.cc:2258] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.799643 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 59e5efe8275844c28200369135695e07 (DEFAULT_TABLE table=default.Table_147ccdd8fd7b46d6a1795605ede946e1 [id=eb33a0cd70854968964600eee44ebcb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.799968 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e5efe8275844c28200369135695e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.800033 9815 ts_tablet_manager.cc:1905] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.800125 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:37.800315 10677 raft_consensus.cc:482] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.800796 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 2967f173bf154bc79bd00e409122f16b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.801344 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.801617 10630 raft_consensus.cc:482] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.801731 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ef1340deca4f00a250c390afcb5064 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.801743 10630 raft_consensus.cc:504] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.802078 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 7172211cb181487a98a1562c371635ef (DEFAULT_TABLE table=default.Table_505b9299e8c0438187bc0f61239bfae2 [id=56b368705d444370acd5ccca83240ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.802294 10630 leader_election.cc:288] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.802726 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:37.801625 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 2967f173bf154bc79bd00e409122f16b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:37.803246 9498 leader_election.cc:341] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.803570 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7172211cb181487a98a1562c371635ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.810001 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0442e8587ed34e64ab67fbc8a2030827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.810593 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0442e8587ed34e64ab67fbc8a2030827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.812175 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fed64561dbc24fbf960eabea8c2db568"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.812731 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fed64561dbc24fbf960eabea8c2db568 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:37.813278 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 36d6aa0e87854c48b52bbb20b10702d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36d6aa0e87854c48b52bbb20b10702d6 already in progress: creating tablet
I20260928 14:50:37.813580 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ad844de91e4040c3a8ae4873c0fa6ba4 (table default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]) successfully deleted
I20260928 14:50:37.814038 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d71d1147c74944da89bda163f87c7417"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.814504 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d71d1147c74944da89bda163f87c7417 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.814648 10813 raft_consensus.cc:482] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.814755 10813 raft_consensus.cc:504] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.815265 10813 leader_election.cc:288] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:37.815340 9815 ts_tablet_manager.cc:1918] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.815429 9815 log.cc:1196] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/41b8584ba1914c3390aee99baaee289e
I20260928 14:50:37.815719 9815 ts_tablet_manager.cc:1939] T 41b8584ba1914c3390aee99baaee289e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.815649 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b68f85996c674639a073b012b3e7668c" } new_table_name: "default.Table_7fff583d70804daab622a201e1425a06" modify_external_catalogs: true
W20260928 14:50:37.816707 9360 leader_election.cc:341] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:37.816756 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2e1b9160eba94bbf9e2bc2bae293d177" } modify_external_catalogs: true
I20260928 14:50:37.816947 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2e1b9160eba94bbf9e2bc2bae293d177" } modify_external_catalogs: true
W20260928 14:50:37.816983 9360 leader_election.cc:341] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:37.817058 9360 leader_election.cc:302] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.817256 10813 raft_consensus.cc:2726] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.817628 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet c5c6b0867466459ca14413559800ff64 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.818123 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cf545aef440c4f55add88d6e91729547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:37.818609 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf545aef440c4f55add88d6e91729547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.821976 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.800421 10677 raft_consensus.cc:504] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:37.822482 9497 leader_election.cc:341] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.822577 9497 leader_election.cc:302] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.822886 10630 raft_consensus.cc:2726] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.823243 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 435d9ae33a424abc83b24adbd9bd1fff (DEFAULT_TABLE table=default.Table_ed8fca0fd85f47eb89303762f2f363e7 [id=bc771da07b094653bcc02a0f525df5e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.821107 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 9efbbfe864d448ccb6b5e7cddfc8e702 (DEFAULT_TABLE table=default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525 [id=05491b57af0943a9a1d93b4d7f7b9d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.823793 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435d9ae33a424abc83b24adbd9bd1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.823932 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efbbfe864d448ccb6b5e7cddfc8e702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.825138 10677 leader_election.cc:288] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:37.821970 9814 ts_tablet_manager.cc:1918] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.825433 9814 log.cc:1196] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/1f012857690f4f91a941a5f642b9c989
I20260928 14:50:37.825711 9814 ts_tablet_manager.cc:1939] T 1f012857690f4f91a941a5f642b9c989 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.826524 9814 tablet_replica.cc:330] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.826745 9814 raft_consensus.cc:2229] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.827059 9814 raft_consensus.cc:2258] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:37.827157 9360 leader_election.cc:341] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:37.827838 9814 ts_tablet_manager.cc:1905] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:37.827950 9360 leader_election.cc:341] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:37.828303 9360 leader_election.cc:302] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:37.828552 10677 raft_consensus.cc:2726] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.830209 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 435d9ae33a424abc83b24adbd9bd1fff (DEFAULT_TABLE table=default.Table_ed8fca0fd85f47eb89303762f2f363e7 [id=bc771da07b094653bcc02a0f525df5e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.830543 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 435d9ae33a424abc83b24adbd9bd1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.833088 9814 ts_tablet_manager.cc:1918] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.833187 9814 log.cc:1196] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/11f9b039838a430eac3fd422f0f4d087
I20260928 14:50:37.833437 9814 ts_tablet_manager.cc:1939] T 11f9b039838a430eac3fd422f0f4d087 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.838253 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 59e5efe8275844c28200369135695e07 (DEFAULT_TABLE table=default.Table_147ccdd8fd7b46d6a1795605ede946e1 [id=eb33a0cd70854968964600eee44ebcb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.838647 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e5efe8275844c28200369135695e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.842054 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 59e5efe8275844c28200369135695e07 (DEFAULT_TABLE table=default.Table_147ccdd8fd7b46d6a1795605ede946e1 [id=eb33a0cd70854968964600eee44ebcb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.842412 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e5efe8275844c28200369135695e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.849210 9537 tablet_service.cc:1467] Processing CreateTablet for tablet f3cb1ec9ee0d42d795abc962b093d0dc (DEFAULT_TABLE table=default.Table_5b331f1608b64602b1a450728d95f2a7 [id=da9c48b48e2a4262af510b3bad3a48f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.849610 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3cb1ec9ee0d42d795abc962b093d0dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:37.849691 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8d84881afc441d9be2bfb5505c9156 consensus state has no leader
I20260928 14:50:37.855831 9848 tablet_bootstrap.cc:492] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.855929 9250 tablet_service.cc:1467] Processing CreateTablet for tablet f3cb1ec9ee0d42d795abc962b093d0dc (DEFAULT_TABLE table=default.Table_5b331f1608b64602b1a450728d95f2a7 [id=da9c48b48e2a4262af510b3bad3a48f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.856019 9848 ts_tablet_manager.cc:1397] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.014s
I20260928 14:50:37.856040 9254 tablet_service.cc:1467] Processing CreateTablet for tablet c4720313dae144c6b49c81a07333e7c5 (DEFAULT_TABLE table=default.Table_06baad6c6fe448b2a3cd1e0bb6c8f71d [id=80ca83c4e33f41b5a7307a99abcb908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.856389 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4720313dae144c6b49c81a07333e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.856638 9848 raft_consensus.cc:348] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.856838 9848 raft_consensus.cc:374] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.856873 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3cb1ec9ee0d42d795abc962b093d0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.856897 9848 raft_consensus.cc:729] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.857154 9848 consensus_queue.cc:260] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.859786 9848 ts_tablet_manager.cc:1428] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:37.860224 9848 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.861061 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 9efbbfe864d448ccb6b5e7cddfc8e702 (DEFAULT_TABLE table=default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525 [id=05491b57af0943a9a1d93b4d7f7b9d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.861420 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efbbfe864d448ccb6b5e7cddfc8e702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.861835 9848 tablet_bootstrap.cc:654] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.863278 10630 raft_consensus.cc:482] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.863399 10630 raft_consensus.cc:504] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.863932 10630 leader_election.cc:288] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.864256 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d1100b862b4170807be02a39307359" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.864514 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d1100b862b4170807be02a39307359" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.865070 9498 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:37.865302 9497 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.865382 9497 leader_election.cc:302] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.865869 10630 raft_consensus.cc:2726] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.869805 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]). Expected version 1 got 0
I20260928 14:50:37.873301 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 732d57c3584148f080e76dffb6b3b146 (DEFAULT_TABLE table=default.Table_3a9c2739592a40cbaad31dd1fab6cdcd [id=19c04962e15c4d2283d35e25582b4aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.873989 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732d57c3584148f080e76dffb6b3b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.875520 9813 ts_tablet_manager.cc:1918] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.875691 9813 log.cc:1196] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f3ac8adb23c5478fadb6cb6765459913
I20260928 14:50:37.876962 9813 ts_tablet_manager.cc:1939] T f3ac8adb23c5478fadb6cb6765459913 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.877815 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 736) took 1570 ms. Trace:
I20260928 14:50:37.879173 9813 rpcz_store.cc:276] 0928 14:50:36.307542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.308012 (+ 470us) service_pool.cc:227] Handling call
0928 14:50:37.718278 (+1410266us) ts_tablet_manager.cc:1145] Deleting tablet f3ac8adb23c5478fadb6cb6765459913
0928 14:50:37.718288 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.856942 (+138654us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.859414 (+ 2472us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.877799 (+ 18385us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1410083}
I20260928 14:50:37.879938 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 4ff870b182fd4cf49895fddbe2cdcf0a (DEFAULT_TABLE table=default.Table_77feeb1f7cce4d099a5d4263cc2da2a4 [id=d297d06089884c93a3c564b4d5e25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.880360 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ff870b182fd4cf49895fddbe2cdcf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.880745 9535 tablet_service.cc:1467] Processing CreateTablet for tablet c4720313dae144c6b49c81a07333e7c5 (DEFAULT_TABLE table=default.Table_06baad6c6fe448b2a3cd1e0bb6c8f71d [id=80ca83c4e33f41b5a7307a99abcb908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.881036 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f3ac8adb23c5478fadb6cb6765459913 (table default.Table_c98a8c2519314eb2a4007165e1132926 [id=b89998aa6b284cb3aab77fd891ebb997]) successfully deleted
I20260928 14:50:37.881090 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4720313dae144c6b49c81a07333e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.881371 9813 tablet_replica.cc:330] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.881736 9813 raft_consensus.cc:2229] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.882143 9813 raft_consensus.cc:2258] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.882717 9813 ts_tablet_manager.cc:1905] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.892038 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 732d57c3584148f080e76dffb6b3b146 (DEFAULT_TABLE table=default.Table_3a9c2739592a40cbaad31dd1fab6cdcd [id=19c04962e15c4d2283d35e25582b4aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.893318 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 (DEFAULT_TABLE table=default.Table_409ae5199a3841c4bac091a68a5b864e [id=a3ac0b0c16834be8b65d4fdf6c71dc71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.894126 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 4ff870b182fd4cf49895fddbe2cdcf0a (DEFAULT_TABLE table=default.Table_77feeb1f7cce4d099a5d4263cc2da2a4 [id=d297d06089884c93a3c564b4d5e25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.895143 9263 tablet_service.cc:1467] Processing CreateTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 (DEFAULT_TABLE table=default.Table_0be40c5bb8bc44b7a36723ee98a49249 [id=13f2887b03b94be198c805fc8a17cacd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.895648 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.897214 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e4b76705874f7185939d2f4e4d1df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.898267 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ff870b182fd4cf49895fddbe2cdcf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.895252 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732d57c3584148f080e76dffb6b3b146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.899300 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.899502 9814 tablet_replica.cc:330] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.899680 9814 raft_consensus.cc:2229] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.899797 9814 raft_consensus.cc:2258] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.900534 9814 ts_tablet_manager.cc:1905] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.905627 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3c4cca0f2d148ccaa69cdfe09591cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.907172 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.896736 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.907482 9815 tablet_replica.cc:330] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.907663 9815 raft_consensus.cc:2229] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.907802 9815 raft_consensus.cc:2258] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.908253 9815 ts_tablet_manager.cc:1905] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.897500 9541 tablet_service.cc:1467] Processing CreateTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 (DEFAULT_TABLE table=default.Table_0be40c5bb8bc44b7a36723ee98a49249 [id=13f2887b03b94be198c805fc8a17cacd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.908576 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3c4cca0f2d148ccaa69cdfe09591cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.909304 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b
I20260928 14:50:37.896090 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 9efbbfe864d448ccb6b5e7cddfc8e702 (DEFAULT_TABLE table=default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525 [id=05491b57af0943a9a1d93b4d7f7b9d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.913759 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efbbfe864d448ccb6b5e7cddfc8e702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.917240 9813 ts_tablet_manager.cc:1918] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:37.918020 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 36d6aa0e87854c48b52bbb20b10702d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36d6aa0e87854c48b52bbb20b10702d6 already in progress: creating tablet
I20260928 14:50:37.918728 9815 ts_tablet_manager.cc:1918] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.918818 9815 log.cc:1196] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:37.919059 9815 ts_tablet_manager.cc:1939] T d30d06c910fa4142a6248e8bfd00f4b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.920894 9814 ts_tablet_manager.cc:1918] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.920990 9814 log.cc:1196] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/a7be6013a04c4222ab34a19e77e48a37
I20260928 14:50:37.921239 9814 ts_tablet_manager.cc:1939] T a7be6013a04c4222ab34a19e77e48a37 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.922230 9814 tablet_replica.cc:330] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:37.922396 9814 raft_consensus.cc:2229] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.922586 9814 raft_consensus.cc:2258] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:37.922585 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 69ef1340deca4f00a250c390afcb5064 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ef1340deca4f00a250c390afcb5064 already in progress: creating tablet
I20260928 14:50:37.923128 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 41b8584ba1914c3390aee99baaee289e (table default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]) successfully deleted
W20260928 14:50:37.923341 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2967f173bf154bc79bd00e409122f16b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2967f173bf154bc79bd00e409122f16b already in progress: creating tablet
I20260928 14:50:37.923854 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d30d06c910fa4142a6248e8bfd00f4b2 (table default.Table_4e86b9df2c224f9083cc99ffe56ecbb4 [id=720e4385ef6d42cbbaa26b3fc3cb5521]) successfully deleted
I20260928 14:50:37.924356 9813 log.cc:1196] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2f0b97883acb4adfa4091653545e894b
I20260928 14:50:37.924695 9813 ts_tablet_manager.cc:1939] T 2f0b97883acb4adfa4091653545e894b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:37.922307 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f348f9e962748a0992d85b9d3d72aeb with delete_type TABLET_DATA_DELETED (replaced by tablet b6fed86d9eda45cab2083fca73825383) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.923054 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.925422 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 737) took 1617 ms. Trace:
I20260928 14:50:37.925571 9813 rpcz_store.cc:276] 0928 14:50:36.307629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.308232 (+ 603us) service_pool.cc:227] Handling call
0928 14:50:37.881332 (+1573100us) ts_tablet_manager.cc:1145] Deleting tablet 2f0b97883acb4adfa4091653545e894b
0928 14:50:37.881342 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.914399 (+ 33057us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.917166 (+ 2767us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.925404 (+ 8238us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1572963}
I20260928 14:50:37.926800 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2f0b97883acb4adfa4091653545e894b (table default.Table_f34a96bd3b7f44d299ae2e1b4b52c1b6 [id=fbf8441d2e0142babc627a032fa49e5f]) successfully deleted
I20260928 14:50:37.927171 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 742) took 1467 ms. Trace:
I20260928 14:50:37.932013 9813 rpcz_store.cc:276] 0928 14:50:36.459398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.459456 (+ 58us) service_pool.cc:227] Handling call
0928 14:50:37.927060 (+1467604us) ts_tablet_manager.cc:1145] Deleting tablet 1fbc88b53052473895a2d2e63da9be50
0928 14:50:37.927070 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.927156 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1467411}
I20260928 14:50:37.934245 9855 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:37.934370 9855 ts_tablet_manager.cc:1397] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.217s user 0.008s sys 0.034s
W20260928 14:50:37.934640 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1fbc88b53052473895a2d2e63da9be50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fbc88b53052473895a2d2e63da9be50 already in progress: creating tablet
I20260928 14:50:37.935096 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 743) took 1475 ms. Trace:
I20260928 14:50:37.935027 9855 raft_consensus.cc:348] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.935228 9855 raft_consensus.cc:374] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.935281 9855 raft_consensus.cc:729] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.935446 9855 consensus_queue.cc:260] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.937280 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 (DEFAULT_TABLE table=default.Table_409ae5199a3841c4bac091a68a5b864e [id=a3ac0b0c16834be8b65d4fdf6c71dc71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.937690 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e4b76705874f7185939d2f4e4d1df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.937719 9813 rpcz_store.cc:276] 0928 14:50:36.459490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.459684 (+ 194us) service_pool.cc:227] Handling call
0928 14:50:37.934977 (+1475293us) ts_tablet_manager.cc:1145] Deleting tablet 9a4a6c21a0824a93acaafa25e1b6e99c
0928 14:50:37.934989 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.935080 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1475128}
W20260928 14:50:37.938364 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9a4a6c21a0824a93acaafa25e1b6e99c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4a6c21a0824a93acaafa25e1b6e99c already in progress: creating tablet
I20260928 14:50:37.938746 9813 tablet_replica.cc:330] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:37.939002 9813 raft_consensus.cc:2229] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.939221 9813 raft_consensus.cc:2258] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.939842 9813 ts_tablet_manager.cc:1905] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.946753 9567 raft_consensus.cc:1261] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:37.947172 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 1f012857690f4f91a941a5f642b9c989 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
I20260928 14:50:37.947484 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.947585 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 11f9b039838a430eac3fd422f0f4d087 (table default.Table_e762fd7ab0074c308dc4407d3c3f70a9 [id=e249dfbd0f314fe7a4283f46d66dfd61]) successfully deleted
I20260928 14:50:37.947647 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.947773 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:37.947815 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2967f173bf154bc79bd00e409122f16b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2967f173bf154bc79bd00e409122f16b already in progress: creating tablet
W20260928 14:50:37.948004 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 69ef1340deca4f00a250c390afcb5064 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ef1340deca4f00a250c390afcb5064 already in progress: creating tablet
I20260928 14:50:37.948077 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:37.948451 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d30d06c910fa4142a6248e8bfd00f4b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d30d06c910fa4142a6248e8bfd00f4b2 already in progress: creating tablet
I20260928 14:50:37.948732 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet a7be6013a04c4222ab34a19e77e48a37 (table default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]) successfully deleted
I20260928 14:50:37.948801 9848 tablet_bootstrap.cc:492] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.948904 9848 ts_tablet_manager.cc:1397] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.089s user 0.017s sys 0.017s
I20260928 14:50:37.949328 10552 consensus_queue.cc:1035] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:37.949592 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet fbcdd6d0f24d460493293693ea7c173c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.949682 9848 raft_consensus.cc:348] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.949908 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 254ab608221e4fe2bc459f9d6fee925a from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.949929 9848 raft_consensus.cc:374] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.949990 9848 raft_consensus.cc:729] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.950199 9848 consensus_queue.cc:260] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.950729 9815 tablet_replica.cc:330] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.950891 9815 raft_consensus.cc:2229] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.951010 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 666de9dd64734708b35738605204ed7d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:37.952231 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.952797 9814 ts_tablet_manager.cc:1905] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.953851 9855 ts_tablet_manager.cc:1428] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260928 14:50:37.954154 9855 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:37.955387 10630 raft_consensus.cc:482] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:37.955556 9855 tablet_bootstrap.cc:654] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.955492 10630 raft_consensus.cc:504] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:37.955650 9815 raft_consensus.cc:2258] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.955977 10630 leader_election.cc:288] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:37.956591 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:37.956733 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:37.957590 9497 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:37.957747 9498 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:37.957845 9498 leader_election.cc:302] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:37.958433 10630 raft_consensus.cc:2726] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:37.958556 9815 ts_tablet_manager.cc:1905] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.960084 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 254ab608221e4fe2bc459f9d6fee925a
I20260928 14:50:37.960595 8955 catalog_manager.cc:6565] ReplaceTablet: tablet 254ab608221e4fe2bc459f9d6fee925a deleted and replaced by tablet 7341dac419f2443594ea9ef9c65f2daa
I20260928 14:50:37.960989 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0e6b85eeae4048bf8a6adc4ac9a93174" } new_table_name: "default.Table_78c57b0e4e8048cb8a9eb35792ecddcf" modify_external_catalogs: true
I20260928 14:50:37.961925 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 254ab608221e4fe2bc459f9d6fee925a with delete_type TABLET_DATA_DELETED (replaced by tablet 7341dac419f2443594ea9ef9c65f2daa) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.962411 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_78ef16fcfe2e4061882c68341df55233" } new_table_name: "default.Table_209dd00793a04a1093067693bad74135" modify_external_catalogs: true
W20260928 14:50:37.962918 9220 consensus_peers.cc:487] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:37.963042 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 254ab608221e4fe2bc459f9d6fee925a with delete_type TABLET_DATA_DELETED (replaced by tablet 7341dac419f2443594ea9ef9c65f2daa) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:37.963624 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e3a9f292618469c8d84da18059419b0 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:37.964219 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b already in progress: creating tablet
I20260928 14:50:37.966440 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5bf215c87d4d499286d9824a4a711ea2" } modify_external_catalogs: true
I20260928 14:50:37.966660 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5bf215c87d4d499286d9824a4a711ea2" } modify_external_catalogs: true
I20260928 14:50:37.967242 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e" } modify_external_catalogs: true
I20260928 14:50:37.967409 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4bb8a0b9b6ed4d37841bd9edd052a13e" } modify_external_catalogs: true
I20260928 14:50:37.968008 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_761212a0dd2944578382b3315eff2301"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:37.968485 9815 ts_tablet_manager.cc:1918] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.968547 9848 ts_tablet_manager.cc:1428] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260928 14:50:37.968573 9815 log.cc:1196] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/92d1100b862b4170807be02a39307359
W20260928 14:50:37.968614 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_761212a0dd2944578382b3315eff2301 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:37.968850 9815 ts_tablet_manager.cc:1939] T 92d1100b862b4170807be02a39307359 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:37.969707 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 92d1100b862b4170807be02a39307359 (table default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]) successfully deleted
I20260928 14:50:37.972608 9848 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:37.974157 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 (DEFAULT_TABLE table=default.Table_409ae5199a3841c4bac091a68a5b864e [id=a3ac0b0c16834be8b65d4fdf6c71dc71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.974464 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e4b76705874f7185939d2f4e4d1df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.976928 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:37.977228 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 254ab608221e4fe2bc459f9d6fee925a with delete_type TABLET_DATA_DELETED (replaced by tablet 7341dac419f2443594ea9ef9c65f2daa) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.977330 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet dc8400fdb8d948b084733011b16df1b3 with delete_type TABLET_DATA_DELETED (replaced by tablet baa80c213f3f4aa9976cc285f6564e0f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.980280 9851 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:37.980419 9851 ts_tablet_manager.cc:1397] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.253s user 0.012s sys 0.032s
I20260928 14:50:37.981259 9848 tablet_bootstrap.cc:654] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:37.981864 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 17cd74cf48ce42c3beda4556213f416a (DEFAULT_TABLE table=default.Table_981f3c2507b14b5fb64a0f1c271bd483 [id=bfb0120f6e8a44ba9882645ec25f7494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.982963 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 17cd74cf48ce42c3beda4556213f416a (DEFAULT_TABLE table=default.Table_981f3c2507b14b5fb64a0f1c271bd483 [id=bfb0120f6e8a44ba9882645ec25f7494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.983021 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 17cd74cf48ce42c3beda4556213f416a (DEFAULT_TABLE table=default.Table_981f3c2507b14b5fb64a0f1c271bd483 [id=bfb0120f6e8a44ba9882645ec25f7494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.983345 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17cd74cf48ce42c3beda4556213f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.983371 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17cd74cf48ce42c3beda4556213f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.984195 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17cd74cf48ce42c3beda4556213f416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.984926 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b042c6ffc148939dcba9b710f198d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 82a58b7387564863a2141a722003c5d1) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:37.986074 9267 tablet_service.cc:1467] Processing CreateTablet for tablet b9ab56f3239c4ef7abf1fe5af8b5635e (DEFAULT_TABLE table=default.Table_b811f325d4094e6da33f9ee8aec3e2d4 [id=6f6253235e144084bd84c58a7d6d5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:37.986384 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9ab56f3239c4ef7abf1fe5af8b5635e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.991154 9815 tablet_replica.cc:330] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:37.991322 9815 raft_consensus.cc:2229] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:37.991436 9815 raft_consensus.cc:2258] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:37.992573 9815 ts_tablet_manager.cc:1905] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:37.993244 9814 ts_tablet_manager.cc:1918] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.993355 9814 log.cc:1196] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2e16a0f674114ac8b4520fbce2d383d8
I20260928 14:50:37.993649 9814 ts_tablet_manager.cc:1939] T 2e16a0f674114ac8b4520fbce2d383d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:37.994495 9848 tablet_bootstrap.cc:492] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:37.993119 9851 raft_consensus.cc:348] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.994886 9851 raft_consensus.cc:374] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.995087 9851 raft_consensus.cc:729] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:37.995410 9851 consensus_queue.cc:260] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.995712 9848 ts_tablet_manager.cc:1397] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260928 14:50:37.996662 9851 ts_tablet_manager.cc:1428] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260928 14:50:37.997192 9848 raft_consensus.cc:348] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:37.997987 9851 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:37.998310 9848 raft_consensus.cc:374] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:37.999680 9813 ts_tablet_manager.cc:1918] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:37.998879 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b9ab56f3239c4ef7abf1fe5af8b5635e (DEFAULT_TABLE table=default.Table_b811f325d4094e6da33f9ee8aec3e2d4 [id=6f6253235e144084bd84c58a7d6d5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.000101 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9ab56f3239c4ef7abf1fe5af8b5635e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:37.999608 9851 tablet_bootstrap.cc:654] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.006028 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ba13ee7a68284a0d8ab81d5b234980bf" } modify_external_catalogs: true
I20260928 14:50:38.008904 9814 tablet_replica.cc:330] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.009161 9814 raft_consensus.cc:2229] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.009296 10630 consensus_queue.cc:1035] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:38.011454 9814 raft_consensus.cc:2258] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.012473 9814 ts_tablet_manager.cc:1905] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.013346 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2e16a0f674114ac8b4520fbce2d383d8 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
W20260928 14:50:38.014019 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b already in progress: creating tablet
W20260928 14:50:38.014321 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5127a4bb7e114ec09235c9e29f614156 consensus state has no leader
I20260928 14:50:38.014636 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 (DEFAULT_TABLE table=default.Table_82daf59a1acc4e2fac99cb20233e41cd [id=b7b6d7fca1454ae094ea3ee62272f9c3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:38.014910 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a78d6d6db7a1484498c7496ddbdc29fb consensus state has no leader
I20260928 14:50:38.014866 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 5eadeeeaa9384684b41b1abbafc4724d (DEFAULT_TABLE table=default.Table_0442e8587ed34e64ab67fbc8a2030827 [id=62ed6dc44c5e4016bb0e72b0099ce9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.014966 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad13af827fd4a08b5bda4a53720c3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.015403 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ba13ee7a68284a0d8ab81d5b234980bf" } modify_external_catalogs: true
I20260928 14:50:38.015621 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 (DEFAULT_TABLE table=default.Table_82daf59a1acc4e2fac99cb20233e41cd [id=b7b6d7fca1454ae094ea3ee62272f9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.015981 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eadeeeaa9384684b41b1abbafc4724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.016604 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 666de9dd64734708b35738605204ed7d
I20260928 14:50:38.017818 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet d806161b858145e1a4fa946587ae1529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.017958 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 666de9dd64734708b35738605204ed7d deleted and replaced by tablet f421b29c12cb4b5989de6bebcf04639f
I20260928 14:50:38.018414 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 (DEFAULT_TABLE table=default.Table_82daf59a1acc4e2fac99cb20233e41cd [id=b7b6d7fca1454ae094ea3ee62272f9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.018529 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 666de9dd64734708b35738605204ed7d with delete_type TABLET_DATA_DELETED (replaced by tablet f421b29c12cb4b5989de6bebcf04639f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.018746 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad13af827fd4a08b5bda4a53720c3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.021452 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 666de9dd64734708b35738605204ed7d with delete_type TABLET_DATA_DELETED (replaced by tablet f421b29c12cb4b5989de6bebcf04639f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.022745 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d6e0800aba3144c9979a09b959f5efc8
I20260928 14:50:38.023523 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet d6e0800aba3144c9979a09b959f5efc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.023911 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet d6e0800aba3144c9979a09b959f5efc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.024041 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet d6e0800aba3144c9979a09b959f5efc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.024221 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 666de9dd64734708b35738605204ed7d with delete_type TABLET_DATA_DELETED (replaced by tablet f421b29c12cb4b5989de6bebcf04639f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.025473 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 5eadeeeaa9384684b41b1abbafc4724d (DEFAULT_TABLE table=default.Table_0442e8587ed34e64ab67fbc8a2030827 [id=62ed6dc44c5e4016bb0e72b0099ce9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.025827 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eadeeeaa9384684b41b1abbafc4724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.025982 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 5eadeeeaa9384684b41b1abbafc4724d (DEFAULT_TABLE table=default.Table_0442e8587ed34e64ab67fbc8a2030827 [id=62ed6dc44c5e4016bb0e72b0099ce9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.026289 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eadeeeaa9384684b41b1abbafc4724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.027354 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 540a929843d3466f8f2d3ba7b2f994ca (DEFAULT_TABLE table=default.Table_17d6c76dc8614d8dae2cf9c971111123 [id=6750432a1a624a9cb9ce840fb99389c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.027653 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540a929843d3466f8f2d3ba7b2f994ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.027628 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 2841006a06b84a0e8408743024955d51 (DEFAULT_TABLE table=default.Table_6795ae14f0b0489799a67da3c1a29565 [id=6beba8982ba946c1b274d99833dcf024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.027933 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2841006a06b84a0e8408743024955d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.030700 9422 raft_consensus.cc:3037] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.031663 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 2841006a06b84a0e8408743024955d51 (DEFAULT_TABLE table=default.Table_6795ae14f0b0489799a67da3c1a29565 [id=6beba8982ba946c1b274d99833dcf024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.031967 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2841006a06b84a0e8408743024955d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.033553 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 2841006a06b84a0e8408743024955d51 (DEFAULT_TABLE table=default.Table_6795ae14f0b0489799a67da3c1a29565 [id=6beba8982ba946c1b274d99833dcf024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.033859 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2841006a06b84a0e8408743024955d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.039417 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.039590 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fbcdd6d0f24d460493293693ea7c173c
I20260928 14:50:38.040040 8956 catalog_manager.cc:6565] ReplaceTablet: tablet fbcdd6d0f24d460493293693ea7c173c deleted and replaced by tablet d263a96b792346b6af2a6eb29737afb6
I20260928 14:50:38.040544 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet fbcdd6d0f24d460493293693ea7c173c with delete_type TABLET_DATA_DELETED (replaced by tablet d263a96b792346b6af2a6eb29737afb6) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.040789 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5c6d593318244002b103f29f10fd02b2
I20260928 14:50:38.041695 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 540a929843d3466f8f2d3ba7b2f994ca (DEFAULT_TABLE table=default.Table_17d6c76dc8614d8dae2cf9c971111123 [id=6750432a1a624a9cb9ce840fb99389c7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:38.041872 9220 consensus_peers.cc:487] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:38.042203 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 540a929843d3466f8f2d3ba7b2f994ca (DEFAULT_TABLE table=default.Table_17d6c76dc8614d8dae2cf9c971111123 [id=6750432a1a624a9cb9ce840fb99389c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.042471 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540a929843d3466f8f2d3ba7b2f994ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.043733 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c6d593318244002b103f29f10fd02b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.043903 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet fbcdd6d0f24d460493293693ea7c173c with delete_type TABLET_DATA_DELETED (replaced by tablet d263a96b792346b6af2a6eb29737afb6) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.044114 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540a929843d3466f8f2d3ba7b2f994ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.045270 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet fbcdd6d0f24d460493293693ea7c173c with delete_type TABLET_DATA_DELETED (replaced by tablet d263a96b792346b6af2a6eb29737afb6) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.045439 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c6d593318244002b103f29f10fd02b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.045670 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ad13af827fd4a08b5bda4a53720c3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.050365 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 60ede1d7f93047b08e043aa32213cd05
I20260928 14:50:38.050933 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c6d593318244002b103f29f10fd02b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.051105 9813 log.cc:1196] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9648be4c626e44e0986c196704483955
I20260928 14:50:38.051249 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ede1d7f93047b08e043aa32213cd05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.051376 9813 ts_tablet_manager.cc:1939] T 9648be4c626e44e0986c196704483955 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.051453 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ede1d7f93047b08e043aa32213cd05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.052026 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 746) took 1592 ms. Trace:
I20260928 14:50:38.052124 9813 rpcz_store.cc:276] 0928 14:50:36.459775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.459824 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:37.938693 (+1478869us) ts_tablet_manager.cc:1145] Deleting tablet 9648be4c626e44e0986c196704483955
0928 14:50:37.938707 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:37.943065 (+ 4358us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:37.999603 (+ 56538us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.052008 (+ 52405us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1478728}
I20260928 14:50:38.052561 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9648be4c626e44e0986c196704483955 (table default.Table_f00db4ef6925410f9db9f1a923d2bfeb [id=b293b6f6bfe64fe8a930fdacb3ba12bd]) successfully deleted
I20260928 14:50:38.053877 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 60ede1d7f93047b08e043aa32213cd05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.055804 9537 tablet_service.cc:1467] Processing CreateTablet for tablet b9ab56f3239c4ef7abf1fe5af8b5635e (DEFAULT_TABLE table=default.Table_b811f325d4094e6da33f9ee8aec3e2d4 [id=6f6253235e144084bd84c58a7d6d5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.056862 9815 ts_tablet_manager.cc:1918] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.056959 9815 log.cc:1196] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:38.057210 9815 ts_tablet_manager.cc:1939] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.058094 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 744) took 1598 ms. Trace:
I20260928 14:50:38.058101 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (table default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]) successfully deleted
I20260928 14:50:38.058182 9813 rpcz_store.cc:276] 0928 14:50:36.459572 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.459873 (+ 301us) service_pool.cc:227] Handling call
0928 14:50:38.057971 (+1598098us) ts_tablet_manager.cc:1145] Deleting tablet 1e3a9f292618469c8d84da18059419b0
0928 14:50:38.057983 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.058065 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597961}
I20260928 14:50:38.058137 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9ab56f3239c4ef7abf1fe5af8b5635e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:38.058589 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1e3a9f292618469c8d84da18059419b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e3a9f292618469c8d84da18059419b0 already in progress: creating tablet
I20260928 14:50:38.060838 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 740) took 1601 ms. Trace:
I20260928 14:50:38.061338 9813 rpcz_store.cc:276] 0928 14:50:36.459204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.459932 (+ 728us) service_pool.cc:227] Handling call
0928 14:50:38.060729 (+1600797us) ts_tablet_manager.cc:1145] Deleting tablet 286f5e0fb1414305ab0a1b5df3ed4ff3
0928 14:50:38.060740 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.060821 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600610}
W20260928 14:50:38.061827 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 already in progress: creating tablet
I20260928 14:50:37.999756 9848 raft_consensus.cc:729] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.062259 9848 consensus_queue.cc:260] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.062927 9855 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.063048 9855 ts_tablet_manager.cc:1397] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.109s user 0.018s sys 0.036s
I20260928 14:50:38.063056 9848 ts_tablet_manager.cc:1428] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.067s user 0.000s sys 0.002s
I20260928 14:50:38.063373 9848 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.064118 9855 raft_consensus.cc:348] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.064399 9855 raft_consensus.cc:374] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.064477 9855 raft_consensus.cc:729] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.064662 9855 consensus_queue.cc:260] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.065126 9855 ts_tablet_manager.cc:1428] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:38.064715 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 741) took 1605 ms. Trace:
I20260928 14:50:38.065359 9855 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.065271 9813 rpcz_store.cc:276] 0928 14:50:36.459305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.460153 (+ 848us) service_pool.cc:227] Handling call
0928 14:50:38.064427 (+1604274us) ts_tablet_manager.cc:1145] Deleting tablet 7aff7724868140b3b544d6b1f237b6fa
0928 14:50:38.064437 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.064699 (+ 262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604132}
I20260928 14:50:38.065753 9814 ts_tablet_manager.cc:1918] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:38.065778 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7aff7724868140b3b544d6b1f237b6fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aff7724868140b3b544d6b1f237b6fa already in progress: creating tablet
I20260928 14:50:38.065855 9814 log.cc:1196] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/11714d0ca321429c95de223320794a0e
I20260928 14:50:38.066123 9814 ts_tablet_manager.cc:1939] T 11714d0ca321429c95de223320794a0e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.066308 9813 tablet_replica.cc:330] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.066515 9813 raft_consensus.cc:2229] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.066545 9855 tablet_bootstrap.cc:654] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.066957 9813 raft_consensus.cc:2258] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.067500 9813 ts_tablet_manager.cc:1905] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.066835 9848 tablet_bootstrap.cc:654] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.078142 9813 ts_tablet_manager.cc:1918] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.078277 9851 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.078404 9851 ts_tablet_manager.cc:1397] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.004s
I20260928 14:50:38.079073 9851 raft_consensus.cc:348] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.079282 9851 raft_consensus.cc:374] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.079344 9851 raft_consensus.cc:729] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.079546 9851 consensus_queue.cc:260] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.080135 9851 ts_tablet_manager.cc:1428] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:38.080889 9851 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.081453 9815 tablet_replica.cc:330] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.082968 9815 raft_consensus.cc:2229] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:38.083261 9815 raft_consensus.cc:2258] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.083724 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet d199c65d3b4040388360fd8302d7cb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.080286 9813 log.cc:1196] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/3f8db468ad3c4bba8c701c3d8feba9f4
I20260928 14:50:38.084295 9813 ts_tablet_manager.cc:1939] T 3f8db468ad3c4bba8c701c3d8feba9f4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.085423 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 745) took 1625 ms. Trace:
I20260928 14:50:38.086012 9848 tablet_bootstrap.cc:492] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.086212 9848 ts_tablet_manager.cc:1397] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.005s
I20260928 14:50:38.086905 9848 raft_consensus.cc:348] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.087162 9848 raft_consensus.cc:374] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.087304 9848 raft_consensus.cc:729] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.087536 9848 consensus_queue.cc:260] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.091388 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d313471146084c3c806a3c01b1c77538" } new_table_name: "default.Table_6b9ef5b0cda2426bb8bf6a02c4e950cc" modify_external_catalogs: true
I20260928 14:50:38.092607 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1182be7988c347c290306523abc75e4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.092675 9815 ts_tablet_manager.cc:1905] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:38.093127 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1182be7988c347c290306523abc75e4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.094453 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_148c366515f54e61a270e84886a7af20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.094899 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_148c366515f54e61a270e84886a7af20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.099454 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad5c36aafd154f249086a527bf95426e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.099870 9814 tablet_replica.cc:330] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:38.099941 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad5c36aafd154f249086a527bf95426e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.100050 9814 raft_consensus.cc:2229] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.100203 9814 raft_consensus.cc:2258] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:38.106724 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a56b4c06e18e4d13adc5c1cfed6c2007 consensus state has no leader
I20260928 14:50:38.108685 9815 ts_tablet_manager.cc:1918] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:38.108788 9815 log.cc:1196] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/254ab608221e4fe2bc459f9d6fee925a
I20260928 14:50:38.109086 9815 ts_tablet_manager.cc:1939] T 254ab608221e4fe2bc459f9d6fee925a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.109337 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 11714d0ca321429c95de223320794a0e (table default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]) successfully deleted
I20260928 14:50:38.109962 9814 ts_tablet_manager.cc:1905] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.111362 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.114957 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_68635365d02e43d7865b30d3eaf7ac6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.115108 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_842f7ea913494cddabfad1158c95b762" } modify_external_catalogs: true
I20260928 14:50:38.115293 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_842f7ea913494cddabfad1158c95b762" } modify_external_catalogs: true
W20260928 14:50:38.115527 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68635365d02e43d7865b30d3eaf7ac6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.115872 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8e132204dd2e4ea9bcec96f5d7018df6" } new_table_name: "default.Table_cb52782bde064ae2b1ea4ca8d30db871" modify_external_catalogs: true
I20260928 14:50:38.117106 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_76ceb36c6040454bbc8cfb60cdda6eb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.119155 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bea51859e0c4bc984288f94c2fcea2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:38.120411 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76ceb36c6040454bbc8cfb60cdda6eb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.124945 9848 ts_tablet_manager.cc:1428] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.039s user 0.001s sys 0.001s
W20260928 14:50:38.127967 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fcc42af91c247b1b80059e95e3659cf consensus state has no leader
I20260928 14:50:38.129750 9814 ts_tablet_manager.cc:1918] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:38.129909 9814 log.cc:1196] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/254ab608221e4fe2bc459f9d6fee925a
I20260928 14:50:38.130256 9848 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.133899 10677 raft_consensus.cc:482] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.134022 10677 raft_consensus.cc:504] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:38.134533 10677 leader_election.cc:288] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.134949 10677 raft_consensus.cc:482] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.135053 10677 raft_consensus.cc:504] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.135511 10677 leader_election.cc:288] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:38.135516 9360 leader_election.cc:341] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8b914e3c8243490d92378a8765d6390f
W20260928 14:50:38.136605 9360 leader_election.cc:341] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:38.136703 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
W20260928 14:50:38.136795 9360 leader_election.cc:341] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:38.136868 9360 leader_election.cc:302] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.137264 10677 raft_consensus.cc:2726] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.137943 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3df6b184a5394a02968435fcfb6a1090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.139257 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
W20260928 14:50:38.139699 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 666de9dd64734708b35738605204ed7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666de9dd64734708b35738605204ed7d already in progress: creating tablet
W20260928 14:50:38.139701 9360 leader_election.cc:341] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 8b914e3c8243490d92378a8765d6390f
I20260928 14:50:38.139791 9360 leader_election.cc:302] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.139979 10677 raft_consensus.cc:2726] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:38.140931 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df6b184a5394a02968435fcfb6a1090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.142318 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d6e0800aba3144c9979a09b959f5efc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6e0800aba3144c9979a09b959f5efc8 already in progress: creating tablet
W20260928 14:50:38.143045 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5c6d593318244002b103f29f10fd02b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6d593318244002b103f29f10fd02b2 already in progress: creating tablet
W20260928 14:50:38.143761 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fbcdd6d0f24d460493293693ea7c173c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbcdd6d0f24d460493293693ea7c173c already in progress: creating tablet
W20260928 14:50:38.145084 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 60ede1d7f93047b08e043aa32213cd05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ede1d7f93047b08e043aa32213cd05 already in progress: creating tablet
I20260928 14:50:38.145296 10630 raft_consensus.cc:482] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.145411 10630 raft_consensus.cc:504] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.145949 10630 leader_election.cc:288] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.146057 10630 raft_consensus.cc:482] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.146150 10630 raft_consensus.cc:504] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.146545 10630 leader_election.cc:288] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.147305 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3a9f292618469c8d84da18059419b0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:38.147796 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f17eb03f5ed4cb581c29fc0d8619ff2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.148993 9498 leader_election.cc:341] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:38.149173 9498 leader_election.cc:341] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.149916 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7b03a4e80e63423fbad18fb6849f9015"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.150097 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_985a3dd0ae1844b5896f4cffa47a0fd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.150452 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b03a4e80e63423fbad18fb6849f9015 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.150651 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_985a3dd0ae1844b5896f4cffa47a0fd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.151822 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd" } modify_external_catalogs: true
I20260928 14:50:38.152010 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_22d3f5131f0c4a07a35a65d77aa7d0fd" } modify_external_catalogs: true
I20260928 14:50:38.152571 10630 raft_consensus.cc:482] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.152721 10630 raft_consensus.cc:504] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.149439 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3f1a26bb56a54c2d8680c9dfa4350471"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.153342 10630 leader_election.cc:288] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:38.153414 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f1a26bb56a54c2d8680c9dfa4350471 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.153539 10630 raft_consensus.cc:482] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.153677 10630 raft_consensus.cc:504] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.153789 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.154206 9498 leader_election.cc:341] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.154646 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ffc5bee62845519a4b7ee8c914e70d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.155041 9498 leader_election.cc:341] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.154210 10630 leader_election.cc:288] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.158599 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_981f3c2507b14b5fb64a0f1c271bd483" } new_table_name: "default.Table_431c77ade78b48c5bf9d05d1f976d3a1" modify_external_catalogs: true
I20260928 14:50:38.160704 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd260373e4047b6ae5e0e6146cd4425 (DEFAULT_TABLE table=default.Table_761212a0dd2944578382b3315eff2301 [id=03d0f11039644fa3a46a17664abbdf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.161087 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd260373e4047b6ae5e0e6146cd4425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.161473 9851 tablet_bootstrap.cc:654] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.166138 9814 ts_tablet_manager.cc:1939] T 254ab608221e4fe2bc459f9d6fee925a P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.167358 9814 tablet_replica.cc:330] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.167732 9814 raft_consensus.cc:2229] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.167922 9814 raft_consensus.cc:2258] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.168375 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:38.169390 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f17eb03f5ed4cb581c29fc0d8619ff2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.170040 9814 ts_tablet_manager.cc:1905] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.171109 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ffc5bee62845519a4b7ee8c914e70d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.170220 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3a9f292618469c8d84da18059419b0" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.170648 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:38.172505 9497 leader_election.cc:341] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.172856 9497 leader_election.cc:302] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:38.173233 9497 leader_election.cc:341] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.173372 9497 leader_election.cc:302] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:38.173722 9497 leader_election.cc:341] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.173857 9497 leader_election.cc:302] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.174079 10630 raft_consensus.cc:2726] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.174312 10630 raft_consensus.cc:2726] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.174494 10630 raft_consensus.cc:2726] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.172709 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.174814 9815 tablet_replica.cc:330] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:38.174945 9497 leader_election.cc:341] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.174985 9815 raft_consensus.cc:2229] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.175021 9497 leader_election.cc:302] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.175101 9815 raft_consensus.cc:2258] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.175333 10894 raft_consensus.cc:2726] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.175838 9815 ts_tablet_manager.cc:1905] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.178614 9851 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.178745 9851 ts_tablet_manager.cc:1397] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260928 14:50:38.179510 9851 raft_consensus.cc:348] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.179697 9851 raft_consensus.cc:374] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.179747 9851 raft_consensus.cc:729] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.179926 9851 consensus_queue.cc:260] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.181423 9855 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.181584 9855 ts_tablet_manager.cc:1397] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.116s user 0.009s sys 0.008s
I20260928 14:50:38.182337 9855 raft_consensus.cc:348] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.182552 9855 raft_consensus.cc:374] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.182626 9855 raft_consensus.cc:729] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.183946 9851 ts_tablet_manager.cc:1428] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:38.184002 10677 raft_consensus.cc:482] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.184135 10677 raft_consensus.cc:504] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.184350 9851 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.184660 10677 leader_election.cc:288] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:38.185629 9360 leader_election.cc:341] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:38.186120 9855 consensus_queue.cc:260] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.186887 9815 ts_tablet_manager.cc:1918] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.187032 9815 log.cc:1196] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1e3a9f292618469c8d84da18059419b0
I20260928 14:50:38.187140 9855 ts_tablet_manager.cc:1428] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 14:50:38.187412 9855 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.188661 9855 tablet_bootstrap.cc:654] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.188659 9815 ts_tablet_manager.cc:1939] T 1e3a9f292618469c8d84da18059419b0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.190376 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd260373e4047b6ae5e0e6146cd4425 (DEFAULT_TABLE table=default.Table_761212a0dd2944578382b3315eff2301 [id=03d0f11039644fa3a46a17664abbdf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.190815 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1e3a9f292618469c8d84da18059419b0 (table default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]) successfully deleted
W20260928 14:50:38.191511 9360 leader_election.cc:341] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:38.191630 9360 leader_election.cc:302] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.192564 10677 raft_consensus.cc:2726] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.192917 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd260373e4047b6ae5e0e6146cd4425 (DEFAULT_TABLE table=default.Table_761212a0dd2944578382b3315eff2301 [id=03d0f11039644fa3a46a17664abbdf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.193248 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd260373e4047b6ae5e0e6146cd4425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.193915 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd260373e4047b6ae5e0e6146cd4425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.200388 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.202101 9815 tablet_replica.cc:330] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.202968 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 (DEFAULT_TABLE table=default.Table_fed64561dbc24fbf960eabea8c2db568 [id=ab8e4e43864d42c6a528ff31d192478c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.203366 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220eb184524b4cd58a4642dbbed5e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.207091 9851 tablet_bootstrap.cc:654] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.208271 9815 raft_consensus.cc:2229] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.209312 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 (DEFAULT_TABLE table=default.Table_fed64561dbc24fbf960eabea8c2db568 [id=ab8e4e43864d42c6a528ff31d192478c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.209784 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220eb184524b4cd58a4642dbbed5e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.211539 9815 raft_consensus.cc:2258] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.213400 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 (DEFAULT_TABLE table=default.Table_fed64561dbc24fbf960eabea8c2db568 [id=ab8e4e43864d42c6a528ff31d192478c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.214217 9815 ts_tablet_manager.cc:1905] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.214496 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220eb184524b4cd58a4642dbbed5e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.214655 9848 tablet_bootstrap.cc:654] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.216039 9254 tablet_service.cc:1467] Processing CreateTablet for tablet d263a96b792346b6af2a6eb29737afb6 (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.216365 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d263a96b792346b6af2a6eb29737afb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.216802 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d0ae614c249b453da761cdb9df68f62c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.217460 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0ae614c249b453da761cdb9df68f62c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.218557 9855 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.220335 9851 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.220456 9851 ts_tablet_manager.cc:1397] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.005s
I20260928 14:50:38.221112 9851 raft_consensus.cc:348] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.221305 9851 raft_consensus.cc:374] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.221356 9851 raft_consensus.cc:729] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.221634 9855 ts_tablet_manager.cc:1397] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260928 14:50:38.221580 9851 consensus_queue.cc:260] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.222947 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0452fe5fc0694c6485030fef808415e4" } new_table_name: "default.Table_c5f832e990de4254b20d4c6516c0773a" modify_external_catalogs: true
I20260928 14:50:38.223713 9851 ts_tablet_manager.cc:1428] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:38.225934 9815 ts_tablet_manager.cc:1918] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.226052 9815 log.cc:1196] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/cbb232c73f014351b796a86180ffb660
I20260928 14:50:38.226277 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_06137559c56b4a89bf8f49323ac5b93a" } modify_external_catalogs: true
I20260928 14:50:38.226393 9815 ts_tablet_manager.cc:1939] T cbb232c73f014351b796a86180ffb660 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.226507 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.226472 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_06137559c56b4a89bf8f49323ac5b93a" } modify_external_catalogs: true
I20260928 14:50:38.227882 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet cbb232c73f014351b796a86180ffb660 (table default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]) successfully deleted
I20260928 14:50:38.229893 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.229895 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_46d9270039b54ce2bf37ad096b1afb95" } new_table_name: "default.Table_a0ec01ddefa34c6f87a1ba767f50336f" modify_external_catalogs: true
W20260928 14:50:38.230744 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cbb232c73f014351b796a86180ffb660 because the tablet was not found. No further retry: Not found: Tablet not found: cbb232c73f014351b796a86180ffb660
I20260928 14:50:38.231366 9814 ts_tablet_manager.cc:1918] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.219856 9813 rpcz_store.cc:276] 0928 14:50:36.459669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.461271 (+ 1602us) service_pool.cc:227] Handling call
0928 14:50:38.066270 (+1604999us) ts_tablet_manager.cc:1145] Deleting tablet 3f8db468ad3c4bba8c701c3d8feba9f4
0928 14:50:38.066280 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.071337 (+ 5057us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.078057 (+ 6720us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.085406 (+ 7349us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604864}
I20260928 14:50:38.227502 9399 tablet_service.cc:1467] Processing CreateTablet for tablet d263a96b792346b6af2a6eb29737afb6 (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.235777 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d263a96b792346b6af2a6eb29737afb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.239459 9529 tablet_service.cc:1467] Processing CreateTablet for tablet d263a96b792346b6af2a6eb29737afb6 (DEFAULT_TABLE table=default.Table_304c4f68873343d6a5f9e77b05c8dfcc [id=55f6f5ee41804ad0bd8b0bc7857caf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.239845 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 4d48886de3194e898da13b5d546ca9d8 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.240180 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d48886de3194e898da13b5d546ca9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.241585 9814 log.cc:1196] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/28ee844aa3c24336b4acb66dc43186e9
I20260928 14:50:38.241876 9814 ts_tablet_manager.cc:1939] T 28ee844aa3c24336b4acb66dc43186e9 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.243456 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 7341dac419f2443594ea9ef9c65f2daa (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.243805 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7341dac419f2443594ea9ef9c65f2daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.243779 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 7341dac419f2443594ea9ef9c65f2daa (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.244113 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7341dac419f2443594ea9ef9c65f2daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.246034 10817 raft_consensus.cc:482] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.246155 10817 raft_consensus.cc:504] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.246644 10817 leader_election.cc:288] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.250290 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 4d48886de3194e898da13b5d546ca9d8 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.231534 9851 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.251395 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5ae9c6ae0c9546e6baa12f13668969ea
I20260928 14:50:38.239338 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 4d48886de3194e898da13b5d546ca9d8 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.251942 9851 tablet_bootstrap.cc:654] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.252123 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d48886de3194e898da13b5d546ca9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.252355 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.252873 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.253729 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ae9c6ae0c9546e6baa12f13668969ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.253679 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8520b28899bc42b08e239502adb8fece" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.254235 9220 leader_election.cc:341] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.254311 10817 raft_consensus.cc:482] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.254406 10817 raft_consensus.cc:504] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.254922 10817 leader_election.cc:288] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.255317 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:38.255550 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 7341dac419f2443594ea9ef9c65f2daa (DEFAULT_TABLE table=default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:38.255815 9220 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.256790 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 28ee844aa3c24336b4acb66dc43186e9 (table default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f [id=544d8d04f58f4aee9d4b04c45d9f9cd8]) successfully deleted
I20260928 14:50:38.258270 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_964ad582e5a24995b2497d7f1d90068d" } modify_external_catalogs: true
I20260928 14:50:38.258472 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_964ad582e5a24995b2497d7f1d90068d" } modify_external_catalogs: true
I20260928 14:50:38.260073 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d3442fc50ac47deafcaab819720545b" } modify_external_catalogs: true
W20260928 14:50:38.260164 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d6e0800aba3144c9979a09b959f5efc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6e0800aba3144c9979a09b959f5efc8 already in progress: creating tablet
I20260928 14:50:38.260342 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4d3442fc50ac47deafcaab819720545b" } modify_external_catalogs: true
I20260928 14:50:38.260753 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:38.260942 9569 raft_consensus.cc:2454] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:38.261765 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d263a96b792346b6af2a6eb29737afb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:38.261950 9219 leader_election.cc:341] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8520b28899bc42b08e239502adb8fece
I20260928 14:50:38.262041 9219 leader_election.cc:302] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.262357 9219 leader_election.cc:302] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.262629 10552 raft_consensus.cc:2726] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.262754 10552 raft_consensus.cc:2781] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:38.262799 10552 raft_consensus.cc:482] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:38.262851 10552 raft_consensus.cc:3037] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.262862 9855 raft_consensus.cc:348] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.263069 9855 raft_consensus.cc:374] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.263119 9855 raft_consensus.cc:729] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.263593 9250 tablet_service.cc:1467] Processing CreateTablet for tablet c19910c560964cc6a17cc11f141d647d (DEFAULT_TABLE table=default.Table_cf545aef440c4f55add88d6e91729547 [id=a293d2c34a274be09de1ffce8065ca42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.263914 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c19910c560964cc6a17cc11f141d647d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.265134 10552 raft_consensus.cc:504] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.265784 10552 leader_election.cc:288] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.266162 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:38.266304 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:38.266463 9569 raft_consensus.cc:3037] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:38.266693 9220 leader_election.cc:341] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.267149 9855 consensus_queue.cc:260] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.268030 9529 tablet_service.cc:1467] Processing CreateTablet for tablet c19910c560964cc6a17cc11f141d647d (DEFAULT_TABLE table=default.Table_cf545aef440c4f55add88d6e91729547 [id=a293d2c34a274be09de1ffce8065ca42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.268479 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c19910c560964cc6a17cc11f141d647d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.268551 9855 ts_tablet_manager.cc:1428] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260928 14:50:38.268707 9569 raft_consensus.cc:2454] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:38.269254 9219 leader_election.cc:302] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.269976 10552 raft_consensus.cc:2781] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:38.270090 10552 raft_consensus.cc:686] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:38.270298 10552 consensus_queue.cc:237] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.268842 9855 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.272509 9399 tablet_service.cc:1467] Processing CreateTablet for tablet f421b29c12cb4b5989de6bebcf04639f (DEFAULT_TABLE table=default.Table_db83f8c905e54fbeb75b212120f77ba7 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.272827 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f421b29c12cb4b5989de6bebcf04639f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.275199 9267 tablet_service.cc:1467] Processing CreateTablet for tablet f421b29c12cb4b5989de6bebcf04639f (DEFAULT_TABLE table=default.Table_db83f8c905e54fbeb75b212120f77ba7 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.275537 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f421b29c12cb4b5989de6bebcf04639f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.282406 9855 tablet_bootstrap.cc:654] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:38.283450 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 666de9dd64734708b35738605204ed7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666de9dd64734708b35738605204ed7d already in progress: creating tablet
I20260928 14:50:38.283812 9814 tablet_replica.cc:330] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.284082 10897 raft_consensus.cc:482] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.284075 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 3f8db468ad3c4bba8c701c3d8feba9f4 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
I20260928 14:50:38.284200 10897 raft_consensus.cc:504] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.284355 9813 tablet_replica.cc:330] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.284524 9813 raft_consensus.cc:2229] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.284715 9813 raft_consensus.cc:2258] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.284792 10897 leader_election.cc:288] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.285225 9813 ts_tablet_manager.cc:1905] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.285768 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.285786 10817 raft_consensus.cc:482] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.287456 10817 raft_consensus.cc:504] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.287998 10817 leader_election.cc:288] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.288380 10896 tablet.cc:1722] T f1f9b6cbf2d949839216e807130b2eb9 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.288924 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.289309 9497 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.289579 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:38.289772 9569 raft_consensus.cc:2454] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:38.289772 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7341dac419f2443594ea9ef9c65f2daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.290179 9219 leader_election.cc:302] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:38.290097 10903 tablet.cc:1722] T f1f9b6cbf2d949839216e807130b2eb9 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.290472 10817 raft_consensus.cc:2781] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:38.290537 10817 raft_consensus.cc:482] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:38.290588 10817 raft_consensus.cc:3037] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.292838 10817 raft_consensus.cc:504] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.293291 10817 leader_election.cc:288] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.293627 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d48886de3194e898da13b5d546ca9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.293687 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.293831 9220 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:38.294194 9498 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.294287 9498 leader_election.cc:302] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.294266 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:38.294719 9220 leader_election.cc:341] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.294970 10897 raft_consensus.cc:2726] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:38.295468 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5ae9c6ae0c9546e6baa12f13668969ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ae9c6ae0c9546e6baa12f13668969ea already in progress: creating tablet
I20260928 14:50:38.295842 9814 raft_consensus.cc:2229] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.296020 9814 raft_consensus.cc:2258] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.298707 9814 ts_tablet_manager.cc:1905] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.302796 9529 tablet_service.cc:1467] Processing CreateTablet for tablet f421b29c12cb4b5989de6bebcf04639f (DEFAULT_TABLE table=default.Table_db83f8c905e54fbeb75b212120f77ba7 [id=fa3d7186cd7343c19f359f1ab5da6d34]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:38.305701 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ae8348f77764a5e8787a33f657ca80d consensus state has no leader
I20260928 14:50:38.305850 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f421b29c12cb4b5989de6bebcf04639f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.305949 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:38.306125 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6f0f7aae759444d8aa4309b98fe7b496
W20260928 14:50:38.306890 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17cd74cf48ce42c3beda4556213f416a consensus state has no leader
I20260928 14:50:38.308588 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.308815 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b8211c873b2414c94798169f73502c2 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.307310 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.307735 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.309607 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f0f7aae759444d8aa4309b98fe7b496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.309871 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "390f10fd4b5f42e182b686cc1ccefb26" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:38.310041 9569 raft_consensus.cc:3037] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.310870 9848 tablet_bootstrap.cc:492] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.311754 9848 ts_tablet_manager.cc:1397] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.182s user 0.002s sys 0.002s
I20260928 14:50:38.312352 9569 raft_consensus.cc:2454] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:38.313098 9219 leader_election.cc:302] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.313115 9848 raft_consensus.cc:348] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.313308 9848 raft_consensus.cc:374] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.313383 9848 raft_consensus.cc:729] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.313633 10817 raft_consensus.cc:2781] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:38.313807 10817 raft_consensus.cc:686] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:38.313700 9848 consensus_queue.cc:260] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.314085 10817 consensus_queue.cc:237] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.318862 9408 tablet_service.cc:1467] Processing CreateTablet for tablet c19910c560964cc6a17cc11f141d647d (DEFAULT_TABLE table=default.Table_cf545aef440c4f55add88d6e91729547 [id=a293d2c34a274be09de1ffce8065ca42]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:38.320678 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6f0f7aae759444d8aa4309b98fe7b496 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f0f7aae759444d8aa4309b98fe7b496 already in progress: creating tablet
I20260928 14:50:38.321172 9815 tablet_replica.cc:330] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.321359 9815 raft_consensus.cc:2229] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.321760 9815 raft_consensus.cc:2258] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.322453 9815 ts_tablet_manager.cc:1905] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.322295 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e43b73b053d24ce8b18f98f8db76e366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.322903 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e43b73b053d24ce8b18f98f8db76e366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.325349 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a392303bc8344306bf5c1d8815194bf4" } new_table_name: "default.Table_c7c519080c7b493ca8249b294e8d446e" modify_external_catalogs: true
I20260928 14:50:38.325812 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_49b35d3828044e0ea1384f19a5e183f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.326346 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49b35d3828044e0ea1384f19a5e183f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.327877 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet e89035a3d41a4af78a8e7afbdb89c7e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.328580 9851 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.328718 9851 ts_tablet_manager.cc:1397] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.003s
I20260928 14:50:38.328814 9815 ts_tablet_manager.cc:1918] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.329555 9851 raft_consensus.cc:348] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.329758 9851 raft_consensus.cc:374] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.329815 9851 raft_consensus.cc:729] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.330004 9851 consensus_queue.cc:260] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.330520 9851 ts_tablet_manager.cc:1428] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:38.331631 9851 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.331664 8955 catalog_manager.cc:5495] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:38.332216 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:38.333230 9851 tablet_bootstrap.cc:654] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.338227 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6b35670ba2044b58a524847f77d4f822
I20260928 14:50:38.341367 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b35670ba2044b58a524847f77d4f822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.341952 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c19910c560964cc6a17cc11f141d647d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.342448 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_389431ce4ce849fe8d399bf876f296d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.342995 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_389431ce4ce849fe8d399bf876f296d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.343152 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b35670ba2044b58a524847f77d4f822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.344228 10817 raft_consensus.cc:482] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.344336 10817 raft_consensus.cc:504] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.344877 10817 leader_election.cc:288] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.345274 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d5a67ec9ce403d91ef1f6d52380b96" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.345738 9219 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: a2d5a67ec9ce403d91ef1f6d52380b96
W20260928 14:50:38.345918 9220 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.345980 9815 log.cc:1196] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/24b256211679481eb0e0309c56ff60c6
I20260928 14:50:38.346016 9220 leader_election.cc:302] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.346197 10817 raft_consensus.cc:2726] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.346508 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b35670ba2044b58a524847f77d4f822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.349023 9814 ts_tablet_manager.cc:1918] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.349123 9814 log.cc:1196] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8520b28899bc42b08e239502adb8fece
I20260928 14:50:38.349381 9814 ts_tablet_manager.cc:1939] T 8520b28899bc42b08e239502adb8fece P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:38.350041 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66096599d4c5458db2af10eb9bac947b consensus state has no leader
I20260928 14:50:38.350620 9814 tablet_replica.cc:330] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.350801 9814 raft_consensus.cc:2229] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.350916 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8520b28899bc42b08e239502adb8fece (table default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]) successfully deleted
I20260928 14:50:38.351032 9815 ts_tablet_manager.cc:1939] T 24b256211679481eb0e0309c56ff60c6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:38.351231 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fbcdd6d0f24d460493293693ea7c173c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbcdd6d0f24d460493293693ea7c173c already in progress: creating tablet
W20260928 14:50:38.351485 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5c6d593318244002b103f29f10fd02b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6d593318244002b103f29f10fd02b2 already in progress: creating tablet
W20260928 14:50:38.351765 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 60ede1d7f93047b08e043aa32213cd05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ede1d7f93047b08e043aa32213cd05 already in progress: creating tablet
I20260928 14:50:38.353153 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 24b256211679481eb0e0309c56ff60c6 (table default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]) successfully deleted
I20260928 14:50:38.354399 9814 raft_consensus.cc:2258] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:38.354938 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6b35670ba2044b58a524847f77d4f822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b35670ba2044b58a524847f77d4f822 already in progress: creating tablet
I20260928 14:50:38.354990 9814 ts_tablet_manager.cc:1905] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.359133 9813 ts_tablet_manager.cc:1918] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.359318 9813 log.cc:1196] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/0e53b8b73b37464687d343493d186660
I20260928 14:50:38.359640 10817 raft_consensus.cc:482] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.359766 10817 raft_consensus.cc:504] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.360235 10817 leader_election.cc:288] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.360750 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:38.360942 9569 raft_consensus.cc:2454] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:38.361363 9813 ts_tablet_manager.cc:1939] T 0e53b8b73b37464687d343493d186660 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.361375 9219 leader_election.cc:302] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:38.361693 10817 raft_consensus.cc:2781] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:38.361760 10817 raft_consensus.cc:482] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:38.361812 10817 raft_consensus.cc:3037] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.364253 10817 raft_consensus.cc:504] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.365067 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:38.365216 9569 raft_consensus.cc:3037] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:38.365635 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.365656 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_06c05f309788430c9a874dbbb85b3ae9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.366240 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06c05f309788430c9a874dbbb85b3ae9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.366386 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 24b256211679481eb0e0309c56ff60c6 because the tablet was not found. No further retry: Not found: Tablet not found: 24b256211679481eb0e0309c56ff60c6
I20260928 14:50:38.366780 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 750) took 1862 ms. Trace:
I20260928 14:50:38.366852 9813 rpcz_store.cc:276] 0928 14:50:36.504048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.504468 (+ 420us) service_pool.cc:227] Handling call
0928 14:50:38.284313 (+1779845us) ts_tablet_manager.cc:1145] Deleting tablet 0e53b8b73b37464687d343493d186660
0928 14:50:38.284324 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.331121 (+ 46797us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.359056 (+ 27935us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.366764 (+ 7708us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1779663}
I20260928 14:50:38.367257 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 0e53b8b73b37464687d343493d186660 (table default.Table_ea5cc25a78624d7b99527b5433bd32e3 [id=8d1045a462c145a29c4d438aeb054173]) successfully deleted
I20260928 14:50:38.367488 9569 raft_consensus.cc:2454] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:38.367606 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 751) took 1820 ms. Trace:
I20260928 14:50:38.367676 9813 rpcz_store.cc:276] 0928 14:50:36.547581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.547632 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:38.367490 (+1819858us) ts_tablet_manager.cc:1145] Deleting tablet 1a2ab53321d74f28aa5453729e12f9d1
0928 14:50:38.367501 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.367591 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1819685}
W20260928 14:50:38.368068 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1a2ab53321d74f28aa5453729e12f9d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a2ab53321d74f28aa5453729e12f9d1 already in progress: creating tablet
I20260928 14:50:38.368289 9219 leader_election.cc:302] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:38.368713 9813 tablet_replica.cc:330] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.368884 9813 raft_consensus.cc:2229] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.369019 9813 raft_consensus.cc:2258] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.369537 9848 ts_tablet_manager.cc:1428] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260928 14:50:38.369602 10552 raft_consensus.cc:2781] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:38.369722 10552 raft_consensus.cc:686] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:38.369925 9848 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.369925 10552 consensus_queue.cc:237] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.371335 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:38.371447 9848 tablet_bootstrap.cc:654] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:38.372313 9220 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.373497 10817 leader_election.cc:288] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.374210 9848 tablet_bootstrap.cc:492] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.374387 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:38.374735 9848 ts_tablet_manager.cc:1397] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
W20260928 14:50:38.374972 9220 leader_election.cc:341] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.375470 9848 raft_consensus.cc:348] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.377033 9851 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.377223 9851 ts_tablet_manager.cc:1397] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.002s
I20260928 14:50:38.377993 9851 raft_consensus.cc:348] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.378248 9851 raft_consensus.cc:374] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.378341 9851 raft_consensus.cc:729] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.378566 9851 consensus_queue.cc:260] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.379115 9851 ts_tablet_manager.cc:1428] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:38.379412 9851 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.381217 9851 tablet_bootstrap.cc:654] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.381201 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2ef88ab43d2c4684b5abea68667a8686" } new_table_name: "default.Table_f117618475d94504bff9ad1fccf76bf9" modify_external_catalogs: true
I20260928 14:50:38.381333 9848 raft_consensus.cc:374] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.381399 9848 raft_consensus.cc:729] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.369510 9813 ts_tablet_manager.cc:1905] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.383770 9848 consensus_queue.cc:260] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.383462 9814 ts_tablet_manager.cc:1918] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.384883 9814 log.cc:1196] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/dfacaf069e3746aeb8ca11d95e65c5ea
I20260928 14:50:38.386188 9814 ts_tablet_manager.cc:1939] T dfacaf069e3746aeb8ca11d95e65c5ea P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.389384 9848 ts_tablet_manager.cc:1428] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260928 14:50:38.394488 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet dfacaf069e3746aeb8ca11d95e65c5ea (table default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]) successfully deleted
I20260928 14:50:38.394843 9814 tablet_replica.cc:330] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.394989 9848 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.395071 9814 raft_consensus.cc:2229] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.395287 9814 raft_consensus.cc:2258] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.395860 9814 ts_tablet_manager.cc:1905] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.396921 10677 raft_consensus.cc:482] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.397053 10677 raft_consensus.cc:504] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.397703 10677 leader_election.cc:288] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.398156 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 94ac5cd43c05479f8516fdc0c30cbf22
W20260928 14:50:38.399128 9360 leader_election.cc:341] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9a753aaf7f8c4498b6ba35fa27d8c537
W20260928 14:50:38.399291 9360 leader_election.cc:341] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 9a753aaf7f8c4498b6ba35fa27d8c537
I20260928 14:50:38.399349 9360 leader_election.cc:302] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.399664 10677 raft_consensus.cc:2726] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.399972 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.402565 9814 ts_tablet_manager.cc:1918] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.402679 9814 log.cc:1196] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:38.402943 9814 ts_tablet_manager.cc:1939] T 6feba01e78004e50a71c610c9a63aeb5 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.403463 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.403700 9815 tablet_replica.cc:330] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.403863 9815 raft_consensus.cc:2229] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.403995 9815 raft_consensus.cc:2258] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.404474 9815 ts_tablet_manager.cc:1905] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.408468 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cb1d541610014e408bc0bb7bcb7954bf
I20260928 14:50:38.409384 9855 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.409538 9855 ts_tablet_manager.cc:1397] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.141s user 0.002s sys 0.006s
I20260928 14:50:38.410323 9855 raft_consensus.cc:348] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.410526 9855 raft_consensus.cc:374] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.410595 9855 raft_consensus.cc:729] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.410813 9855 consensus_queue.cc:260] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.411615 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet cb1d541610014e408bc0bb7bcb7954bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.411769 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 94ac5cd43c05479f8516fdc0c30cbf22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.412328 9815 ts_tablet_manager.cc:1918] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:38.412911 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet cb1d541610014e408bc0bb7bcb7954bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.413187 9815 log.cc:1196] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/94ac5cd43c05479f8516fdc0c30cbf22
I20260928 14:50:38.413672 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0ccb3313b7104b4c8d0d1c59915df4a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.413820 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet cb1d541610014e408bc0bb7bcb7954bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.414290 9815 ts_tablet_manager.cc:1939] T 94ac5cd43c05479f8516fdc0c30cbf22 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.415505 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6feba01e78004e50a71c610c9a63aeb5 (table default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]) successfully deleted
W20260928 14:50:38.415589 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ccb3313b7104b4c8d0d1c59915df4a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.415743 9855 ts_tablet_manager.cc:1428] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20260928 14:50:38.415822 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5ae9c6ae0c9546e6baa12f13668969ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ae9c6ae0c9546e6baa12f13668969ea already in progress: creating tablet
W20260928 14:50:38.416013 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6f0f7aae759444d8aa4309b98fe7b496 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f0f7aae759444d8aa4309b98fe7b496 already in progress: creating tablet
W20260928 14:50:38.416232 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6b35670ba2044b58a524847f77d4f822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b35670ba2044b58a524847f77d4f822 already in progress: creating tablet
I20260928 14:50:38.418859 9848 tablet_bootstrap.cc:654] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:38.419934 9220 consensus_peers.cc:487] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:38.419947 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]) successfully deleted
W20260928 14:50:38.420187 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cb1d541610014e408bc0bb7bcb7954bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb1d541610014e408bc0bb7bcb7954bf already in progress: creating tablet
I20260928 14:50:38.420423 9855 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.420611 9814 tablet_replica.cc:330] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.420879 9814 raft_consensus.cc:2229] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:38.421244 9814 raft_consensus.cc:2258] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.421952 9855 tablet_bootstrap.cc:654] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.422091 9814 ts_tablet_manager.cc:1905] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.427796 9814 ts_tablet_manager.cc:1918] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:38.427950 9814 log.cc:1196] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/94ac5cd43c05479f8516fdc0c30cbf22
I20260928 14:50:38.428292 9814 ts_tablet_manager.cc:1939] T 94ac5cd43c05479f8516fdc0c30cbf22 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.429716 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]) successfully deleted
W20260928 14:50:38.430444 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cb1d541610014e408bc0bb7bcb7954bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb1d541610014e408bc0bb7bcb7954bf already in progress: creating tablet
I20260928 14:50:38.433240 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ef0baa0c73054cefa825a46f9d497875"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.433858 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef0baa0c73054cefa825a46f9d497875 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.435473 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a753aaf7f8c4498b6ba35fa27d8c537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.438308 9848 tablet_bootstrap.cc:492] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.438489 9848 ts_tablet_manager.cc:1397] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260928 14:50:38.439173 9848 raft_consensus.cc:348] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.439429 9848 raft_consensus.cc:374] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.439535 9848 raft_consensus.cc:729] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.439790 9848 consensus_queue.cc:260] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.440915 9848 ts_tablet_manager.cc:1428] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:38.441226 9848 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.442736 9848 tablet_bootstrap.cc:654] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.446745 10552 consensus_queue.cc:1035] T c556381a95fa42e284dab68a7f401e63 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:38.449267 9855 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.449420 9855 ts_tablet_manager.cc:1397] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260928 14:50:38.450256 9855 raft_consensus.cc:348] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.450479 9855 raft_consensus.cc:374] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.450558 9855 raft_consensus.cc:729] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.450812 9855 consensus_queue.cc:260] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.451459 9855 ts_tablet_manager.cc:1428] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:38.452028 9855 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:38.452509 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01dd30e15c31498299ca5f5a3b2770e9 consensus state has no leader
I20260928 14:50:38.453981 9855 tablet_bootstrap.cc:654] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.454607 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_48e38a1afbb64c24911cd087a3bb9861"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.457000 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_415acab6842745adb711bc6992d57aed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.457763 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_415acab6842745adb711bc6992d57aed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.459463 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48e38a1afbb64c24911cd087a3bb9861 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.460619 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet ca7fa45e25b0455e92412b844cd78cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.462219 10552 consensus_queue.cc:1035] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:38.464206 9848 tablet_bootstrap.cc:492] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.464389 9848 ts_tablet_manager.cc:1397] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260928 14:50:38.465111 9848 raft_consensus.cc:348] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.465378 9848 raft_consensus.cc:374] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.465473 9848 raft_consensus.cc:729] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.465780 9848 consensus_queue.cc:260] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.466596 9848 ts_tablet_manager.cc:1428] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:38.467144 9848 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.469389 9848 tablet_bootstrap.cc:654] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.470631 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6b8211c873b2414c94798169f73502c2
I20260928 14:50:38.471083 8956 catalog_manager.cc:6565] ReplaceTablet: tablet 6b8211c873b2414c94798169f73502c2 deleted and replaced by tablet 258d5e3e08794e6cad1d3b7c74bb3d87
I20260928 14:50:38.472887 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8211c873b2414c94798169f73502c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 258d5e3e08794e6cad1d3b7c74bb3d87) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.473712 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8211c873b2414c94798169f73502c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 258d5e3e08794e6cad1d3b7c74bb3d87) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:38.474315 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6b8211c873b2414c94798169f73502c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b8211c873b2414c94798169f73502c2 already in progress: creating tablet
W20260928 14:50:38.474622 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6b8211c873b2414c94798169f73502c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b8211c873b2414c94798169f73502c2 already in progress: creating tablet
I20260928 14:50:38.474664 9851 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.474792 9851 ts_tablet_manager.cc:1397] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.017s
I20260928 14:50:38.475037 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8211c873b2414c94798169f73502c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 258d5e3e08794e6cad1d3b7c74bb3d87) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.477702 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 1b22c3f9578a464a96be0bac6127e56d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.478427 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cec79b345afa4c25bbd3c96ac88c6b11" } modify_external_catalogs: true
I20260928 14:50:38.479331 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cec79b345afa4c25bbd3c96ac88c6b11" } modify_external_catalogs: true
I20260928 14:50:38.489590 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet f1f9b6cbf2d949839216e807130b2eb9 (table default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52]). Expected version 2 got 0
I20260928 14:50:38.493144 10891 raft_consensus.cc:482] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.493409 10891 raft_consensus.cc:504] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.494040 10891 leader_election.cc:288] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.495076 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.496129 9498 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.497308 9848 tablet_bootstrap.cc:492] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.497704 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.497975 9851 raft_consensus.cc:348] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.498191 9851 raft_consensus.cc:374] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.498256 9851 raft_consensus.cc:729] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.498447 9851 consensus_queue.cc:260] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.498790 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_41d491fd6a8044a9a1dad70218781027"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.499830 9497 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.499927 9497 leader_election.cc:302] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.500403 10891 raft_consensus.cc:2726] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:38.501379 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41d491fd6a8044a9a1dad70218781027 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.504091 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9903241fd3b463094fff7bf9c76ed9b consensus state has no leader
I20260928 14:50:38.504385 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 9e72d815a218451b884604a1f334d632 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.505185 9848 ts_tablet_manager.cc:1397] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.001s
I20260928 14:50:38.506491 10677 raft_consensus.cc:482] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.506604 10677 raft_consensus.cc:504] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.507155 10677 leader_election.cc:288] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:38.509594 9360 leader_election.cc:341] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b9f843006a1e43a49f177433c7a3e1ea
W20260928 14:50:38.509802 9360 leader_election.cc:341] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: b9f843006a1e43a49f177433c7a3e1ea
I20260928 14:50:38.509912 9360 leader_election.cc:302] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.509819 9848 raft_consensus.cc:348] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.510046 9848 raft_consensus.cc:374] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.510089 9848 raft_consensus.cc:729] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.510279 9848 consensus_queue.cc:260] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.511376 9855 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.511536 9855 ts_tablet_manager.cc:1397] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.001s
I20260928 14:50:38.512348 10677 raft_consensus.cc:2726] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.512279 9855 raft_consensus.cc:348] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.512454 9855 raft_consensus.cc:374] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.512877 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1eb1ac72cc9d46e4948c87c000d87cb6" } new_table_name: "default.Table_b570999786d3492aab37373143a36894" modify_external_catalogs: true
I20260928 14:50:38.512508 9855 raft_consensus.cc:729] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.514187 9855 consensus_queue.cc:260] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.515319 9855 ts_tablet_manager.cc:1428] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:38.515575 9855 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.517879 9855 tablet_bootstrap.cc:654] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.519294 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba" } modify_external_catalogs: true
I20260928 14:50:38.519517 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba" } modify_external_catalogs: true
I20260928 14:50:38.520807 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a4b0b314447f41eb8a531ae408712220" } new_table_name: "default.Table_9a63611e04b34faf88bfc79521f8a164" modify_external_catalogs: true
I20260928 14:50:38.522015 9848 ts_tablet_manager.cc:1428] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 14:50:38.522891 9848 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.524096 9848 tablet_bootstrap.cc:654] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.533677 9855 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.533838 9855 ts_tablet_manager.cc:1397] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260928 14:50:38.534571 9855 raft_consensus.cc:348] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.537577 9855 raft_consensus.cc:374] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.537693 9855 raft_consensus.cc:729] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.537916 9855 consensus_queue.cc:260] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.538537 9855 ts_tablet_manager.cc:1428] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 14:50:38.541815 9855 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.541846 9813 ts_tablet_manager.cc:1918] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.541994 9813 log.cc:1196] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/962a5dee53514f7ab5a63242f7d70446
I20260928 14:50:38.542354 9813 ts_tablet_manager.cc:1939] T 962a5dee53514f7ab5a63242f7d70446 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.543089 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 752) took 1963 ms. Trace:
I20260928 14:50:38.543244 9813 rpcz_store.cc:276] 0928 14:50:36.579474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.579525 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:38.368667 (+1789142us) ts_tablet_manager.cc:1145] Deleting tablet 962a5dee53514f7ab5a63242f7d70446
0928 14:50:38.368677 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.538893 (+170216us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.541771 (+ 2878us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.543060 (+ 1289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788950}
I20260928 14:50:38.543768 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 962a5dee53514f7ab5a63242f7d70446 (table default.Table_92419bafe3fe4c55bd4275a007fae26e [id=1692d8fdf9b240f6a1662de9319db005]) successfully deleted
I20260928 14:50:38.543905 9855 tablet_bootstrap.cc:654] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.544382 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 764) took 1837 ms. Trace:
I20260928 14:50:38.544507 9813 rpcz_store.cc:276] 0928 14:50:36.707384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.707640 (+ 256us) service_pool.cc:227] Handling call
0928 14:50:38.544272 (+1836632us) ts_tablet_manager.cc:1145] Deleting tablet c073b27ed9d14c178caa3080ff0737ff
0928 14:50:38.544280 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.544366 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1836405}
I20260928 14:50:38.544651 9848 tablet_bootstrap.cc:492] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.544835 9848 ts_tablet_manager.cc:1397] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
W20260928 14:50:38.544979 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c073b27ed9d14c178caa3080ff0737ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c073b27ed9d14c178caa3080ff0737ff already in progress: creating tablet
I20260928 14:50:38.545357 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 765) took 1836 ms. Trace:
I20260928 14:50:38.545473 9813 rpcz_store.cc:276] 0928 14:50:36.708720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.708965 (+ 245us) service_pool.cc:227] Handling call
0928 14:50:38.545263 (+1836298us) ts_tablet_manager.cc:1145] Deleting tablet 2fdb3daaea744a8b9170325440e81ee7
0928 14:50:38.545272 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.545343 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1836100}
W20260928 14:50:38.545943 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2fdb3daaea744a8b9170325440e81ee7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fdb3daaea744a8b9170325440e81ee7 already in progress: creating tablet
I20260928 14:50:38.545437 9848 raft_consensus.cc:348] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.546248 9848 raft_consensus.cc:374] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.546445 9848 raft_consensus.cc:729] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.546689 9848 consensus_queue.cc:260] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.546290 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 763) took 1847 ms. Trace:
I20260928 14:50:38.546952 9813 rpcz_store.cc:276] 0928 14:50:36.698838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.748478 (+ 49640us) service_pool.cc:227] Handling call
0928 14:50:38.546196 (+1797718us) ts_tablet_manager.cc:1145] Deleting tablet edf76b53ded84392a39c73d7e653615d
0928 14:50:38.546205 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.546277 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1797477}
W20260928 14:50:38.547416 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet edf76b53ded84392a39c73d7e653615d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edf76b53ded84392a39c73d7e653615d already in progress: creating tablet
I20260928 14:50:38.548043 9848 ts_tablet_manager.cc:1428] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:38.548197 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d4c62e8168e4db684e75af5228f1201" } modify_external_catalogs: true
I20260928 14:50:38.548388 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d4c62e8168e4db684e75af5228f1201" } modify_external_catalogs: true
I20260928 14:50:38.548904 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 768) took 1669 ms. Trace:
W20260928 14:50:38.549937 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 01dd30e15c31498299ca5f5a3b2770e9 (table default.Table_c7c519080c7b493ca8249b294e8d446e [id=b58aea2205304defa62befcee84dfa0f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01dd30e15c31498299ca5f5a3b2770e9 consensus state has no leader
I20260928 14:50:38.551311 8949 catalog_manager.cc:5495] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:38.551754 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]). Expected version 2 got 0
I20260928 14:50:38.552155 9250 tablet_service.cc:1467] Processing CreateTablet for tablet e1e68eaf41064dd0bfba8828d641f99b (DEFAULT_TABLE table=default.Table_7b03a4e80e63423fbad18fb6849f9015 [id=f7b26695169a444fa846fab3fee97276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.552079 8949 catalog_manager.cc:5495] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:38.552547 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e68eaf41064dd0bfba8828d641f99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.553141 8946 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_8b349ec7ad604085ae146a0fbd98eb86 [id=3d4e8c920b14490fb8d10202db71bb52] alter complete (version 2)
I20260928 14:50:38.554050 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_75c33bec6a9447f98f1bab145ed54509" } new_table_name: "default.Table_d441068e52104bbfb805f4c1ae8e1cf8" modify_external_catalogs: true
I20260928 14:50:38.557755 9851 ts_tablet_manager.cc:1428] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.083s user 0.002s sys 0.000s
I20260928 14:50:38.562036 9851 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.563506 9851 tablet_bootstrap.cc:654] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.563619 9529 tablet_service.cc:1467] Processing CreateTablet for tablet e1e68eaf41064dd0bfba8828d641f99b (DEFAULT_TABLE table=default.Table_7b03a4e80e63423fbad18fb6849f9015 [id=f7b26695169a444fa846fab3fee97276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.552928 10920 raft_consensus.cc:482] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.563829 10920 raft_consensus.cc:504] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.563983 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e68eaf41064dd0bfba8828d641f99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.564376 10920 leader_election.cc:288] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:38.565155 9360 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:38.563767 9813 rpcz_store.cc:276] 0928 14:50:36.879336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:36.949972 (+ 70636us) service_pool.cc:227] Handling call
0928 14:50:38.547658 (+1597686us) ts_tablet_manager.cc:1145] Deleting tablet e00bf3d07eeb42219d79326705b3e440
0928 14:50:38.548797 (+ 1139us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.548888 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595905}
W20260928 14:50:38.565623 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e00bf3d07eeb42219d79326705b3e440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00bf3d07eeb42219d79326705b3e440 already in progress: creating tablet
I20260928 14:50:38.565877 9813 tablet_replica.cc:330] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.566036 9813 raft_consensus.cc:2229] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.566160 9813 raft_consensus.cc:2258] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.566596 9813 ts_tablet_manager.cc:1905] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.553895 9848 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.563508 9408 tablet_service.cc:1467] Processing CreateTablet for tablet e1e68eaf41064dd0bfba8828d641f99b (DEFAULT_TABLE table=default.Table_7b03a4e80e63423fbad18fb6849f9015 [id=f7b26695169a444fa846fab3fee97276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.569453 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e68eaf41064dd0bfba8828d641f99b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:38.570261 9360 leader_election.cc:341] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:38.570362 9360 leader_election.cc:302] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.570678 10920 raft_consensus.cc:2726] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.570756 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:38.570924 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_ce86cfe203734bd4bd139c7bf581ac85 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 1 got 0
I20260928 14:50:38.572594 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd80a5f3384433681a172fd50b07066 (DEFAULT_TABLE table=default.Table_3df6b184a5394a02968435fcfb6a1090 [id=14873adea0fe4e499f397d00696c76df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.573000 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd80a5f3384433681a172fd50b07066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.576155 9848 tablet_bootstrap.cc:654] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:38.578043 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 598523e862d74ed982f2fa7757f95619 consensus state has no leader
I20260928 14:50:38.578693 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 727cb249723946578bc5bb086d6e6c40 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.579486 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd80a5f3384433681a172fd50b07066 (DEFAULT_TABLE table=default.Table_3df6b184a5394a02968435fcfb6a1090 [id=14873adea0fe4e499f397d00696c76df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.579602 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd80a5f3384433681a172fd50b07066 (DEFAULT_TABLE table=default.Table_3df6b184a5394a02968435fcfb6a1090 [id=14873adea0fe4e499f397d00696c76df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.579799 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd80a5f3384433681a172fd50b07066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.579950 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd80a5f3384433681a172fd50b07066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.580579 9855 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.580695 9855 ts_tablet_manager.cc:1397] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20260928 14:50:38.581398 9855 raft_consensus.cc:348] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.581657 9855 raft_consensus.cc:374] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.581717 9855 raft_consensus.cc:729] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.581893 9855 consensus_queue.cc:260] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:38.583511 8940 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417): Couldn't send request to peer 8d70b1b045bd4ec4b74be2dc2364ecba. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 14:50:38.585126 8951 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 258d5e3e08794e6cad1d3b7c74bb3d87
I20260928 14:50:38.586531 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.587080 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.588220 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 58316263538c4bd9bc21ff704421160a (DEFAULT_TABLE table=default.Table_68635365d02e43d7865b30d3eaf7ac6b [id=1a2c4346791d4ed39b84e3d9ff75bb55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.588547 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58316263538c4bd9bc21ff704421160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.590338 9848 tablet_bootstrap.cc:492] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.590440 9848 ts_tablet_manager.cc:1397] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20260928 14:50:38.591318 9848 raft_consensus.cc:348] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.591490 9848 raft_consensus.cc:374] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.591537 9848 raft_consensus.cc:729] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.591596 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 58316263538c4bd9bc21ff704421160a (DEFAULT_TABLE table=default.Table_68635365d02e43d7865b30d3eaf7ac6b [id=1a2c4346791d4ed39b84e3d9ff75bb55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.591750 9848 consensus_queue.cc:260] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.591907 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58316263538c4bd9bc21ff704421160a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:38.594599 9220 consensus_peers.cc:487] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:38.594732 9848 ts_tablet_manager.cc:1428] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:38.595098 9848 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.596868 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 69e3c8ef3e20451dbf91b671655974e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.596915 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 58316263538c4bd9bc21ff704421160a (DEFAULT_TABLE table=default.Table_68635365d02e43d7865b30d3eaf7ac6b [id=1a2c4346791d4ed39b84e3d9ff75bb55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.600070 9848 tablet_bootstrap.cc:654] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.600723 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58316263538c4bd9bc21ff704421160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.600948 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 66772fac8b3747f0983562195abcc64e
I20260928 14:50:38.601845 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 66772fac8b3747f0983562195abcc64e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.602869 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 7025da9d5aa84568b05ec3d8b4b3ab97 (DEFAULT_TABLE table=default.Table_3f1a26bb56a54c2d8680c9dfa4350471 [id=b70b06a0894f40debb05015a57d36bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.603169 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7025da9d5aa84568b05ec3d8b4b3ab97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.604950 9813 ts_tablet_manager.cc:1918] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.605036 9813 log.cc:1196] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8f2898a032e1488b98c31b5e83371a71
I20260928 14:50:38.605311 9813 ts_tablet_manager.cc:1939] T 8f2898a032e1488b98c31b5e83371a71 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.605926 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 769) took 1470 ms. Trace:
I20260928 14:50:38.605999 9813 rpcz_store.cc:276] 0928 14:50:37.135921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.135976 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:38.565838 (+1429862us) ts_tablet_manager.cc:1145] Deleting tablet 8f2898a032e1488b98c31b5e83371a71
0928 14:50:38.565848 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.602304 (+ 36456us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.604882 (+ 2578us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.605909 (+ 1027us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429672}
I20260928 14:50:38.610288 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 7025da9d5aa84568b05ec3d8b4b3ab97 (DEFAULT_TABLE table=default.Table_3f1a26bb56a54c2d8680c9dfa4350471 [id=b70b06a0894f40debb05015a57d36bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.610891 9267 tablet_service.cc:1467] Processing CreateTablet for tablet f5e2f558b21c4a8e90280da110f14691 (DEFAULT_TABLE table=default.Table_ad5c36aafd154f249086a527bf95426e [id=f21c4cfc0c204e5cb7487c376469cb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.611586 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 (DEFAULT_TABLE table=default.Table_985a3dd0ae1844b5896f4cffa47a0fd8 [id=b7ebb5ea1ae8404e8b9220ebbafe1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.612744 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.613255 9255 tablet_service.cc:1467] Processing CreateTablet for tablet fce40514b75a4e9aabdd9b32072f6a46 (DEFAULT_TABLE table=default.Table_76ceb36c6040454bbc8cfb60cdda6eb0 [id=6daf30bc2bdf45459b422607b8f29d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.613633 9257 tablet_service.cc:1467] Processing CreateTablet for tablet f1131ee7f0ee4906be478cb5317719b3 (DEFAULT_TABLE table=default.Table_1182be7988c347c290306523abc75e4c [id=b7f2737785a74a5c8bf5e1c6adbea118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.617144 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.618304 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.619047 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4001db9bc2b946be85c0c1767b203039" } modify_external_catalogs: true
I20260928 14:50:38.619351 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_41fcada969964258a48a44db603216b5" } modify_external_catalogs: true
I20260928 14:50:38.619515 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 66772fac8b3747f0983562195abcc64e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.619906 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 7025da9d5aa84568b05ec3d8b4b3ab97 (DEFAULT_TABLE table=default.Table_3f1a26bb56a54c2d8680c9dfa4350471 [id=b70b06a0894f40debb05015a57d36bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.620237 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7025da9d5aa84568b05ec3d8b4b3ab97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.621387 9543 tablet_service.cc:1467] Processing CreateTablet for tablet f5e2f558b21c4a8e90280da110f14691 (DEFAULT_TABLE table=default.Table_ad5c36aafd154f249086a527bf95426e [id=f21c4cfc0c204e5cb7487c376469cb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.621706 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5e2f558b21c4a8e90280da110f14691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.622188 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 (DEFAULT_TABLE table=default.Table_985a3dd0ae1844b5896f4cffa47a0fd8 [id=b7ebb5ea1ae8404e8b9220ebbafe1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.622466 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fdc5e3f83924f4cae8d30be9dcce152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.622748 9536 tablet_service.cc:1467] Processing CreateTablet for tablet fce40514b75a4e9aabdd9b32072f6a46 (DEFAULT_TABLE table=default.Table_76ceb36c6040454bbc8cfb60cdda6eb0 [id=6daf30bc2bdf45459b422607b8f29d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.623183 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f1131ee7f0ee4906be478cb5317719b3 (DEFAULT_TABLE table=default.Table_1182be7988c347c290306523abc75e4c [id=b7f2737785a74a5c8bf5e1c6adbea118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.625607 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5e2f558b21c4a8e90280da110f14691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.625727 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.626643 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fce40514b75a4e9aabdd9b32072f6a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.627432 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1131ee7f0ee4906be478cb5317719b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.628798 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d2bd32270694ec2af95c7bf5b906b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.633826 9814 tablet_replica.cc:330] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.634002 9814 raft_consensus.cc:2229] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.634143 9814 raft_consensus.cc:2258] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.634472 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d2bd32270694ec2af95c7bf5b906b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.634959 9814 ts_tablet_manager.cc:1905] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.637723 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fce40514b75a4e9aabdd9b32072f6a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.637919 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fdc5e3f83924f4cae8d30be9dcce152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.640026 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7025da9d5aa84568b05ec3d8b4b3ab97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.645769 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1131ee7f0ee4906be478cb5317719b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.649304 9814 ts_tablet_manager.cc:1918] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.649590 9814 log.cc:1196] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/a2d5a67ec9ce403d91ef1f6d52380b96
I20260928 14:50:38.650590 9814 ts_tablet_manager.cc:1939] T a2d5a67ec9ce403d91ef1f6d52380b96 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.606769 9388 tablet_service.cc:1467] Processing CreateTablet for tablet f5e2f558b21c4a8e90280da110f14691 (DEFAULT_TABLE table=default.Table_ad5c36aafd154f249086a527bf95426e [id=f21c4cfc0c204e5cb7487c376469cb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.651494 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5e2f558b21c4a8e90280da110f14691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.651723 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8f2898a032e1488b98c31b5e83371a71 (table default.Table_f39bb48fe52441c5a026c16c6230bd76 [id=cf694e59859443f0a41a679614312c4d]) successfully deleted
I20260928 14:50:38.652565 9813 tablet_replica.cc:330] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.607025 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 (DEFAULT_TABLE table=default.Table_985a3dd0ae1844b5896f4cffa47a0fd8 [id=b7ebb5ea1ae8404e8b9220ebbafe1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.653429 9813 raft_consensus.cc:2229] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.653887 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fdc5e3f83924f4cae8d30be9dcce152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.654258 9813 raft_consensus.cc:2258] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.654487 9814 tablet_replica.cc:330] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.655194 9814 raft_consensus.cc:2229] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.656021 9814 raft_consensus.cc:2258] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.656461 9851 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.656564 9851 ts_tablet_manager.cc:1397] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.000s
I20260928 14:50:38.657029 9813 ts_tablet_manager.cc:1905] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.657337 9851 raft_consensus.cc:348] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.657512 9851 raft_consensus.cc:374] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.657650 9851 raft_consensus.cc:729] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.607513 9397 tablet_service.cc:1467] Processing CreateTablet for tablet fce40514b75a4e9aabdd9b32072f6a46 (DEFAULT_TABLE table=default.Table_76ceb36c6040454bbc8cfb60cdda6eb0 [id=6daf30bc2bdf45459b422607b8f29d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.658107 9851 consensus_queue.cc:260] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.658485 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fce40514b75a4e9aabdd9b32072f6a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.658728 9814 ts_tablet_manager.cc:1905] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.607728 9392 tablet_service.cc:1467] Processing CreateTablet for tablet f1131ee7f0ee4906be478cb5317719b3 (DEFAULT_TABLE table=default.Table_1182be7988c347c290306523abc75e4c [id=b7f2737785a74a5c8bf5e1c6adbea118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.661737 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1131ee7f0ee4906be478cb5317719b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:38.662012 9851 ts_tablet_manager.cc:1428] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:38.610284 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 767958659f4f450497eb5f2a3902993e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.622062 9848 tablet_bootstrap.cc:492] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.663913 9848 ts_tablet_manager.cc:1397] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.001s
I20260928 14:50:38.648096 10920 raft_consensus.cc:482] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.664494 9848 raft_consensus.cc:348] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.664553 10920 raft_consensus.cc:504] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.664678 9848 raft_consensus.cc:374] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.664721 9848 raft_consensus.cc:729] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.664875 9848 consensus_queue.cc:260] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.665057 9851 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.665051 10920 leader_election.cc:288] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.665318 9848 ts_tablet_manager.cc:1428] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:38.665511 9848 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.666483 9851 tablet_bootstrap.cc:654] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.666690 9848 tablet_bootstrap.cc:654] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.607290 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:38.670255 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d2bd32270694ec2af95c7bf5b906b1b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:38.674459 9360 leader_election.cc:341] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 767958659f4f450497eb5f2a3902993e
I20260928 14:50:38.684029 9813 ts_tablet_manager.cc:1918] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.684554 9813 log.cc:1196] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8f79fcac805b42ba8b66949fbdfeb8f6
W20260928 14:50:38.685312 9360 leader_election.cc:341] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 767958659f4f450497eb5f2a3902993e
I20260928 14:50:38.685403 9360 leader_election.cc:302] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.685739 10677 raft_consensus.cc:2726] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.686067 9813 ts_tablet_manager.cc:1939] T 8f79fcac805b42ba8b66949fbdfeb8f6 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.686817 9814 ts_tablet_manager.cc:1918] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.687340 9814 log.cc:1196] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/01c1e945f1c54281856bfabe08fba42e
I20260928 14:50:38.687425 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 771) took 1535 ms. Trace:
I20260928 14:50:38.687846 9813 rpcz_store.cc:276] 0928 14:50:37.151479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.153574 (+ 2095us) service_pool.cc:227] Handling call
0928 14:50:38.652339 (+1498765us) ts_tablet_manager.cc:1145] Deleting tablet 8f79fcac805b42ba8b66949fbdfeb8f6
0928 14:50:38.652351 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.670457 (+ 18106us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.683736 (+ 13279us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.687407 (+ 3671us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1498486}
I20260928 14:50:38.689029 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8f79fcac805b42ba8b66949fbdfeb8f6 (table default.Table_4f27adee7f5546bdacf1cf473d252a5b [id=290e5d7ef835430987ca8992b8142bf6]) successfully deleted
I20260928 14:50:38.688771 9814 ts_tablet_manager.cc:1939] T 01c1e945f1c54281856bfabe08fba42e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.690284 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 779) took 1436 ms. Trace:
I20260928 14:50:38.690872 9813 rpcz_store.cc:276] 0928 14:50:37.253418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.254041 (+ 623us) service_pool.cc:227] Handling call
0928 14:50:38.689718 (+1435677us) ts_tablet_manager.cc:1145] Deleting tablet 02d0fce7d3444063a6dcfec9538f4f66
0928 14:50:38.689833 (+ 115us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.690262 (+ 429us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1435385}
W20260928 14:50:38.692030 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 02d0fce7d3444063a6dcfec9538f4f66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02d0fce7d3444063a6dcfec9538f4f66 already in progress: creating tablet
I20260928 14:50:38.692847 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 780) took 1436 ms. Trace:
I20260928 14:50:38.693367 9813 rpcz_store.cc:276] 0928 14:50:37.256373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.257557 (+ 1184us) service_pool.cc:227] Handling call
0928 14:50:38.692283 (+1434726us) ts_tablet_manager.cc:1145] Deleting tablet 151f556d50bc400a9ed4cfbdbbfc84aa
0928 14:50:38.692403 (+ 120us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.692825 (+ 422us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1434352}
I20260928 14:50:38.694787 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 777) took 1445 ms. Trace:
W20260928 14:50:38.694878 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 151f556d50bc400a9ed4cfbdbbfc84aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 151f556d50bc400a9ed4cfbdbbfc84aa already in progress: creating tablet
I20260928 14:50:38.695089 9813 rpcz_store.cc:276] 0928 14:50:37.249797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.264503 (+ 14706us) service_pool.cc:227] Handling call
0928 14:50:38.694490 (+1429987us) ts_tablet_manager.cc:1145] Deleting tablet 09f92d1f0e69409a8ef355d550cfb52c
0928 14:50:38.694569 (+ 79us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.694768 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429821}
W20260928 14:50:38.695868 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 09f92d1f0e69409a8ef355d550cfb52c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09f92d1f0e69409a8ef355d550cfb52c already in progress: creating tablet
I20260928 14:50:38.695930 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 784) took 1352 ms. Trace:
I20260928 14:50:38.696234 9813 rpcz_store.cc:276] 0928 14:50:37.343644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.343992 (+ 348us) service_pool.cc:227] Handling call
0928 14:50:38.695669 (+1351677us) ts_tablet_manager.cc:1145] Deleting tablet 9f04c05cdad04261a1e2ae7e044ddbfb
0928 14:50:38.695678 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.695879 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309892}
W20260928 14:50:38.696919 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9f04c05cdad04261a1e2ae7e044ddbfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f04c05cdad04261a1e2ae7e044ddbfb already in progress: creating tablet
I20260928 14:50:38.697036 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 786) took 1353 ms. Trace:
I20260928 14:50:38.697348 9813 rpcz_store.cc:276] 0928 14:50:37.343863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.344160 (+ 297us) service_pool.cc:227] Handling call
0928 14:50:38.696774 (+1352614us) ts_tablet_manager.cc:1145] Deleting tablet 6bff112215814b8ba3d6624bbec772e1
0928 14:50:38.696784 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.696984 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310890}
I20260928 14:50:38.698150 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 787) took 1354 ms. Trace:
I20260928 14:50:38.698385 9813 rpcz_store.cc:276] 0928 14:50:37.343944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.344252 (+ 308us) service_pool.cc:227] Handling call
0928 14:50:38.697901 (+1353649us) ts_tablet_manager.cc:1145] Deleting tablet 9dd00b9377b245a29d2a6735248112bc
0928 14:50:38.697948 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.698101 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1311958}
W20260928 14:50:38.699172 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9dd00b9377b245a29d2a6735248112bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9dd00b9377b245a29d2a6735248112bc already in progress: creating tablet
I20260928 14:50:38.699132 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 785) took 1355 ms. Trace:
I20260928 14:50:38.699435 9813 rpcz_store.cc:276] 0928 14:50:37.343772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.347722 (+ 3950us) service_pool.cc:227] Handling call
0928 14:50:38.698912 (+1351190us) ts_tablet_manager.cc:1145] Deleting tablet e5cb151d58f545d9b1e6f652a0627ab9
0928 14:50:38.698922 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.699113 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312945}
I20260928 14:50:38.700312 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 783) took 1372 ms. Trace:
I20260928 14:50:38.700546 9813 rpcz_store.cc:276] 0928 14:50:37.327351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.327657 (+ 306us) service_pool.cc:227] Handling call
0928 14:50:38.700031 (+1372374us) ts_tablet_manager.cc:1145] Deleting tablet 2b92039b9a484a768efa3714b58248ef
0928 14:50:38.700087 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.700241 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295312}
I20260928 14:50:38.701200 9813 tablet_replica.cc:330] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:38.701619 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e5cb151d58f545d9b1e6f652a0627ab9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5cb151d58f545d9b1e6f652a0627ab9 already in progress: creating tablet
I20260928 14:50:38.701809 9813 raft_consensus.cc:2229] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:38.702021 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2b92039b9a484a768efa3714b58248ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b92039b9a484a768efa3714b58248ef already in progress: creating tablet
I20260928 14:50:38.702250 9813 raft_consensus.cc:2258] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.703305 9813 ts_tablet_manager.cc:1905] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:38.705986 9220 consensus_peers.cc:487] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:38.708999 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6e4ce1f9eed42abb3688716dc6733cf consensus state has no leader
I20260928 14:50:38.709244 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4117a5bc71ab4993bebe7d817ba46031
I20260928 14:50:38.709657 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4001db9bc2b946be85c0c1767b203039" } modify_external_catalogs: true
I20260928 14:50:38.710676 9567 raft_consensus.cc:1261] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:38.711180 10552 consensus_queue.cc:1035] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:38.714507 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.715222 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 66772fac8b3747f0983562195abcc64e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.715763 9813 ts_tablet_manager.cc:1918] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.715860 9813 log.cc:1196] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8b914e3c8243490d92378a8765d6390f
I20260928 14:50:38.717732 10677 raft_consensus.cc:482] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.717847 10677 raft_consensus.cc:504] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.718355 10677 leader_election.cc:288] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.719362 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 727cb249723946578bc5bb086d6e6c40
I20260928 14:50:38.720893 9851 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.721067 9851 ts_tablet_manager.cc:1397] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
W20260928 14:50:38.722167 9360 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:38.722708 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet afe58ef9809540cb942e3ec44296e36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.722678 9851 raft_consensus.cc:348] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.722934 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 727cb249723946578bc5bb086d6e6c40 with delete_type TABLET_DATA_DELETED (replaced by tablet 32e609be5acd42b48b6b7423cd56401a) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.722946 9851 raft_consensus.cc:374] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.723009 9851 raft_consensus.cc:729] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.723187 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet a2d5a67ec9ce403d91ef1f6d52380b96 (table default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]) successfully deleted
I20260928 14:50:38.723409 9851 consensus_queue.cc:260] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:38.723588 9360 leader_election.cc:341] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:38.723686 9360 leader_election.cc:302] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.723856 9813 ts_tablet_manager.cc:1939] T 8b914e3c8243490d92378a8765d6390f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.724049 9855 ts_tablet_manager.cc:1428] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.143s user 0.002s sys 0.000s
I20260928 14:50:38.724128 10677 raft_consensus.cc:2726] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.724128 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 789) took 1273 ms. Trace:
I20260928 14:50:38.724334 9855 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.724355 9813 rpcz_store.cc:276] 0928 14:50:37.450380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.450734 (+ 354us) service_pool.cc:227] Handling call
0928 14:50:38.701123 (+1250389us) ts_tablet_manager.cc:1145] Deleting tablet 8b914e3c8243490d92378a8765d6390f
0928 14:50:38.701135 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.712741 (+ 11606us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.715697 (+ 2956us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.724115 (+ 8418us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250160}
I20260928 14:50:38.724640 9813 tablet_replica.cc:330] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.724802 9813 raft_consensus.cc:2229] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.724921 9813 raft_consensus.cc:2258] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.725494 9813 ts_tablet_manager.cc:1905] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.728307 9851 ts_tablet_manager.cc:1428] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260928 14:50:38.730630 9813 ts_tablet_manager.cc:1918] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.730737 9813 log.cc:1196] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8296732efcb349ab9cc87e3ff1e11fd0
I20260928 14:50:38.731005 9813 ts_tablet_manager.cc:1939] T 8296732efcb349ab9cc87e3ff1e11fd0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.731264 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 790) took 1266 ms. Trace:
I20260928 14:50:38.731338 9813 rpcz_store.cc:276] 0928 14:50:37.465204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.465259 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:38.724602 (+1259343us) ts_tablet_manager.cc:1145] Deleting tablet 8296732efcb349ab9cc87e3ff1e11fd0
0928 14:50:38.724612 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.728059 (+ 3447us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.730565 (+ 2506us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.731252 (+ 687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258642}
I20260928 14:50:38.731665 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 791) took 1255 ms. Trace:
I20260928 14:50:38.731740 9813 rpcz_store.cc:276] 0928 14:50:37.476408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.476688 (+ 280us) service_pool.cc:227] Handling call
0928 14:50:38.731568 (+1254880us) ts_tablet_manager.cc:1145] Deleting tablet 3b75816a9816497ca6bc6ba8e5c5eb3d
0928 14:50:38.731577 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.731651 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1254703}
I20260928 14:50:38.731976 9813 tablet_replica.cc:330] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.732144 9813 raft_consensus.cc:2229] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.732272 9813 raft_consensus.cc:2258] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.732786 9813 ts_tablet_manager.cc:1905] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.732939 9851 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.735322 9851 tablet_bootstrap.cc:654] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.735441 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_41fcada969964258a48a44db603216b5" } modify_external_catalogs: true
I20260928 14:50:38.735599 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8b914e3c8243490d92378a8765d6390f (table default.Table_38a7426d79f54a28be2cc6abd2f3c923 [id=eb51d531a1f643189883977d5d7e9715]) successfully deleted
I20260928 14:50:38.735616 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 727cb249723946578bc5bb086d6e6c40 deleted and replaced by tablet 32e609be5acd42b48b6b7423cd56401a
I20260928 14:50:38.736570 9848 tablet_bootstrap.cc:492] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.736521 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8296732efcb349ab9cc87e3ff1e11fd0 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
I20260928 14:50:38.736750 9848 ts_tablet_manager.cc:1397] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.071s user 0.000s sys 0.008s
W20260928 14:50:38.736891 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b75816a9816497ca6bc6ba8e5c5eb3d already in progress: creating tablet
I20260928 14:50:38.737397 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 79ef0426eb92482a83d9903e0d6153c1
I20260928 14:50:38.737443 9848 raft_consensus.cc:348] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.737730 9848 raft_consensus.cc:374] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.737814 9848 raft_consensus.cc:729] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.738036 9848 consensus_queue.cc:260] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.739061 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:38.739230 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 01c1e945f1c54281856bfabe08fba42e (table default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]) successfully deleted
W20260928 14:50:38.739585 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 66772fac8b3747f0983562195abcc64e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66772fac8b3747f0983562195abcc64e already in progress: creating tablet
I20260928 14:50:38.740516 9848 ts_tablet_manager.cc:1428] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260928 14:50:38.740805 9848 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.740634 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bfa126b466444d33ab6b35eb4b09680b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.741184 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfa126b466444d33ab6b35eb4b09680b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.743574 10895 raft_consensus.cc:482] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.743719 10895 raft_consensus.cc:504] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.744344 10895 leader_election.cc:288] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.744884 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac853c5b6f4f9cb9de91e6aa448c75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.745399 9498 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.745909 10677 raft_consensus.cc:482] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.746029 10677 raft_consensus.cc:504] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:38.746610 10677 leader_election.cc:288] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:38.747220 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:38.746124 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac853c5b6f4f9cb9de91e6aa448c75" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.747212 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c556381a95fa42e284dab68a7f401e63" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:38.749902 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 39091da7a6fb4aceadd3434bd304c268
I20260928 14:50:38.750258 9360 leader_election.cc:302] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:38.750887 9497 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.750993 9497 leader_election.cc:302] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.751339 10895 raft_consensus.cc:2726] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.751737 10677 raft_consensus.cc:2726] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.754222 10552 consensus_queue.cc:1035] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:38.754325 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 39091da7a6fb4aceadd3434bd304c268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.754729 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.755029 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet 4117a5bc71ab4993bebe7d817ba46031 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.755592 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_77bf464749b54bcfaa58cb2fb76b9b87" } new_table_name: "default.Table_10cf8a0b98ba43a3b9f4c78ec3c73de7" modify_external_catalogs: true
I20260928 14:50:38.757701 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e66d01a20bc54be0b7bf73284800b6d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.758556 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e66d01a20bc54be0b7bf73284800b6d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.760794 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a08023e8b16d4821a87ecf11c0a4f562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.761516 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a08023e8b16d4821a87ecf11c0a4f562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.763639 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a8329927f074163871a1cbe4e0e3c46 consensus state has no leader
I20260928 14:50:38.763484 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_81ba99afeafb41d4be70bdcc7b135e1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.764268 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81ba99afeafb41d4be70bdcc7b135e1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.764428 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_46a114a9c79f44b7a5d27044b9cbeda1" } new_table_name: "default.Table_59f0eeb2e2874fc9a5d62af6564efef2" modify_external_catalogs: true
I20260928 14:50:38.766491 9851 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.766486 10677 raft_consensus.cc:482] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.766597 10677 raft_consensus.cc:504] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.766723 9851 ts_tablet_manager.cc:1397] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260928 14:50:38.767181 10677 leader_election.cc:288] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.767678 9851 raft_consensus.cc:348] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.767913 9851 raft_consensus.cc:374] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.767975 9851 raft_consensus.cc:729] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.768152 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cf0711f56e724fedba65fee2b61378d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.768322 9360 leader_election.cc:341] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d806161b858145e1a4fa946587ae1529
I20260928 14:50:38.768213 9851 consensus_queue.cc:260] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:38.768620 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf0711f56e724fedba65fee2b61378d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.768631 9360 leader_election.cc:341] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: d806161b858145e1a4fa946587ae1529
I20260928 14:50:38.768716 9360 leader_election.cc:302] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:38.768822 9851 ts_tablet_manager.cc:1428] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:38.769145 9851 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.769397 10677 raft_consensus.cc:2726] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.769726 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7993fc05acd649b492783050564153ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.770166 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7993fc05acd649b492783050564153ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.773010 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f09fdf67c68c48d299fe22d83c67b4ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:38.773880 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f09fdf67c68c48d299fe22d83c67b4ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.777110 9855 tablet_bootstrap.cc:654] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.779982 9848 tablet_bootstrap.cc:654] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.781035 9851 tablet_bootstrap.cc:654] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.792912 9813 ts_tablet_manager.cc:1918] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.793035 9813 log.cc:1196] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/852b70b1f7444ad2ab92d66d580a0db7
I20260928 14:50:38.793331 9813 ts_tablet_manager.cc:1939] T 852b70b1f7444ad2ab92d66d580a0db7 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:38.802273 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 66772fac8b3747f0983562195abcc64e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66772fac8b3747f0983562195abcc64e already in progress: creating tablet
I20260928 14:50:38.804293 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.805655 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 4117a5bc71ab4993bebe7d817ba46031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.806234 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_836c57f02277490ab989a2438b10304c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.808411 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 727cb249723946578bc5bb086d6e6c40 with delete_type TABLET_DATA_DELETED (replaced by tablet 32e609be5acd42b48b6b7423cd56401a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.808667 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 39091da7a6fb4aceadd3434bd304c268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.808699 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.808892 9814 tablet_replica.cc:330] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:38.809075 9814 raft_consensus.cc:2229] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.809650 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.811088 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.811235 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.784358 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4f4696110aa04b4d98a90d7acf435e4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:38.816500 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5a0e54b68ecb48adb9658774ac31c91c" } modify_external_catalogs: true
W20260928 14:50:38.816728 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4117a5bc71ab4993bebe7d817ba46031 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4117a5bc71ab4993bebe7d817ba46031 already in progress: creating tablet
I20260928 14:50:38.825606 9848 tablet_bootstrap.cc:492] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.825610 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a380394f52e94a7bab93d509467e5376" } new_table_name: "default.Table_0738d88c93774a4b91aee142a00d29df" modify_external_catalogs: true
I20260928 14:50:38.825824 9848 ts_tablet_manager.cc:1397] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.085s user 0.005s sys 0.000s
I20260928 14:50:38.826548 9848 raft_consensus.cc:348] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.826790 10677 raft_consensus.cc:482] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.826905 10677 raft_consensus.cc:504] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.827107 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 792) took 1345 ms. Trace:
I20260928 14:50:38.827175 9813 rpcz_store.cc:276] 0928 14:50:37.481936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.482075 (+ 139us) service_pool.cc:227] Handling call
0928 14:50:38.731941 (+1249866us) ts_tablet_manager.cc:1145] Deleting tablet 852b70b1f7444ad2ab92d66d580a0db7
0928 14:50:38.731950 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.789959 (+ 58009us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.792831 (+ 2872us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.827092 (+ 34261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249711}
I20260928 14:50:38.827418 10677 leader_election.cc:288] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:38.827535 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 809) took 1180 ms. Trace:
I20260928 14:50:38.827615 9813 rpcz_store.cc:276] 0928 14:50:37.646607 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.646654 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:38.827424 (+1180770us) ts_tablet_manager.cc:1145] Deleting tablet 2967f173bf154bc79bd00e409122f16b
0928 14:50:38.827433 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.827520 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180588}
I20260928 14:50:38.827905 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 810) took 1180 ms. Trace:
I20260928 14:50:38.827970 9813 rpcz_store.cc:276] 0928 14:50:37.647434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.653063 (+ 5629us) service_pool.cc:227] Handling call
0928 14:50:38.827814 (+1174751us) ts_tablet_manager.cc:1145] Deleting tablet 69ef1340deca4f00a250c390afcb5064
0928 14:50:38.827823 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.827891 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174602}
I20260928 14:50:38.826810 9848 raft_consensus.cc:374] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:38.828536 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f4696110aa04b4d98a90d7acf435e4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:38.828678 9360 leader_election.cc:341] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 82b042c6ffc148939dcba9b710f198d3
W20260928 14:50:38.828850 9360 leader_election.cc:341] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 82b042c6ffc148939dcba9b710f198d3
I20260928 14:50:38.828913 9360 leader_election.cc:302] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:38.829041 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_836c57f02277490ab989a2438b10304c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:38.828954 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5a0e54b68ecb48adb9658774ac31c91c" } modify_external_catalogs: true
I20260928 14:50:38.829331 10677 raft_consensus.cc:2726] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:38.829629 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e59ac8618ca64e09b1af2469745271f8 consensus state has no leader
I20260928 14:50:38.829967 9813 tablet_replica.cc:330] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:38.829962 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4117a5bc71ab4993bebe7d817ba46031 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4117a5bc71ab4993bebe7d817ba46031 already in progress: creating tablet
I20260928 14:50:38.830154 9813 raft_consensus.cc:2229] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.830289 9813 raft_consensus.cc:2258] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.830940 9848 raft_consensus.cc:729] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.831127 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_056d3fea7c954741878c0c00280b909e" } modify_external_catalogs: true
I20260928 14:50:38.831331 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_056d3fea7c954741878c0c00280b909e" } modify_external_catalogs: true
I20260928 14:50:38.833261 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_304c4f68873343d6a5f9e77b05c8dfcc" } new_table_name: "default.Table_03083d6d919843cd89a110cd5acc31f1" modify_external_catalogs: true
I20260928 14:50:38.835132 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 852b70b1f7444ad2ab92d66d580a0db7 (table default.Table_2daaa607d7bb425caea915bbbdb6b8f7 [id=642d2fdad14e4f7e9f2f649802f6f6a5]) successfully deleted
W20260928 14:50:38.835397 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2967f173bf154bc79bd00e409122f16b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2967f173bf154bc79bd00e409122f16b already in progress: creating tablet
W20260928 14:50:38.836009 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 69ef1340deca4f00a250c390afcb5064 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ef1340deca4f00a250c390afcb5064 already in progress: creating tablet
I20260928 14:50:38.838124 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a with delete_type TABLET_DATA_DELETED (replaced by tablet a0d94bf844904306b84695e452d62ebd) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.840409 9848 consensus_queue.cc:260] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.840981 9848 ts_tablet_manager.cc:1428] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260928 14:50:38.844158 9813 ts_tablet_manager.cc:1905] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.846145 9848 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.850538 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 091600d56fdc469d8b754acd8933808b
W20260928 14:50:38.851373 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 consensus state has no leader
I20260928 14:50:38.851430 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 091600d56fdc469d8b754acd8933808b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.851657 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 091600d56fdc469d8b754acd8933808b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.852463 9848 tablet_bootstrap.cc:654] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.856348 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet dbf40dcd1f57425a85193a3fe4b039b6
I20260928 14:50:38.856846 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.857345 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.857472 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 1738a95895914cc4936a38e1d189d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:23 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:38.861917 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d263a96b792346b6af2a6eb29737afb6 consensus state has no leader
I20260928 14:50:38.865641 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 727cb249723946578bc5bb086d6e6c40 with delete_type TABLET_DATA_DELETED (replaced by tablet 32e609be5acd42b48b6b7423cd56401a) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.865969 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.866107 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 091600d56fdc469d8b754acd8933808b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.866233 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet dbf40dcd1f57425a85193a3fe4b039b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.866807 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef0426eb92482a83d9903e0d6153c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.867054 9815 tablet_replica.cc:330] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.867254 9815 raft_consensus.cc:2229] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.867431 9815 raft_consensus.cc:2258] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.867915 9815 ts_tablet_manager.cc:1905] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.865854 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 39091da7a6fb4aceadd3434bd304c268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.871697 10941 tablet.cc:1722] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.875222 9815 ts_tablet_manager.cc:1918] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:38.875310 9815 log.cc:1196] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/727cb249723946578bc5bb086d6e6c40
I20260928 14:50:38.875648 9815 ts_tablet_manager.cc:1939] T 727cb249723946578bc5bb086d6e6c40 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.875900 10942 tablet.cc:1722] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.876084 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 4729fc718bf540ecb501c2cac3966bb0 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.876325 9848 tablet_bootstrap.cc:492] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.876461 9848 ts_tablet_manager.cc:1397] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.001s
I20260928 14:50:38.876816 9815 tablet_replica.cc:330] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.876981 9815 raft_consensus.cc:2229] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.877099 9815 raft_consensus.cc:2258] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.877101 9848 raft_consensus.cc:348] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.877291 9848 raft_consensus.cc:374] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.877347 9848 raft_consensus.cc:729] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.877514 9848 consensus_queue.cc:260] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.878290 9848 ts_tablet_manager.cc:1428] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:38.878540 9848 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.877781 9815 ts_tablet_manager.cc:1905] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.880278 9848 tablet_bootstrap.cc:654] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.882513 9848 tablet_bootstrap.cc:492] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.883731 9848 ts_tablet_manager.cc:1397] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260928 14:50:38.884508 9848 raft_consensus.cc:348] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.884886 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]) successfully deleted
I20260928 14:50:38.885597 9855 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:38.885728 9855 ts_tablet_manager.cc:1397] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.161s user 0.007s sys 0.009s
I20260928 14:50:38.886376 9855 raft_consensus.cc:348] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.886569 9855 raft_consensus.cc:374] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.886729 9848 raft_consensus.cc:374] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.886835 9848 raft_consensus.cc:729] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.886624 9855 raft_consensus.cc:729] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.887022 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet cbd9f9cb48a945d19420a8bdb9bb9576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.887609 9855 consensus_queue.cc:260] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.888031 9851 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.888124 9855 ts_tablet_manager.cc:1428] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:38.887764 9848 consensus_queue.cc:260] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.888315 9851 ts_tablet_manager.cc:1397] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.119s user 0.013s sys 0.014s
I20260928 14:50:38.892263 8946 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff] alter complete (version 2)
I20260928 14:50:38.892668 9848 ts_tablet_manager.cc:1428] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:38.892755 9851 raft_consensus.cc:348] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.893026 9851 raft_consensus.cc:374] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.893131 9851 raft_consensus.cc:729] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.893358 9851 consensus_queue.cc:260] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.893776 10895 raft_consensus.cc:482] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.893884 10895 raft_consensus.cc:504] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.894006 9851 ts_tablet_manager.cc:1428] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260928 14:50:38.894225 9851 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.894385 10895 leader_election.cc:288] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.895112 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:38.895975 9497 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.896843 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:38.896966 9848 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.897362 10817 raft_consensus.cc:482] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:38.897459 9498 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.897569 9498 leader_election.cc:302] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.897473 10817 raft_consensus.cc:504] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.897873 10895 raft_consensus.cc:2726] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.898015 10817 leader_election.cc:288] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.898411 9848 tablet_bootstrap.cc:654] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:38.898778 9219 leader_election.cc:341] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:38.899930 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86f11c5ca3154bac934cae3842f16de4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:38.900439 9220 leader_election.cc:341] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.900529 9220 leader_election.cc:302] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.900844 10817 raft_consensus.cc:2726] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.902055 9851 tablet_bootstrap.cc:654] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.885844 9813 ts_tablet_manager.cc:1918] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.902798 9813 log.cc:1196] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/b9f843006a1e43a49f177433c7a3e1ea
I20260928 14:50:38.903124 9813 ts_tablet_manager.cc:1939] T b9f843006a1e43a49f177433c7a3e1ea P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.908134 9814 raft_consensus.cc:2258] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.908505 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 808) took 1262 ms. Trace:
I20260928 14:50:38.910000 9813 rpcz_store.cc:276] 0928 14:50:37.646520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.661582 (+ 15062us) service_pool.cc:227] Handling call
0928 14:50:38.829926 (+1168344us) ts_tablet_manager.cc:1145] Deleting tablet b9f843006a1e43a49f177433c7a3e1ea
0928 14:50:38.829936 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.868021 (+ 38085us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.885762 (+ 17741us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.908490 (+ 22728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168172}
I20260928 14:50:38.910578 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 811) took 1244 ms. Trace:
I20260928 14:50:38.910722 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet b9f843006a1e43a49f177433c7a3e1ea (table default.Table_24d1275ef415467cb0fd23d519f914f2 [id=7700eff2a2ce4e84b5487533aded9c85]) successfully deleted
I20260928 14:50:38.910729 9813 rpcz_store.cc:276] 0928 14:50:37.665998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.666049 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:38.910471 (+1244422us) ts_tablet_manager.cc:1145] Deleting tablet 36d6aa0e87854c48b52bbb20b10702d6
0928 14:50:38.910481 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.910560 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244275}
I20260928 14:50:38.911154 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet f1dacb0eef514609bcaf503ccc9845e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca013d1c5b44730b7163e71dc408b04) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.911356 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 820) took 1110 ms. Trace:
I20260928 14:50:38.911468 9813 rpcz_store.cc:276] 0928 14:50:37.801261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.801306 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:38.911212 (+1109906us) ts_tablet_manager.cc:1145] Deleting tablet d30d06c910fa4142a6248e8bfd00f4b2
0928 14:50:38.911221 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.911342 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1109710}
W20260928 14:50:38.911552 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 36d6aa0e87854c48b52bbb20b10702d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36d6aa0e87854c48b52bbb20b10702d6 already in progress: creating tablet
I20260928 14:50:38.911793 9813 tablet_replica.cc:330] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:38.911937 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d30d06c910fa4142a6248e8bfd00f4b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d30d06c910fa4142a6248e8bfd00f4b2 already in progress: creating tablet
I20260928 14:50:38.912767 9813 raft_consensus.cc:2229] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.912889 9815 ts_tablet_manager.cc:1918] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.913038 9815 log.cc:1196] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:38.913401 9815 ts_tablet_manager.cc:1939] T f28a74dc0afe4f20b47139a703550ef6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:38.913592 9813 raft_consensus.cc:2258] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.914134 9813 ts_tablet_manager.cc:1905] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.914737 9815 tablet_replica.cc:330] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:38.917541 9815 raft_consensus.cc:2229] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.917790 9815 raft_consensus.cc:2258] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.920043 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f28a74dc0afe4f20b47139a703550ef6 (table default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]) successfully deleted
I20260928 14:50:38.919718 9851 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.923203 9851 ts_tablet_manager.cc:1397] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260928 14:50:38.926144 9851 raft_consensus.cc:348] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.926381 9851 raft_consensus.cc:374] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.926476 9851 raft_consensus.cc:729] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.926731 9851 consensus_queue.cc:260] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.927281 9851 ts_tablet_manager.cc:1428] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:38.929416 9851 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:38.930720 9360 consensus_peers.cc:487] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 727cb249723946578bc5bb086d6e6c40. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:38.930790 9851 tablet_bootstrap.cc:654] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.934937 9814 ts_tablet_manager.cc:1905] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.941851 9813 ts_tablet_manager.cc:1918] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:38.941954 9813 log.cc:1196] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5f348f9e962748a0992d85b9d3d72aeb
I20260928 14:50:38.942222 9813 ts_tablet_manager.cc:1939] T 5f348f9e962748a0992d85b9d3d72aeb P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:38.942855 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 823) took 1020 ms. Trace:
I20260928 14:50:38.942943 9813 rpcz_store.cc:276] 0928 14:50:37.922180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.922234 (+ 54us) service_pool.cc:227] Handling call
0928 14:50:38.911757 (+989523us) ts_tablet_manager.cc:1145] Deleting tablet 5f348f9e962748a0992d85b9d3d72aeb
0928 14:50:38.911767 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.937827 (+ 26060us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.941775 (+ 3948us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.942838 (+ 1063us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":986858}
I20260928 14:50:38.943293 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 822) took 1031 ms. Trace:
I20260928 14:50:38.943310 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5f348f9e962748a0992d85b9d3d72aeb (table default.Table_ec53a95de3d2420e8fb0c19d712a61aa [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:38.943369 9813 rpcz_store.cc:276] 0928 14:50:37.911399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.922997 (+ 11598us) service_pool.cc:227] Handling call
0928 14:50:38.943183 (+1020186us) ts_tablet_manager.cc:1145] Deleting tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b
0928 14:50:38.943193 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.943277 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018197}
I20260928 14:50:38.943619 9813 tablet_replica.cc:330] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:38.943802 9813 raft_consensus.cc:2229] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.943957 9813 raft_consensus.cc:2258] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.944420 9813 ts_tablet_manager.cc:1905] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:38.944716 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b already in progress: creating tablet
I20260928 14:50:38.945655 10941 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.954730 10950 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:38.955454 9814 ts_tablet_manager.cc:1918] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:38.955559 9814 log.cc:1196] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/727cb249723946578bc5bb086d6e6c40
I20260928 14:50:38.956569 9851 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:38.956753 9851 ts_tablet_manager.cc:1397] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260928 14:50:38.958877 9851 raft_consensus.cc:348] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.959136 9851 raft_consensus.cc:374] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.959225 9851 raft_consensus.cc:729] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.959489 9851 consensus_queue.cc:260] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.960032 9851 ts_tablet_manager.cc:1428] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:38.960264 9855 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:38.965616 9851 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:38.966691 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 0a5a14312acc4de39e72ac15cf74fcbf from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:38.966915 9848 tablet_bootstrap.cc:492] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.966981 9855 tablet_bootstrap.cc:654] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.966984 9851 tablet_bootstrap.cc:654] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.967027 9848 ts_tablet_manager.cc:1397] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.016s
I20260928 14:50:38.967108 10817 raft_consensus.cc:482] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:38.967219 10817 raft_consensus.cc:504] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.967732 10817 leader_election.cc:288] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:38.967675 9848 raft_consensus.cc:348] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.967852 9848 raft_consensus.cc:374] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.967900 9848 raft_consensus.cc:729] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.968096 9848 consensus_queue.cc:260] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.968564 9848 ts_tablet_manager.cc:1428] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:38.969866 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
I20260928 14:50:38.970702 9848 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.972203 9848 tablet_bootstrap.cc:654] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:38.972833 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:38.975550 9219 leader_election.cc:341] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7d267fa0a698437986feb52cd9c15cc1
I20260928 14:50:38.976178 9814 ts_tablet_manager.cc:1939] T 727cb249723946578bc5bb086d6e6c40 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:38.977686 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6b0867466459ca14413559800ff64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.977908 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d267fa0a698437986feb52cd9c15cc1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:38.981345 9814 tablet_replica.cc:330] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:38.983764 9220 leader_election.cc:341] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:38.983881 9220 leader_election.cc:302] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:38.984076 10817 raft_consensus.cc:2726] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:38.984690 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]) successfully deleted
W20260928 14:50:38.984997 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 39091da7a6fb4aceadd3434bd304c268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39091da7a6fb4aceadd3434bd304c268 already in progress: creating tablet
W20260928 14:50:38.985203 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 79ef0426eb92482a83d9903e0d6153c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ef0426eb92482a83d9903e0d6153c1 already in progress: creating tablet
I20260928 14:50:38.986009 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:38.989689 9814 raft_consensus.cc:2229] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:38.989856 9814 raft_consensus.cc:2258] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:38.991645 9814 ts_tablet_manager.cc:1905] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:38.991869 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 21ffc5bee62845519a4b7ee8c914e70d (table default.Table_01fb8b545e2648849deb8c293b3b9cd6 [id=8aeb1610df884d82ac12f54569e7ed98]). Expected version 1 got 0
I20260928 14:50:38.992151 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_7917435d3b4e4f27ae33c29460308484 [id=38a18331beae4386a199edd7e5491230]). Expected version 2 got 0
I20260928 14:50:38.992512 9848 tablet_bootstrap.cc:492] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:38.992785 9848 ts_tablet_manager.cc:1397] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260928 14:50:38.993489 9848 raft_consensus.cc:348] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.993767 9848 raft_consensus.cc:374] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:38.993866 9848 raft_consensus.cc:729] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:38.994225 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0a5a14312acc4de39e72ac15cf74fcbf
I20260928 14:50:38.994120 9848 consensus_queue.cc:260] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:38.994624 8953 catalog_manager.cc:6565] ReplaceTablet: tablet 0a5a14312acc4de39e72ac15cf74fcbf deleted and replaced by tablet 5bf714191e8f4835aa8414bd902833a9
I20260928 14:50:38.995123 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf with delete_type TABLET_DATA_DELETED (replaced by tablet 5bf714191e8f4835aa8414bd902833a9) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:38.996146 9813 ts_tablet_manager.cc:1918] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:38.996237 9813 log.cc:1196] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/254ab608221e4fe2bc459f9d6fee925a
I20260928 14:50:38.997037 9848 ts_tablet_manager.cc:1428] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:38.997901 9848 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:38.998253 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf with delete_type TABLET_DATA_DELETED (replaced by tablet 5bf714191e8f4835aa8414bd902833a9) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:38.998723 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a5a14312acc4de39e72ac15cf74fcbf with delete_type TABLET_DATA_DELETED (replaced by tablet 5bf714191e8f4835aa8414bd902833a9) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:38.999390 9848 tablet_bootstrap.cc:654] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.005303 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b8bf89489cec43d2ad925995c11007a2" } new_table_name: "default.Table_44b3f5bdc0754ca6abbae36af06bcfca" modify_external_catalogs: true
I20260928 14:50:39.005381 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_352c130d9bb84d8984fd0573e0d78b7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.005910 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_352c130d9bb84d8984fd0573e0d78b7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.006244 9813 ts_tablet_manager.cc:1939] T 254ab608221e4fe2bc459f9d6fee925a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.006881 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 824) took 1029 ms. Trace:
I20260928 14:50:39.006968 9813 rpcz_store.cc:276] 0928 14:50:37.977133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.977184 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:38.943563 (+966379us) ts_tablet_manager.cc:1145] Deleting tablet 254ab608221e4fe2bc459f9d6fee925a
0928 14:50:38.943572 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:38.990997 (+ 47425us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:38.996073 (+ 5076us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.006863 (+ 10790us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":966220}
I20260928 14:50:39.007248 9813 tablet_replica.cc:330] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.007414 9813 raft_consensus.cc:2229] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.007542 9813 raft_consensus.cc:2258] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.008260 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 254ab608221e4fe2bc459f9d6fee925a (table default.Table_12d8f6b419c946f48ae9f7c461999575 [id=1e88a2a99878466eaae925e2d332c188]) successfully deleted
I20260928 14:50:39.009169 10942 tablet.cc:1722] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:39.012481 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet caddc46461d349c78a8f06df1f4d658c consensus state has no leader
I20260928 14:50:39.012753 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d05d8d79537247a1a6ef77e4e00859d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.012925 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e246f841a2543d69ee059defc37a2d6" } new_table_name: "default.Table_6f1cd1b3c22e4695985a10986a442034" modify_external_catalogs: true
W20260928 14:50:39.013311 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d05d8d79537247a1a6ef77e4e00859d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.013715 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e66d01a20bc54be0b7bf73284800b6d8" } modify_external_catalogs: true
I20260928 14:50:39.013913 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e66d01a20bc54be0b7bf73284800b6d8" } modify_external_catalogs: true
I20260928 14:50:39.014775 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f9a6762f650e4839b51bed6814860eef" } modify_external_catalogs: true
I20260928 14:50:39.014966 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f9a6762f650e4839b51bed6814860eef" } modify_external_catalogs: true
I20260928 14:50:39.014340 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b072b55c076c496b981860d100357f44" } modify_external_catalogs: true
I20260928 14:50:39.015759 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b072b55c076c496b981860d100357f44" } modify_external_catalogs: true
I20260928 14:50:39.017275 9851 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.017452 9851 ts_tablet_manager.cc:1397] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.001s
I20260928 14:50:39.018174 9815 ts_tablet_manager.cc:1905] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.018188 9851 raft_consensus.cc:348] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.018375 9851 raft_consensus.cc:374] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.018431 9851 raft_consensus.cc:729] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.018642 9851 consensus_queue.cc:260] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.019003 9813 ts_tablet_manager.cc:1905] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.021684 8950 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4] alter complete (version 2)
I20260928 14:50:39.022233 9851 ts_tablet_manager.cc:1428] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:39.023427 9848 tablet_bootstrap.cc:492] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.017484 9814 ts_tablet_manager.cc:1918] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.023547 9848 ts_tablet_manager.cc:1397] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260928 14:50:39.023808 9814 log.cc:1196] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:39.024180 9814 ts_tablet_manager.cc:1939] T 86f11c5ca3154bac934cae3842f16de4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.024405 9848 raft_consensus.cc:348] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.024624 9848 raft_consensus.cc:374] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.024683 9848 raft_consensus.cc:729] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.024915 9848 consensus_queue.cc:260] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.025740 9851 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.025978 9848 ts_tablet_manager.cc:1428] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:39.027237 9814 tablet_replica.cc:330] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.027305 9851 tablet_bootstrap.cc:654] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:39.028321 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e1bbf59243f4cf6bfc0f770cd01934d consensus state has no leader
I20260928 14:50:39.029043 9848 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:39.030751 9848 tablet_bootstrap.cc:654] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.031112 8956 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet c177dde0f5c5443fa611f3dbaa1dae67
I20260928 14:50:39.027505 9814 raft_consensus.cc:2229] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.031492 9814 raft_consensus.cc:2258] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.032698 9814 ts_tablet_manager.cc:1905] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.039980 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 86f11c5ca3154bac934cae3842f16de4 (table default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]) successfully deleted
I20260928 14:50:39.040884 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ca849c59018c4806bcded6e030c16848"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.041028 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_02540a2b82a6425d9b6a7d04ce13df5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.041587 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca849c59018c4806bcded6e030c16848 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.041690 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.041814 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_072f1034d9cd45109148c223b46617a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.042086 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:39.042284 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_072f1034d9cd45109148c223b46617a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.042501 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_57e0f72948c241daa7c51ddedecbc5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.043001 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57e0f72948c241daa7c51ddedecbc5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.042924 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fd8492b512fc4972890e5b661b979542"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.043418 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd8492b512fc4972890e5b661b979542 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:39.043491 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02540a2b82a6425d9b6a7d04ce13df5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.044520 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_32e300160b6d40b6b78f7cab5973cd76" } new_table_name: "default.Table_f3715b90ca484321bbe766fa27007209" modify_external_catalogs: true
I20260928 14:50:39.046515 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c602ad029b2647f381a367e5bac39fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.046917 9855 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
W20260928 14:50:39.046940 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c602ad029b2647f381a367e5bac39fc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.047065 9855 ts_tablet_manager.cc:1397] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.002s
I20260928 14:50:39.047765 9855 raft_consensus.cc:348] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.047984 9855 raft_consensus.cc:374] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.048045 9855 raft_consensus.cc:729] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.048259 9855 consensus_queue.cc:260] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.048828 9855 ts_tablet_manager.cc:1428] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:39.049639 9855 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.051807 10895 raft_consensus.cc:482] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.051925 10895 raft_consensus.cc:504] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.052443 10895 leader_election.cc:288] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.052812 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:39.053411 9497 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.053872 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.054591 9498 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.054695 9498 leader_election.cc:302] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.054992 10895 raft_consensus.cc:2726] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.055758 9815 ts_tablet_manager.cc:1918] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:39.055948 9813 ts_tablet_manager.cc:1918] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.056114 9815 log.cc:1196] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/091600d56fdc469d8b754acd8933808b
I20260928 14:50:39.056236 9813 log.cc:1196] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/dc8400fdb8d948b084733011b16df1b3
I20260928 14:50:39.056793 9813 ts_tablet_manager.cc:1939] T dc8400fdb8d948b084733011b16df1b3 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.059077 9814 ts_tablet_manager.cc:1918] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.059269 9815 ts_tablet_manager.cc:1939] T 091600d56fdc469d8b754acd8933808b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.057687 9422 raft_consensus.cc:3037] T c556381a95fa42e284dab68a7f401e63 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.061177 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 825) took 1083 ms. Trace:
I20260928 14:50:39.061254 9813 rpcz_store.cc:276] 0928 14:50:37.977229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.977280 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:39.007210 (+1029930us) ts_tablet_manager.cc:1145] Deleting tablet dc8400fdb8d948b084733011b16df1b3
0928 14:50:39.007220 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.033032 (+ 25812us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.054665 (+ 21633us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.061159 (+ 6494us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029781}
I20260928 14:50:39.061756 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet dc8400fdb8d948b084733011b16df1b3 (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]) successfully deleted
I20260928 14:50:39.062232 9813 tablet_replica.cc:330] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.062417 9813 raft_consensus.cc:2229] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.062546 9813 raft_consensus.cc:2258] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.064039 9815 tablet_replica.cc:330] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.064491 9815 raft_consensus.cc:2229] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.064687 9815 raft_consensus.cc:2258] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.064816 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]) successfully deleted
I20260928 14:50:39.064289 9855 tablet_bootstrap.cc:654] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:39.065083 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet dbf40dcd1f57425a85193a3fe4b039b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbf40dcd1f57425a85193a3fe4b039b6 already in progress: creating tablet
W20260928 14:50:39.065310 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 79ef0426eb92482a83d9903e0d6153c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ef0426eb92482a83d9903e0d6153c1 already in progress: creating tablet
W20260928 14:50:39.065536 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 39091da7a6fb4aceadd3434bd304c268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39091da7a6fb4aceadd3434bd304c268 already in progress: creating tablet
I20260928 14:50:39.068712 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7917435d3b4e4f27ae33c29460308484" } new_table_name: "default.Table_e9daf3dcd2ea41469f8e89a3f87ea208" modify_external_catalogs: true
I20260928 14:50:39.070621 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet ba281355b2f44b77a4ff99d49c084162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.070868 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet cf9342e920ae48278ab3f3c6d639fc94 with delete_type TABLET_DATA_DELETED (replaced by tablet ab6ccac2580049a5a615d8d36a44f373) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.072043 9813 ts_tablet_manager.cc:1905] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.072568 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_01fb8b545e2648849deb8c293b3b9cd6" } modify_external_catalogs: true
I20260928 14:50:39.072768 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_01fb8b545e2648849deb8c293b3b9cd6" } modify_external_catalogs: true
I20260928 14:50:39.074141 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0fe9bb8edba0417cb944819486542aa8" } modify_external_catalogs: true
I20260928 14:50:39.074379 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0fe9bb8edba0417cb944819486542aa8" } modify_external_catalogs: true
I20260928 14:50:39.076171 9815 ts_tablet_manager.cc:1905] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.076504 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_163954843d7844c084b6b7fb63f8c121" } new_table_name: "default.Table_a295eec0df314d1daf27bb41be119c4c" modify_external_catalogs: true
I20260928 14:50:39.076385 9814 log.cc:1196] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7d267fa0a698437986feb52cd9c15cc1
I20260928 14:50:39.077034 9814 ts_tablet_manager.cc:1939] T 7d267fa0a698437986feb52cd9c15cc1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.077562 9851 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.079676 9851 ts_tablet_manager.cc:1397] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.003s
I20260928 14:50:39.080988 9814 tablet_replica.cc:330] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.081226 9814 raft_consensus.cc:2229] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.081511 9814 raft_consensus.cc:2258] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.080452 9851 raft_consensus.cc:348] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.085371 9851 raft_consensus.cc:374] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.085497 9851 raft_consensus.cc:729] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.085762 9851 consensus_queue.cc:260] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.086614 9814 ts_tablet_manager.cc:1905] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.088593 9851 ts_tablet_manager.cc:1428] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:39.090406 9851 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:39.092286 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7879be7bb70430daf898fc79f5ce19c consensus state has no leader
I20260928 14:50:39.092679 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_400b69c56f5541d59fea79fb9d9ffd91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.093199 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_400b69c56f5541d59fea79fb9d9ffd91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.093425 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:39.094203 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9e9af23f6e3c4796b91d32916ea5ea6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.094516 10920 raft_consensus.cc:482] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:39.094689 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e9af23f6e3c4796b91d32916ea5ea6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.094642 10920 raft_consensus.cc:504] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.095209 10920 leader_election.cc:288] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.096983 9360 leader_election.cc:341] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 63cf6b4c153f4fbdb4ffe16f5c91da7a
W20260928 14:50:39.097188 9360 leader_election.cc:341] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 63cf6b4c153f4fbdb4ffe16f5c91da7a
I20260928 14:50:39.097262 9360 leader_election.cc:302] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.097440 9855 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.097571 9855 ts_tablet_manager.cc:1397] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260928 14:50:39.097759 10920 raft_consensus.cc:2726] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.097970 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:39.098220 9855 raft_consensus.cc:348] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.098426 9855 raft_consensus.cc:374] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.098527 9855 raft_consensus.cc:729] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.098740 9855 consensus_queue.cc:260] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.099311 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.099687 9855 ts_tablet_manager.cc:1428] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:39.101536 9855 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.103678 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7d267fa0a698437986feb52cd9c15cc1 (table default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]) successfully deleted
I20260928 14:50:39.104269 9855 tablet_bootstrap.cc:654] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.106017 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 2137c02d796a4290a8b160c57069fdd2 (DEFAULT_TABLE table=default.Table_415acab6842745adb711bc6992d57aed [id=21d36835573e4b2c942c801ed420fcff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.106381 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2137c02d796a4290a8b160c57069fdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.110554 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 293ba34b7a6c49e790861431646bb405 (DEFAULT_TABLE table=default.Table_06c05f309788430c9a874dbbb85b3ae9 [id=8f1e70080eac4c48810443ae058cc9f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.110898 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293ba34b7a6c49e790861431646bb405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.110848 9406 tablet_service.cc:1467] Processing CreateTablet for tablet f4569747ca024b828b06041e0a4f713d (DEFAULT_TABLE table=default.Table_0ccb3313b7104b4c8d0d1c59915df4a6 [id=b4a25a77ca5a4a4a9ce93119d376d128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.111162 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4569747ca024b828b06041e0a4f713d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.091926 9851 tablet_bootstrap.cc:654] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.121093 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 2137c02d796a4290a8b160c57069fdd2 (DEFAULT_TABLE table=default.Table_415acab6842745adb711bc6992d57aed [id=21d36835573e4b2c942c801ed420fcff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.121481 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2137c02d796a4290a8b160c57069fdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.121935 9815 ts_tablet_manager.cc:1918] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.122112 9815 log.cc:1196] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2df12117111548beb5d570436e2d6de2
I20260928 14:50:39.122483 9815 ts_tablet_manager.cc:1939] T 2df12117111548beb5d570436e2d6de2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.123771 9815 tablet_replica.cc:330] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.127038 9814 ts_tablet_manager.cc:1918] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.129176 9813 ts_tablet_manager.cc:1918] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.129917 9813 log.cc:1196] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/82b042c6ffc148939dcba9b710f198d3
I20260928 14:50:39.130270 9813 ts_tablet_manager.cc:1939] T 82b042c6ffc148939dcba9b710f198d3 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.130568 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 826) took 1153 ms. Trace:
I20260928 14:50:39.130692 9813 rpcz_store.cc:276] 0928 14:50:37.977341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:37.984861 (+ 7520us) service_pool.cc:227] Handling call
0928 14:50:39.061484 (+1076623us) ts_tablet_manager.cc:1145] Deleting tablet 82b042c6ffc148939dcba9b710f198d3
0928 14:50:39.061494 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.096233 (+ 34739us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.129099 (+ 32866us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.130554 (+ 1455us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076453}
I20260928 14:50:39.131201 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 82b042c6ffc148939dcba9b710f198d3 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:39.131524 9813 tablet_replica.cc:330] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.131736 9813 raft_consensus.cc:2229] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.131965 9813 raft_consensus.cc:2258] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.133695 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 21ffc5bee62845519a4b7ee8c914e70d
I20260928 14:50:39.134445 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.138684 9813 ts_tablet_manager.cc:1905] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.128624 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 2137c02d796a4290a8b160c57069fdd2 (DEFAULT_TABLE table=default.Table_415acab6842745adb711bc6992d57aed [id=21d36835573e4b2c942c801ed420fcff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.139098 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2137c02d796a4290a8b160c57069fdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.129235 9536 tablet_service.cc:1467] Processing CreateTablet for tablet f4569747ca024b828b06041e0a4f713d (DEFAULT_TABLE table=default.Table_0ccb3313b7104b4c8d0d1c59915df4a6 [id=b4a25a77ca5a4a4a9ce93119d376d128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.141772 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4569747ca024b828b06041e0a4f713d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.142058 10942 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:39.129601 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 293ba34b7a6c49e790861431646bb405 (DEFAULT_TABLE table=default.Table_06c05f309788430c9a874dbbb85b3ae9 [id=8f1e70080eac4c48810443ae058cc9f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:39.147017 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ddb704c5128a4880ae1b89b4d4d1fcfd consensus state has no leader
I20260928 14:50:39.148504 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 28ee844aa3c24336b4acb66dc43186e9 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:39.149435 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.150303 9815 raft_consensus.cc:2229] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.151525 9815 raft_consensus.cc:2258] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.128643 9256 tablet_service.cc:1467] Processing CreateTablet for tablet f4569747ca024b828b06041e0a4f713d (DEFAULT_TABLE table=default.Table_0ccb3313b7104b4c8d0d1c59915df4a6 [id=b4a25a77ca5a4a4a9ce93119d376d128]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.151713 9814 log.cc:1196] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/a303792e4c804844bc6037fabb425be4
I20260928 14:50:39.129645 9255 tablet_service.cc:1467] Processing CreateTablet for tablet e89370dcc9f645b5b585ba900c05821d (DEFAULT_TABLE table=default.Table_e43b73b053d24ce8b18f98f8db76e366 [id=87f4cd77da514be39e101d8a858b55eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.138216 9851 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.141350 10941 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:39.152158 9851 ts_tablet_manager.cc:1397] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20260928 14:50:39.156157 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4729fc718bf540ecb501c2cac3966bb0
I20260928 14:50:39.129575 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 293ba34b7a6c49e790861431646bb405 (DEFAULT_TABLE table=default.Table_06c05f309788430c9a874dbbb85b3ae9 [id=8f1e70080eac4c48810443ae058cc9f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.156523 8955 catalog_manager.cc:6565] ReplaceTablet: tablet 4729fc718bf540ecb501c2cac3966bb0 deleted and replaced by tablet 4cfab1937b3e48ef895dd12cbaa914cc
I20260928 14:50:39.152031 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89370dcc9f645b5b585ba900c05821d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.149015 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.157063 9851 raft_consensus.cc:348] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.151351 9394 tablet_service.cc:1467] Processing CreateTablet for tablet e89370dcc9f645b5b585ba900c05821d (DEFAULT_TABLE table=default.Table_e43b73b053d24ce8b18f98f8db76e366 [id=87f4cd77da514be39e101d8a858b55eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.157763 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89370dcc9f645b5b585ba900c05821d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.151485 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 (DEFAULT_TABLE table=default.Table_d0ae614c249b453da761cdb9df68f62c [id=c91d58c28d804494b65e14942265e434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.159861 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cfab1937b3e48ef895dd12cbaa914cc) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.160655 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2df12117111548beb5d570436e2d6de2 (table default.Table_19caea08036943b0b17c5e53d8c486b3 [id=b5e9a91ec4124a81a3410ab71fb084bb]) successfully deleted
I20260928 14:50:39.160832 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd5bf5648c546ac9145328ff3e8b198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.151839 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.152410 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293ba34b7a6c49e790861431646bb405. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.162508 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0a5a14312acc4de39e72ac15cf74fcbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a5a14312acc4de39e72ac15cf74fcbf already in progress: creating tablet
I20260928 14:50:39.167559 9815 ts_tablet_manager.cc:1905] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.170169 9851 raft_consensus.cc:374] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.170289 9851 raft_consensus.cc:729] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.170555 9851 consensus_queue.cc:260] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.160184 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4569747ca024b828b06041e0a4f713d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.173266 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293ba34b7a6c49e790861431646bb405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.152032 9814 ts_tablet_manager.cc:1939] T a303792e4c804844bc6037fabb425be4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.175853 9814 tablet_replica.cc:330] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.176204 9851 ts_tablet_manager.cc:1428] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260928 14:50:39.176512 9814 raft_consensus.cc:2229] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:39.176775 9814 raft_consensus.cc:2258] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.178045 9855 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.178174 9855 ts_tablet_manager.cc:1397] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.000s
I20260928 14:50:39.178769 9855 raft_consensus.cc:348] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.178963 9855 raft_consensus.cc:374] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.178977 9848 tablet_bootstrap.cc:492] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.179021 9855 raft_consensus.cc:729] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.179098 9848 ts_tablet_manager.cc:1397] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.150s user 0.018s sys 0.009s
I20260928 14:50:39.179229 9855 consensus_queue.cc:260] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.180120 9855 ts_tablet_manager.cc:1428] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:39.179875 9848 raft_consensus.cc:348] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.180497 9848 raft_consensus.cc:374] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.180589 9848 raft_consensus.cc:729] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.180826 9848 consensus_queue.cc:260] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.183913 9855 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.185468 9851 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.186313 9855 tablet_bootstrap.cc:654] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.177287 9814 ts_tablet_manager.cc:1905] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.192241 9848 ts_tablet_manager.cc:1428] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 14:50:39.193385 9813 ts_tablet_manager.cc:1918] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.193486 9813 log.cc:1196] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d806161b858145e1a4fa946587ae1529
I20260928 14:50:39.193825 9813 ts_tablet_manager.cc:1939] T d806161b858145e1a4fa946587ae1529 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.195055 9851 tablet_bootstrap.cc:654] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.195086 9535 tablet_service.cc:1467] Processing CreateTablet for tablet e89370dcc9f645b5b585ba900c05821d (DEFAULT_TABLE table=default.Table_e43b73b053d24ce8b18f98f8db76e366 [id=87f4cd77da514be39e101d8a858b55eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.195416 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89370dcc9f645b5b585ba900c05821d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.196218 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 (DEFAULT_TABLE table=default.Table_d0ae614c249b453da761cdb9df68f62c [id=c91d58c28d804494b65e14942265e434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.196547 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd5bf5648c546ac9145328ff3e8b198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.198750 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 (DEFAULT_TABLE table=default.Table_d0ae614c249b453da761cdb9df68f62c [id=c91d58c28d804494b65e14942265e434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.199066 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd5bf5648c546ac9145328ff3e8b198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.199915 9814 ts_tablet_manager.cc:1918] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:39.199996 9814 log.cc:1196] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/091600d56fdc469d8b754acd8933808b
I20260928 14:50:39.200330 9814 ts_tablet_manager.cc:1939] T 091600d56fdc469d8b754acd8933808b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.201623 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cfab1937b3e48ef895dd12cbaa914cc) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.201828 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 4729fc718bf540ecb501c2cac3966bb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cfab1937b3e48ef895dd12cbaa914cc) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.205216 9855 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.205185 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b (DEFAULT_TABLE table=default.Table_48e38a1afbb64c24911cd087a3bb9861 [id=6296e1263b3e42fab0a1efdaa997a880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.205330 9855 ts_tablet_manager.cc:1397] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.001s
I20260928 14:50:39.205650 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.205950 9855 raft_consensus.cc:348] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.206151 9855 raft_consensus.cc:374] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.206210 9855 raft_consensus.cc:729] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.206573 9422 raft_consensus.cc:3037] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.209889 9848 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:39.210680 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet a303792e4c804844bc6037fabb425be4 (table default.Table_39fb4e4216bf46188c6df0df4e908528 [id=6d447d56ce46413f934c0d407c8b7eb9]) successfully deleted
I20260928 14:50:39.211704 9848 tablet_bootstrap.cc:654] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.214876 9851 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.215353 10920 raft_consensus.cc:482] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.215306 9855 consensus_queue.cc:260] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.215472 10920 raft_consensus.cc:504] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.216019 10920 leader_election.cc:288] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.216305 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 830) took 1198 ms. Trace:
I20260928 14:50:39.216715 9851 ts_tablet_manager.cc:1397] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.003s
W20260928 14:50:39.217644 9360 leader_election.cc:341] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: e89035a3d41a4af78a8e7afbdb89c7e0
W20260928 14:50:39.218168 9360 leader_election.cc:341] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:39.218261 9360 leader_election.cc:302] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.218621 10920 raft_consensus.cc:2726] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.216408 9813 rpcz_store.cc:276] 0928 14:50:38.017715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.017767 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:39.131484 (+1113717us) ts_tablet_manager.cc:1145] Deleting tablet d806161b858145e1a4fa946587ae1529
0928 14:50:39.131495 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.190608 (+ 59113us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.193303 (+ 2695us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.216288 (+ 22985us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113543}
I20260928 14:50:39.219563 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 831) took 1201 ms. Trace:
I20260928 14:50:39.219655 9813 rpcz_store.cc:276] 0928 14:50:38.018439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.018487 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:39.219448 (+1200961us) ts_tablet_manager.cc:1145] Deleting tablet 666de9dd64734708b35738605204ed7d
0928 14:50:39.219460 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.219547 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1200798}
I20260928 14:50:39.219985 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 832) took 1196 ms. Trace:
I20260928 14:50:39.220079 9813 rpcz_store.cc:276] 0928 14:50:38.023438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.023484 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:39.219884 (+1196400us) ts_tablet_manager.cc:1145] Deleting tablet d6e0800aba3144c9979a09b959f5efc8
0928 14:50:39.219894 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.219970 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196233}
I20260928 14:50:39.220422 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 835) took 1180 ms. Trace:
I20260928 14:50:39.220505 9813 rpcz_store.cc:276] 0928 14:50:38.040455 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.040501 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:39.220321 (+1179820us) ts_tablet_manager.cc:1145] Deleting tablet fbcdd6d0f24d460493293693ea7c173c
0928 14:50:39.220331 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.220406 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179491}
I20260928 14:50:39.221324 9855 ts_tablet_manager.cc:1428] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260928 14:50:39.221642 9855 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.223307 9855 tablet_bootstrap.cc:654] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.223616 9392 tablet_service.cc:1467] Processing CreateTablet for tablet c37480fb31e842c5b4ce0a93104d23bf (DEFAULT_TABLE table=default.Table_49b35d3828044e0ea1384f19a5e183f9 [id=68b10484d1f5429ea81f52545a574535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.223711 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 948ad6c90d7146758788b5125a66d594 (DEFAULT_TABLE table=default.Table_ef0baa0c73054cefa825a46f9d497875 [id=1bbde8cd47814e21beade1cf5bc12627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.223805 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b (DEFAULT_TABLE table=default.Table_48e38a1afbb64c24911cd087a3bb9861 [id=6296e1263b3e42fab0a1efdaa997a880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.223938 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c37480fb31e842c5b4ce0a93104d23bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.224125 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.224156 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1a2300b63141a78561ba56c60f3306 (DEFAULT_TABLE table=default.Table_41d491fd6a8044a9a1dad70218781027 [id=4517445ce5ba4429918b46f9b617e131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.224452 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1a2300b63141a78561ba56c60f3306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.229489 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ad6c90d7146758788b5125a66d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.229727 9851 raft_consensus.cc:348] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.229914 9851 raft_consensus.cc:374] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.229969 9851 raft_consensus.cc:729] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.230765 9851 consensus_queue.cc:260] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:39.234340 9220 consensus_peers.cc:487] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:39.220809 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 837) took 1178 ms. Trace:
I20260928 14:50:39.234843 9851 ts_tablet_manager.cc:1428] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260928 14:50:39.235780 9813 rpcz_store.cc:276] 0928 14:50:38.042000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.050885 (+ 8885us) service_pool.cc:227] Handling call
0928 14:50:39.220715 (+1169830us) ts_tablet_manager.cc:1145] Deleting tablet 5c6d593318244002b103f29f10fd02b2
0928 14:50:39.220725 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.220796 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169670}
I20260928 14:50:39.240521 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 838) took 1189 ms. Trace:
I20260928 14:50:39.240653 9815 ts_tablet_manager.cc:1918] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.240729 9851 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.241559 9815 log.cc:1196] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:39.241920 9815 ts_tablet_manager.cc:1939] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.242056 9813 rpcz_store.cc:276] 0928 14:50:38.050873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.053814 (+ 2941us) service_pool.cc:227] Handling call
0928 14:50:39.240416 (+1186602us) ts_tablet_manager.cc:1145] Deleting tablet 60ede1d7f93047b08e043aa32213cd05
0928 14:50:39.240426 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.240505 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1186361}
I20260928 14:50:39.242359 9813 tablet_replica.cc:330] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.242537 9813 raft_consensus.cc:2229] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.242686 9813 raft_consensus.cc:2258] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.243196 9813 ts_tablet_manager.cc:1905] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.243603 9814 tablet_replica.cc:330] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.243801 9814 raft_consensus.cc:2229] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.243968 9814 raft_consensus.cc:2258] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.245750 9815 tablet_replica.cc:330] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.246011 9815 raft_consensus.cc:2229] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.248642 9815 raft_consensus.cc:2258] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.249187 9815 ts_tablet_manager.cc:1905] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.251699 10817 raft_consensus.cc:482] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.251844 10817 raft_consensus.cc:504] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.252441 10817 leader_election.cc:288] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.253357 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:39.253562 9567 raft_consensus.cc:2454] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:39.255385 9814 ts_tablet_manager.cc:1905] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.243345 9848 tablet_bootstrap.cc:492] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.244556 10950 tablet.cc:1722] T f1f9b6cbf2d949839216e807130b2eb9 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:39.254837 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.256529 9848 ts_tablet_manager.cc:1397] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260928 14:50:39.257237 9848 raft_consensus.cc:348] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.257504 9848 raft_consensus.cc:374] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.257727 9848 raft_consensus.cc:729] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.258088 9219 leader_election.cc:302] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
W20260928 14:50:39.258271 9220 leader_election.cc:341] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.258533 10817 raft_consensus.cc:2781] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:39.258617 10817 raft_consensus.cc:482] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:39.258685 10817 raft_consensus.cc:3037] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.258338 9848 consensus_queue.cc:260] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.259718 10920 raft_consensus.cc:482] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.259815 10920 raft_consensus.cc:504] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.260272 10920 leader_election.cc:288] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.261003 10817 raft_consensus.cc:504] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.261229 9848 ts_tablet_manager.cc:1428] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260928 14:50:39.262527 9360 leader_election.cc:341] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:39.262657 9848 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:39.262727 9360 leader_election.cc:341] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:39.262946 10817 leader_election.cc:288] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.262935 9360 leader_election.cc:302] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.263434 10920 raft_consensus.cc:2726] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.263855 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:39.264357 9220 leader_election.cc:341] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.264424 10895 raft_consensus.cc:482] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.264534 10895 raft_consensus.cc:504] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.265023 10895 leader_election.cc:288] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.265209 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:39.265357 9569 raft_consensus.cc:3037] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.265565 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:39.265842 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.266278 9498 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:39.266402 9497 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.266472 9497 leader_election.cc:302] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.266855 10891 raft_consensus.cc:2726] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.268568 9848 tablet_bootstrap.cc:654] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.256482 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed15033bf244ae08492dc561dc7469f (DEFAULT_TABLE table=default.Table_389431ce4ce849fe8d399bf876f296d3 [id=f3c39f08ca224bf5b73f7f7d2b5578e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.270541 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed15033bf244ae08492dc561dc7469f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.273765 9569 raft_consensus.cc:2454] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:39.274216 9219 leader_election.cc:302] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.274561 10817 raft_consensus.cc:2781] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:39.275063 10817 raft_consensus.cc:686] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:39.275367 10817 consensus_queue.cc:237] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.275614 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]) successfully deleted
I20260928 14:50:39.275818 9815 ts_tablet_manager.cc:1918] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:39.276012 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 53873us
I20260928 14:50:39.277560 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b (DEFAULT_TABLE table=default.Table_48e38a1afbb64c24911cd087a3bb9861 [id=6296e1263b3e42fab0a1efdaa997a880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.277921 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.256002 9851 tablet_bootstrap.cc:654] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.279031 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 948ad6c90d7146758788b5125a66d594 (DEFAULT_TABLE table=default.Table_ef0baa0c73054cefa825a46f9d497875 [id=1bbde8cd47814e21beade1cf5bc12627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.279336 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ad6c90d7146758788b5125a66d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.285576 9815 log.cc:1196] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/21ffc5bee62845519a4b7ee8c914e70d
I20260928 14:50:39.285871 9815 ts_tablet_manager.cc:1939] T 21ffc5bee62845519a4b7ee8c914e70d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.286010 9543 tablet_service.cc:1467] Processing CreateTablet for tablet c37480fb31e842c5b4ce0a93104d23bf (DEFAULT_TABLE table=default.Table_49b35d3828044e0ea1384f19a5e183f9 [id=68b10484d1f5429ea81f52545a574535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.286304 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c37480fb31e842c5b4ce0a93104d23bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.286415 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d806161b858145e1a4fa946587ae1529 (table default.Table_efdda1920fdd4a118b80b0f5485931b9 [id=dff3eb862aae4b499edec318643fd384]) successfully deleted
W20260928 14:50:39.287002 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 666de9dd64734708b35738605204ed7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666de9dd64734708b35738605204ed7d already in progress: creating tablet
W20260928 14:50:39.287338 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d6e0800aba3144c9979a09b959f5efc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6e0800aba3144c9979a09b959f5efc8 already in progress: creating tablet
W20260928 14:50:39.287671 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fbcdd6d0f24d460493293693ea7c173c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbcdd6d0f24d460493293693ea7c173c already in progress: creating tablet
W20260928 14:50:39.288337 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5c6d593318244002b103f29f10fd02b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c6d593318244002b103f29f10fd02b2 already in progress: creating tablet
W20260928 14:50:39.288687 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 60ede1d7f93047b08e043aa32213cd05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ede1d7f93047b08e043aa32213cd05 already in progress: creating tablet
I20260928 14:50:39.289337 9815 tablet_replica.cc:330] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.289535 9815 raft_consensus.cc:2229] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.289667 9815 raft_consensus.cc:2258] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.290362 9815 ts_tablet_manager.cc:1905] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.293799 9255 tablet_service.cc:1467] Processing CreateTablet for tablet c37480fb31e842c5b4ce0a93104d23bf (DEFAULT_TABLE table=default.Table_49b35d3828044e0ea1384f19a5e183f9 [id=68b10484d1f5429ea81f52545a574535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.294188 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c37480fb31e842c5b4ce0a93104d23bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.295349 9815 ts_tablet_manager.cc:1918] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.295435 9815 log.cc:1196] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:39.295672 9815 ts_tablet_manager.cc:1939] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.299952 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 948ad6c90d7146758788b5125a66d594 (DEFAULT_TABLE table=default.Table_ef0baa0c73054cefa825a46f9d497875 [id=1bbde8cd47814e21beade1cf5bc12627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.300333 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ad6c90d7146758788b5125a66d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.306259 9855 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.306377 9855 ts_tablet_manager.cc:1397] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.002s
I20260928 14:50:39.307009 9855 raft_consensus.cc:348] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.307214 9855 raft_consensus.cc:374] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.307265 9855 raft_consensus.cc:729] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.307439 9855 consensus_queue.cc:260] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.307907 9855 ts_tablet_manager.cc:1428] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:39.311493 9814 ts_tablet_manager.cc:1918] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.311604 9814 log.cc:1196] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/73bbcf31960d478087a0a91337c34ec8
I20260928 14:50:39.311920 9814 ts_tablet_manager.cc:1939] T 73bbcf31960d478087a0a91337c34ec8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.315651 9813 ts_tablet_manager.cc:1918] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.315778 9813 log.cc:1196] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d199c65d3b4040388360fd8302d7cb8c
I20260928 14:50:39.316063 9813 ts_tablet_manager.cc:1939] T d199c65d3b4040388360fd8302d7cb8c P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.316373 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 839) took 1232 ms. Trace:
I20260928 14:50:39.316469 9813 rpcz_store.cc:276] 0928 14:50:38.083535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.083671 (+ 136us) service_pool.cc:227] Handling call
0928 14:50:39.242321 (+1158650us) ts_tablet_manager.cc:1145] Deleting tablet d199c65d3b4040388360fd8302d7cb8c
0928 14:50:39.242331 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.286549 (+ 44218us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.315567 (+ 29018us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.316340 (+ 773us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158459}
I20260928 14:50:39.319129 10552 raft_consensus.cc:482] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.319271 10552 raft_consensus.cc:504] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.319851 10552 leader_election.cc:288] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.320711 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:39.320919 9569 raft_consensus.cc:2454] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:39.321285 9219 leader_election.cc:302] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:39.321561 10552 raft_consensus.cc:2781] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:39.321656 10552 raft_consensus.cc:482] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:39.321733 10552 raft_consensus.cc:3037] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.324199 10906 consensus_queue.cc:1035] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:39.326941 10552 raft_consensus.cc:504] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.327469 10552 leader_election.cc:288] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.328047 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:39.328214 9568 raft_consensus.cc:3037] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.328727 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1a2300b63141a78561ba56c60f3306 (DEFAULT_TABLE table=default.Table_41d491fd6a8044a9a1dad70218781027 [id=4517445ce5ba4429918b46f9b617e131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.329871 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1a2300b63141a78561ba56c60f3306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.330744 9568 raft_consensus.cc:2454] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:39.331271 9219 leader_election.cc:302] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:39.332270 9855 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.332298 10906 raft_consensus.cc:2781] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:39.333974 9855 tablet_bootstrap.cc:654] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.338652 9814 tablet_replica.cc:330] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.339406 9814 raft_consensus.cc:2229] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.339641 9814 raft_consensus.cc:2258] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.339926 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed15033bf244ae08492dc561dc7469f (DEFAULT_TABLE table=default.Table_389431ce4ce849fe8d399bf876f296d3 [id=f3c39f08ca224bf5b73f7f7d2b5578e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.340296 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed15033bf244ae08492dc561dc7469f (DEFAULT_TABLE table=default.Table_389431ce4ce849fe8d399bf876f296d3 [id=f3c39f08ca224bf5b73f7f7d2b5578e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.316803 9813 tablet_replica.cc:330] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.320401 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.340626 9813 raft_consensus.cc:2229] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.340665 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed15033bf244ae08492dc561dc7469f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.340633 10552 consensus_queue.cc:1035] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:39.327872 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:39.341733 9220 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.340792 9813 raft_consensus.cc:2258] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:39.342005 9220 leader_election.cc:341] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.342870 9813 ts_tablet_manager.cc:1905] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:39.343022 9220 consensus_peers.cc:487] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:39.348618 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1a2300b63141a78561ba56c60f3306 (DEFAULT_TABLE table=default.Table_41d491fd6a8044a9a1dad70218781027 [id=4517445ce5ba4429918b46f9b617e131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.349148 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1a2300b63141a78561ba56c60f3306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.353699 10895 raft_consensus.cc:482] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.353808 10895 raft_consensus.cc:504] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.354311 10895 leader_election.cc:288] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.354877 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:39.355587 9497 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.357848 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.358321 9498 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.358418 9498 leader_election.cc:302] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.358764 10895 raft_consensus.cc:2726] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.363112 9848 tablet_bootstrap.cc:492] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.363523 9848 ts_tablet_manager.cc:1397] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.004s
I20260928 14:50:39.365195 9848 raft_consensus.cc:348] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.365717 9848 raft_consensus.cc:374] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.365871 9848 raft_consensus.cc:729] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.372212 10920 raft_consensus.cc:482] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.372344 10920 raft_consensus.cc:504] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.372900 10920 leader_election.cc:288] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.373777 9360 leader_election.cc:341] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ba281355b2f44b77a4ff99d49c084162
W20260928 14:50:39.374002 9360 leader_election.cc:341] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:39.374125 9360 leader_election.cc:302] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.374532 10920 raft_consensus.cc:2726] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.375129 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 69f79321ee2446f1aadebaaa79cf7247
I20260928 14:50:39.375999 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 81ef55984cab462082310e195afbe516
I20260928 14:50:39.382712 9814 ts_tablet_manager.cc:1905] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.383216 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5eb84b168008483d9cd4ee38dca692f0" } modify_external_catalogs: true
I20260928 14:50:39.384069 10906 raft_consensus.cc:686] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:39.384424 10906 consensus_queue.cc:237] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.384768 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (table default.Table_6e3dd5704ce1494096b9810b983fc8a9 [id=49157f905fed4cf8936325e4fcb30ae3]) successfully deleted
I20260928 14:50:39.385150 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_17d6c76dc8614d8dae2cf9c971111123" } new_table_name: "default.Table_364b85cc352b4b39b203bfdf676c034b" modify_external_catalogs: true
I20260928 14:50:39.386998 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c40ddd4cd54e4d6c9edb0ce7be9102ed
I20260928 14:50:39.389093 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e7821da8ba304407a101c795da981432"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.390149 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7821da8ba304407a101c795da981432 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.391551 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6cf6f89a8c62417ea311d36488b8c771"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.392160 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cf6f89a8c62417ea311d36488b8c771 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.393067 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_189ff43beccd48af8e898b45130b3595" } new_table_name: "default.Table_8a8e9d4c48a54a77bbb629d2a35e4931" modify_external_catalogs: true
I20260928 14:50:39.394160 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_acbd19c6e20748d9bba6a875da87b863"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.394582 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acbd19c6e20748d9bba6a875da87b863 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.395437 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7d848fc8c0f34a48a42cc566d5863054"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.395864 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d848fc8c0f34a48a42cc566d5863054 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.396905 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5eb84b168008483d9cd4ee38dca692f0" } modify_external_catalogs: true
I20260928 14:50:39.398011 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 4729fc718bf540ecb501c2cac3966bb0 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:39.398612 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1e7414dbd8f84924b82024317a3b013c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.399299 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e7414dbd8f84924b82024317a3b013c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.403117 9851 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.403295 9851 ts_tablet_manager.cc:1397] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.164s user 0.005s sys 0.006s
I20260928 14:50:39.404037 9851 raft_consensus.cc:348] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.404361 9851 raft_consensus.cc:374] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.404466 9851 raft_consensus.cc:729] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.404704 9851 consensus_queue.cc:260] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.405435 9851 ts_tablet_manager.cc:1428] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:39.405771 9851 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.407564 9851 tablet_bootstrap.cc:654] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.412413 9813 ts_tablet_manager.cc:1918] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.412710 9813 log.cc:1196] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/4bea51859e0c4bc984288f94c2fcea2e
I20260928 14:50:39.413059 9813 ts_tablet_manager.cc:1939] T 4bea51859e0c4bc984288f94c2fcea2e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:39.420040 8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.61:41417, user_credentials={real_user=slave}} blocked reactor thread for 130757us
I20260928 14:50:39.420894 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d199c65d3b4040388360fd8302d7cb8c (table default.Table_84d5571edfa649fcb6d2b43b7c99f1e9 [id=40fba1f25abb416fbfe370c1a1d4ce5c]) successfully deleted
I20260928 14:50:39.423945 10906 raft_consensus.cc:482] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.424144 10906 raft_consensus.cc:504] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.425117 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:39.425318 9569 raft_consensus.cc:2454] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:39.425729 9219 leader_election.cc:302] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:39.425966 10817 raft_consensus.cc:2781] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:39.426039 10817 raft_consensus.cc:482] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:39.426110 10817 raft_consensus.cc:3037] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.426903 9855 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.427021 9855 ts_tablet_manager.cc:1397] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.002s
I20260928 14:50:39.427693 9855 raft_consensus.cc:348] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.427875 9855 raft_consensus.cc:374] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.427920 9855 raft_consensus.cc:729] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.428124 9855 consensus_queue.cc:260] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.423321 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.423820 9392 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ef55984cab462082310e195afbe516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.424120 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.424747 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet a19995a0d8af4d3ca562bade80ce006f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.428644 9855 ts_tablet_manager.cc:1428] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:39.428539 10817 raft_consensus.cc:504] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.428753 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 840) took 1309 ms. Trace:
I20260928 14:50:39.428906 9855 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.428841 9813 rpcz_store.cc:276] 0928 14:50:38.118883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.119087 (+ 204us) service_pool.cc:227] Handling call
0928 14:50:39.316732 (+1197645us) ts_tablet_manager.cc:1145] Deleting tablet 4bea51859e0c4bc984288f94c2fcea2e
0928 14:50:39.316742 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.394439 (+ 77697us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.412207 (+ 17768us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.428723 (+ 16516us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197445}
I20260928 14:50:39.429075 10817 leader_election.cc:288] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.429543 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:39.429819 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:39.429966 9569 raft_consensus.cc:3037] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:39.430058 9220 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.430681 9855 tablet_bootstrap.cc:654] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.432359 9569 raft_consensus.cc:2454] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:39.432837 9219 leader_election.cc:302] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.435598 10975 raft_consensus.cc:2781] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:39.435611 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 4bea51859e0c4bc984288f94c2fcea2e (table default.Table_90c26f1761434c4da4b1b562e70a7093 [id=58a1bf6d877846b884536413b601a0ab]) successfully deleted
I20260928 14:50:39.435798 10975 raft_consensus.cc:686] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:39.436043 10975 consensus_queue.cc:237] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.429273 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 846) took 1177 ms. Trace:
I20260928 14:50:39.437628 9813 rpcz_store.cc:276] 0928 14:50:38.252179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.252302 (+ 123us) service_pool.cc:227] Handling call
0928 14:50:39.429129 (+1176827us) ts_tablet_manager.cc:1145] Deleting tablet 5ae9c6ae0c9546e6baa12f13668969ea
0928 14:50:39.429140 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.429234 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176629}
I20260928 14:50:39.438001 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 849) took 1131 ms. Trace:
I20260928 14:50:39.438107 9813 rpcz_store.cc:276] 0928 14:50:38.306952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.309519 (+ 2567us) service_pool.cc:227] Handling call
0928 14:50:39.437879 (+1128360us) ts_tablet_manager.cc:1145] Deleting tablet 6f0f7aae759444d8aa4309b98fe7b496
0928 14:50:39.437890 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.437968 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1128088}
I20260928 14:50:39.438376 9813 tablet_replica.cc:330] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:39.438645 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5ae9c6ae0c9546e6baa12f13668969ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ae9c6ae0c9546e6baa12f13668969ea already in progress: creating tablet
W20260928 14:50:39.438880 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6f0f7aae759444d8aa4309b98fe7b496 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f0f7aae759444d8aa4309b98fe7b496 already in progress: creating tablet
I20260928 14:50:39.439427 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed15033bf244ae08492dc561dc7469f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.442540 9855 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.442651 9855 ts_tablet_manager.cc:1397] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260928 14:50:39.443053 9813 raft_consensus.cc:2229] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.443226 9813 raft_consensus.cc:2258] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.443276 9855 raft_consensus.cc:348] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.443441 9855 raft_consensus.cc:374] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.443480 9855 raft_consensus.cc:729] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.443717 9813 ts_tablet_manager.cc:1905] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.443914 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 21ffc5bee62845519a4b7ee8c914e70d (table default.Table_01fb8b545e2648849deb8c293b3b9cd6 [id=8aeb1610df884d82ac12f54569e7ed98]) successfully deleted
I20260928 14:50:39.443967 8955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_e9daf3dcd2ea41469f8e89a3f87ea208 [id=38a18331beae4386a199edd7e5491230] alter complete (version 3)
W20260928 14:50:39.444065 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 59042us
I20260928 14:50:39.444276 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
W20260928 14:50:39.444482 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4729fc718bf540ecb501c2cac3966bb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4729fc718bf540ecb501c2cac3966bb0 already in progress: creating tablet
I20260928 14:50:39.443920 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f24a84b5dc26497789fa19d09f9c30fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.445209 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f24a84b5dc26497789fa19d09f9c30fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.448514 9848 consensus_queue.cc:260] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.452301 9851 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.452438 9851 ts_tablet_manager.cc:1397] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.001s
I20260928 14:50:39.453277 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0893e8c25e0045b98734a8da11360638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.453707 10895 raft_consensus.cc:482] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.453819 10895 raft_consensus.cc:504] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.454332 10895 leader_election.cc:288] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.454985 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:39.455312 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.456756 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0893e8c25e0045b98734a8da11360638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:39.457653 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a0117aff69403e816ff37592db935f consensus state has no leader
W20260928 14:50:39.458118 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 540a929843d3466f8f2d3ba7b2f994ca consensus state has no leader
W20260928 14:50:39.458165 9498 leader_election.cc:341] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:39.458864 9497 leader_election.cc:341] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.458952 9497 leader_election.cc:302] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.459429 9851 raft_consensus.cc:348] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.459654 9851 raft_consensus.cc:374] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.459733 9851 raft_consensus.cc:729] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.460253 9851 consensus_queue.cc:260] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.462867 10920 raft_consensus.cc:482] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.463063 10920 raft_consensus.cc:504] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.463637 10920 leader_election.cc:288] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.464517 9360 leader_election.cc:341] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: c5c6b0867466459ca14413559800ff64
I20260928 14:50:39.465544 10895 raft_consensus.cc:2726] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:39.465938 9360 leader_election.cc:341] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c5c6b0867466459ca14413559800ff64
I20260928 14:50:39.466110 9360 leader_election.cc:302] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.466492 10920 raft_consensus.cc:2726] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:39.468024 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet dbf40dcd1f57425a85193a3fe4b039b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbf40dcd1f57425a85193a3fe4b039b6 already in progress: creating tablet
W20260928 14:50:39.468235 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0a5a14312acc4de39e72ac15cf74fcbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a5a14312acc4de39e72ac15cf74fcbf already in progress: creating tablet
I20260928 14:50:39.468611 9848 ts_tablet_manager.cc:1428] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.105s user 0.000s sys 0.002s
I20260928 14:50:39.470077 9848 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:39.469668 9855 consensus_queue.cc:260] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.471026 9855 ts_tablet_manager.cc:1428] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260928 14:50:39.471289 9855 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.472800 9855 tablet_bootstrap.cc:654] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.472896 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 73bbcf31960d478087a0a91337c34ec8 (table default.Table_7cbe9b800b63472f9c3edbe98510060c [id=40cbb3838eac45129f8df57636ce48dc]) successfully deleted
I20260928 14:50:39.474454 9848 tablet_bootstrap.cc:654] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.475503 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.477936 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ef55984cab462082310e195afbe516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.479334 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.479730 9814 ts_tablet_manager.cc:1918] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.479852 9814 log.cc:1196] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/75f9359df0ac466c912cd20fc6b94390
I20260928 14:50:39.484123 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d0ae614c249b453da761cdb9df68f62c" } new_table_name: "default.Table_b6f84ba3f2fb4b5fa8fdb6fea7c1d946" modify_external_catalogs: true
I20260928 14:50:39.486073 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_77feeb1f7cce4d099a5d4263cc2da2a4" } new_table_name: "default.Table_63d043f3946045ec9af5d6f61a0116cd" modify_external_catalogs: true
I20260928 14:50:39.487324 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dbc4720c6e574bb7a875e924f8c2524f" } new_table_name: "default.Table_bbc7f5f92c2447c1a6ba6df83536d05a" modify_external_catalogs: true
I20260928 14:50:39.488379 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_453f1cfe1974492aa15946bdaf2b3432" } modify_external_catalogs: true
I20260928 14:50:39.488600 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_453f1cfe1974492aa15946bdaf2b3432" } modify_external_catalogs: true
I20260928 14:50:39.485882 9851 ts_tablet_manager.cc:1428] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.033s user 0.002s sys 0.002s
I20260928 14:50:39.489979 9851 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.489888 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0ab04efebc02425ea04daf251cc46efe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.489992 9814 ts_tablet_manager.cc:1939] T 75f9359df0ac466c912cd20fc6b94390 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:39.490496 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ab04efebc02425ea04daf251cc46efe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.491634 9851 tablet_bootstrap.cc:654] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:39.486335 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 48551.5us
I20260928 14:50:39.493044 10552 raft_consensus.cc:482] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.493391 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 81ef55984cab462082310e195afbe516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.493270 10552 raft_consensus.cc:504] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.493762 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.494027 10552 leader_election.cc:288] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.494364 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.494969 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:39.495151 9220 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.495170 9567 raft_consensus.cc:2454] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:39.495883 9219 leader_election.cc:302] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.496309 10552 raft_consensus.cc:2781] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:39.496414 10552 raft_consensus.cc:482] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:39.496490 10552 raft_consensus.cc:3037] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.497088 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet c5c6b0867466459ca14413559800ff64 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:39.497435 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3f17eb03f5ed4cb581c29fc0d8619ff2
I20260928 14:50:39.499114 10552 raft_consensus.cc:504] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.499723 10552 leader_election.cc:288] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.500291 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:39.500470 9567 raft_consensus.cc:3037] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.500968 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.503474 9567 raft_consensus.cc:2454] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:39.503933 9219 leader_election.cc:302] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:39.505070 10552 raft_consensus.cc:2781] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:39.505295 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f79321ee2446f1aadebaaa79cf7247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.505270 10552 raft_consensus.cc:686] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:39.505743 10552 consensus_queue.cc:237] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.507404 9814 tablet_replica.cc:330] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.508285 9813 ts_tablet_manager.cc:1918] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.508473 9813 log.cc:1196] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/e89035a3d41a4af78a8e7afbdb89c7e0
I20260928 14:50:39.508751 10906 leader_election.cc:288] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.508844 9813 ts_tablet_manager.cc:1939] T e89035a3d41a4af78a8e7afbdb89c7e0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.509161 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 850) took 1182 ms. Trace:
I20260928 14:50:39.509254 9813 rpcz_store.cc:276] 0928 14:50:38.326846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.327814 (+ 968us) service_pool.cc:227] Handling call
0928 14:50:39.438316 (+1110502us) ts_tablet_manager.cc:1145] Deleting tablet e89035a3d41a4af78a8e7afbdb89c7e0
0928 14:50:39.438325 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.467862 (+ 29537us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.498522 (+ 30660us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.509131 (+ 10609us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1110271}
I20260928 14:50:39.509680 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 851) took 1170 ms. Trace:
I20260928 14:50:39.509864 9813 rpcz_store.cc:276] 0928 14:50:38.339217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.341297 (+ 2080us) service_pool.cc:227] Handling call
0928 14:50:39.509504 (+1168207us) ts_tablet_manager.cc:1145] Deleting tablet 6b35670ba2044b58a524847f77d4f822
0928 14:50:39.509514 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.509611 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167946}
I20260928 14:50:39.507745 9814 raft_consensus.cc:2229] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.510236 9813 tablet_replica.cc:330] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.510353 9814 raft_consensus.cc:2258] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.510514 9813 raft_consensus.cc:2229] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.510768 9813 raft_consensus.cc:2258] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.511264 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet e89035a3d41a4af78a8e7afbdb89c7e0 (table default.Table_81ca6df5fc2849cab83083e994d3627a [id=23a200906c414328a1fdd9624c105637]) successfully deleted
I20260928 14:50:39.511358 9813 ts_tablet_manager.cc:1905] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:39.511637 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6b35670ba2044b58a524847f77d4f822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b35670ba2044b58a524847f77d4f822 already in progress: creating tablet
I20260928 14:50:39.512102 9814 ts_tablet_manager.cc:1905] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.522025 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.522251 9815 tablet_replica.cc:330] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.522434 9815 raft_consensus.cc:2229] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.522557 9815 raft_consensus.cc:2258] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.523046 9815 ts_tablet_manager.cc:1905] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.530795 9815 ts_tablet_manager.cc:1918] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.530954 9815 log.cc:1196] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3f17eb03f5ed4cb581c29fc0d8619ff2
I20260928 14:50:39.531261 9815 ts_tablet_manager.cc:1939] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:39.534634 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 69f79321ee2446f1aadebaaa79cf7247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f79321ee2446f1aadebaaa79cf7247 already in progress: creating tablet
W20260928 14:50:39.534888 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 81ef55984cab462082310e195afbe516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81ef55984cab462082310e195afbe516 already in progress: creating tablet
W20260928 14:50:39.535099 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c40ddd4cd54e4d6c9edb0ce7be9102ed already in progress: creating tablet
I20260928 14:50:39.535300 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (table default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]) successfully deleted
I20260928 14:50:39.536520 9855 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.536629 9855 ts_tablet_manager.cc:1397] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.012s
I20260928 14:50:39.537302 9855 raft_consensus.cc:348] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.537484 9855 raft_consensus.cc:374] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.537569 9855 raft_consensus.cc:729] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.539048 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:39.541033 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_10fc9af0b33143b39db7a62e6be6a0c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.541249 9855 consensus_queue.cc:260] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:39.541663 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10fc9af0b33143b39db7a62e6be6a0c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.542302 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.542498 9815 tablet_replica.cc:330] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.543061 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.543566 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.543720 10920 raft_consensus.cc:482] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.543861 9815 raft_consensus.cc:2229] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.543839 10920 raft_consensus.cc:504] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.543975 9815 raft_consensus.cc:2258] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.544373 9855 ts_tablet_manager.cc:1428] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:39.544366 10920 leader_election.cc:288] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.544623 9855 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.546051 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b695c68118b49359f1899d30208b1b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b3abf8936d34eaba6d60245727738dc) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.544672 9815 ts_tablet_manager.cc:1905] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.545130 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.546514 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.545790 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:39.548640 9360 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1738a95895914cc4936a38e1d189d538
W20260928 14:50:39.548918 9360 leader_election.cc:341] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 1738a95895914cc4936a38e1d189d538
I20260928 14:50:39.549162 9360 leader_election.cc:302] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.549574 10920 raft_consensus.cc:2726] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.550128 9813 ts_tablet_manager.cc:1918] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:39.550241 9813 log.cc:1196] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/94ac5cd43c05479f8516fdc0c30cbf22
I20260928 14:50:39.550613 9813 ts_tablet_manager.cc:1939] T 94ac5cd43c05479f8516fdc0c30cbf22 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.550930 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 852) took 1151 ms. Trace:
I20260928 14:50:39.551029 9813 rpcz_store.cc:276] 0928 14:50:38.399574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.399883 (+ 309us) service_pool.cc:227] Handling call
0928 14:50:39.510103 (+1110220us) ts_tablet_manager.cc:1145] Deleting tablet 94ac5cd43c05479f8516fdc0c30cbf22
0928 14:50:39.510114 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.536522 (+ 26408us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.550031 (+ 13509us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.550898 (+ 867us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1109947}
I20260928 14:50:39.551553 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 94ac5cd43c05479f8516fdc0c30cbf22 (table default.Table_964ad582e5a24995b2497d7f1d90068d [id=8068756e5cb44215af3614c6e7a9a357]) successfully deleted
I20260928 14:50:39.552095 9815 ts_tablet_manager.cc:1918] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.552213 9815 log.cc:1196] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:39.552502 9815 ts_tablet_manager.cc:1939] T d96492abf8cf459a992dd1d7b0226b57 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.553437 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d96492abf8cf459a992dd1d7b0226b57 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:39.555228 9848 tablet_bootstrap.cc:492] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.555663 9855 tablet_bootstrap.cc:654] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.556419 9848 ts_tablet_manager.cc:1397] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.086s user 0.000s sys 0.003s
I20260928 14:50:39.560896 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.561197 9848 raft_consensus.cc:348] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.562247 9848 raft_consensus.cc:374] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.562489 9848 raft_consensus.cc:729] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.563175 9815 tablet_replica.cc:330] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.563375 9815 raft_consensus.cc:2229] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.563513 9815 raft_consensus.cc:2258] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.564564 9855 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.564675 9855 ts_tablet_manager.cc:1397] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260928 14:50:39.564822 9815 ts_tablet_manager.cc:1905] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:39.569218 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 76a0117aff69403e816ff37592db935f (table default.Table_8a8e9d4c48a54a77bbb629d2a35e4931 [id=282988394f5c48779b485b8b67505cf9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 76a0117aff69403e816ff37592db935f consensus state has no leader
W20260928 14:50:39.569878 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fd5bf5648c546ac9145328ff3e8b198 consensus state has no leader
I20260928 14:50:39.565398 9855 raft_consensus.cc:348] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.571154 9855 raft_consensus.cc:374] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.571225 9855 raft_consensus.cc:729] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.571409 9855 consensus_queue.cc:260] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.571954 9855 ts_tablet_manager.cc:1428] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260928 14:50:39.572223 9855 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.572814 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 75f9359df0ac466c912cd20fc6b94390 (table default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]) successfully deleted
I20260928 14:50:39.574525 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:39.575677 9855 tablet_bootstrap.cc:654] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.566315 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:39.572666 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b9dad76ac94a03811e4793e0234aad" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.576076 9848 consensus_queue.cc:260] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.573518 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 853) took 1162 ms. Trace:
I20260928 14:50:39.576658 9813 rpcz_store.cc:276] 0928 14:50:38.409677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.411539 (+ 1862us) service_pool.cc:227] Handling call
0928 14:50:39.572109 (+1160570us) ts_tablet_manager.cc:1145] Deleting tablet cb1d541610014e408bc0bb7bcb7954bf
0928 14:50:39.572119 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.572207 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1160366}
I20260928 14:50:39.577915 9813 tablet_replica.cc:330] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.578207 9813 raft_consensus.cc:2229] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:39.578933 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cb1d541610014e408bc0bb7bcb7954bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb1d541610014e408bc0bb7bcb7954bf already in progress: creating tablet
I20260928 14:50:39.582547 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ee844aa3c24336b4acb66dc43186e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.585628 9813 raft_consensus.cc:2258] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.586217 9813 ts_tablet_manager.cc:1905] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.586679 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:39.591001 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ff870b182fd4cf49895fddbe2cdcf0a consensus state has no leader
I20260928 14:50:39.591713 9848 ts_tablet_manager.cc:1428] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260928 14:50:39.594568 10920 raft_consensus.cc:482] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.594738 10920 raft_consensus.cc:504] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.595273 10920 leader_election.cc:288] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.595538 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:39.598156 9360 leader_election.cc:341] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: cbd9f9cb48a945d19420a8bdb9bb9576
I20260928 14:50:39.598651 9848 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:39.599299 9360 leader_election.cc:341] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cbd9f9cb48a945d19420a8bdb9bb9576
I20260928 14:50:39.599596 9360 leader_election.cc:302] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.599951 10920 raft_consensus.cc:2726] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:39.606945 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 080159d2e65a4550861f4c63fb22d02e consensus state has no leader
I20260928 14:50:39.607342 9815 ts_tablet_manager.cc:1918] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.607918 9815 log.cc:1196] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9cb3cc5b42524a4399d0bcf21c851fd8
I20260928 14:50:39.608325 9815 ts_tablet_manager.cc:1939] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.609465 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (table default.Table_27c8c6bf92104baba58d5f721c298c16 [id=44b6b5a0e8a4438c97dd07f6c86ffef6]) successfully deleted
I20260928 14:50:39.614037 9848 tablet_bootstrap.cc:654] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.614506 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9050b87026a2453688df6d403fa18d08
I20260928 14:50:39.615442 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 9050b87026a2453688df6d403fa18d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.616653 10895 raft_consensus.cc:482] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.616775 10895 raft_consensus.cc:504] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.617312 10895 leader_election.cc:288] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.618057 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaacc1f839914859b23ae755042e02d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.618642 9498 leader_election.cc:341] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.620880 9815 tablet_replica.cc:330] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.621469 9815 raft_consensus.cc:2229] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.622161 9815 raft_consensus.cc:2258] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.623296 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 9050b87026a2453688df6d403fa18d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.623396 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d267fa0a698437986feb52cd9c15cc1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:39.624383 9815 ts_tablet_manager.cc:1905] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.626092 9813 ts_tablet_manager.cc:1918] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.629444 9813 log.cc:1196] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9a753aaf7f8c4498b6ba35fa27d8c537
I20260928 14:50:39.632004 9813 ts_tablet_manager.cc:1939] T 9a753aaf7f8c4498b6ba35fa27d8c537 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.630313 9848 tablet_bootstrap.cc:492] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.632711 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 854) took 1197 ms. Trace:
I20260928 14:50:39.638038 9813 rpcz_store.cc:276] 0928 14:50:38.434917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.435409 (+ 492us) service_pool.cc:227] Handling call
0928 14:50:39.577773 (+1142364us) ts_tablet_manager.cc:1145] Deleting tablet 9a753aaf7f8c4498b6ba35fa27d8c537
0928 14:50:39.577782 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.595817 (+ 18035us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.625988 (+ 30171us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.632679 (+ 6691us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1142125}
I20260928 14:50:39.638662 9813 tablet_replica.cc:330] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.638801 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9a753aaf7f8c4498b6ba35fa27d8c537 (table default.Table_783c475fe2dc470c85133e418a70741a [id=98f3af61cb704c68b1ceedc3e14ecbbe]) successfully deleted
I20260928 14:50:39.639324 9813 raft_consensus.cc:2229] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.639554 9813 raft_consensus.cc:2258] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.640105 9813 ts_tablet_manager.cc:1905] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.632925 9848 ts_tablet_manager.cc:1397] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.001s
I20260928 14:50:39.641909 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaacc1f839914859b23ae755042e02d8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:39.642204 9848 raft_consensus.cc:348] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:39.642282 9220 leader_election.cc:341] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.642483 9848 raft_consensus.cc:374] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.642640 9848 raft_consensus.cc:729] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:39.642953 9497 leader_election.cc:341] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.643042 9497 leader_election.cc:302] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.642928 9848 consensus_queue.cc:260] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.643517 10895 raft_consensus.cc:2726] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.643695 9848 ts_tablet_manager.cc:1428] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:39.644966 9855 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.645200 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8a7f6a0a32614b6f8f509a6bfa83c331 (DEFAULT_TABLE table=default.Table_400b69c56f5541d59fea79fb9d9ffd91 [id=ed09e24d622e4a9d9a9323db8eb2a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.645653 9855 ts_tablet_manager.cc:1397] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.014s
I20260928 14:50:39.646652 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 8a7f6a0a32614b6f8f509a6bfa83c331 (DEFAULT_TABLE table=default.Table_400b69c56f5541d59fea79fb9d9ffd91 [id=ed09e24d622e4a9d9a9323db8eb2a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.646840 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 1195380515774c9f9e004d10db9d6907 (DEFAULT_TABLE table=default.Table_02540a2b82a6425d9b6a7d04ce13df5e [id=426657409d494c91baba529947ea446a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.646981 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a7f6a0a32614b6f8f509a6bfa83c331. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.647251 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 49584.3us
W20260928 14:50:39.647506 9220 leader_election.cc:341] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.647734 9404 tablet_service.cc:1467] Processing CreateTablet for tablet 6f73568a67cb401388beaa266a0324fc (DEFAULT_TABLE table=default.Table_fd8492b512fc4972890e5b661b979542 [id=54b0d33fa7c64724afb2f3cdca8b0e87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.648085 9855 raft_consensus.cc:348] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.648219 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9050b87026a2453688df6d403fa18d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.648270 9855 raft_consensus.cc:374] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.648321 9855 raft_consensus.cc:729] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.648607 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 8a7f6a0a32614b6f8f509a6bfa83c331 (DEFAULT_TABLE table=default.Table_400b69c56f5541d59fea79fb9d9ffd91 [id=ed09e24d622e4a9d9a9323db8eb2a6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.648958 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a7f6a0a32614b6f8f509a6bfa83c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.649001 9855 consensus_queue.cc:260] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.652340 9392 tablet_service.cc:1467] Processing CreateTablet for tablet df88856c3e884d779628ab9ca5b2589d (DEFAULT_TABLE table=default.Table_352c130d9bb84d8984fd0573e0d78b7a [id=c94ce8f0303c48b1934ced63ec7f61e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.652643 9388 tablet_service.cc:1467] Processing CreateTablet for tablet f012865a2bf84e0f8454c1eaa9e9a529 (DEFAULT_TABLE table=default.Table_81ba99afeafb41d4be70bdcc7b135e1f [id=48089611e6f0416c8a9d5fb9c75d7053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.652643 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1317707bc6427080e37ef098e11c9a (DEFAULT_TABLE table=default.Table_836c57f02277490ab989a2438b10304c [id=3ec936c45d1048d99fa9f802dfd84ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.653843 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0dc1a1900846bca0041da5bb918acd (DEFAULT_TABLE table=default.Table_7993fc05acd649b492783050564153ac [id=4a95041dcafe44cf915ebe7b5da47554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.654886 10920 raft_consensus.cc:482] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.655007 10920 raft_consensus.cc:504] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.655512 10920 leader_election.cc:288] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.656292 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1d934435241529be3b4300ef4aa58 (DEFAULT_TABLE table=default.Table_cf0711f56e724fedba65fee2b61378d2 [id=10beff82b0e94e23b4815d3dc56eff86]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:39.656659 9360 leader_election.cc:341] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: a19995a0d8af4d3ca562bade80ce006f
W20260928 14:50:39.657951 9360 leader_election.cc:341] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: a19995a0d8af4d3ca562bade80ce006f
I20260928 14:50:39.658063 9360 leader_election.cc:302] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.658166 9855 ts_tablet_manager.cc:1428] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260928 14:50:39.658504 10920 raft_consensus.cc:2726] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.658959 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 1195380515774c9f9e004d10db9d6907 (DEFAULT_TABLE table=default.Table_02540a2b82a6425d9b6a7d04ce13df5e [id=426657409d494c91baba529947ea446a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.659386 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1195380515774c9f9e004d10db9d6907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.662681 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 4eca68f459834ce2983a27c21361eef3 (DEFAULT_TABLE table=default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf [id=cab9fafe49d3445d83b91c75b1ec39a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.663117 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 1195380515774c9f9e004d10db9d6907 (DEFAULT_TABLE table=default.Table_02540a2b82a6425d9b6a7d04ce13df5e [id=426657409d494c91baba529947ea446a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.663534 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1195380515774c9f9e004d10db9d6907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.663553 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 227e203bdf454f7289d2c8cccb9da63f (DEFAULT_TABLE table=default.Table_bfa126b466444d33ab6b35eb4b09680b [id=90e87b9b625645f696a03cefb33a3fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.663930 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf714191e8f4835aa8414bd902833a9 (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.664060 9814 ts_tablet_manager.cc:1918] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.664155 9814 log.cc:1196] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/21ffc5bee62845519a4b7ee8c914e70d
I20260928 14:50:39.664266 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 4cfab1937b3e48ef895dd12cbaa914cc (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.664470 9814 ts_tablet_manager.cc:1939] T 21ffc5bee62845519a4b7ee8c914e70d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.664989 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 32e609be5acd42b48b6b7423cd56401a (DEFAULT_TABLE table=default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.665719 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 89431db9b37d4d13a25cb736f67129bd (DEFAULT_TABLE table=default.Table_072f1034d9cd45109148c223b46617a5 [id=a460044d964a45408b19de05e3aee03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.666508 9389 tablet_service.cc:1467] Processing CreateTablet for tablet b1b6d93a18d84c6890e3bb5a0be1926f (DEFAULT_TABLE table=default.Table_c602ad029b2647f381a367e5bac39fc7 [id=ecd3016c3e90491396d4bd91e3f68711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.667750 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 401b718f24e842f28d40a6d232d865b5 (DEFAULT_TABLE table=default.Table_f09fdf67c68c48d299fe22d83c67b4ba [id=a048bf3012ea4c7185c65fd3a584275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.667768 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6f73568a67cb401388beaa266a0324fc (DEFAULT_TABLE table=default.Table_fd8492b512fc4972890e5b661b979542 [id=54b0d33fa7c64724afb2f3cdca8b0e87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.668114 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f73568a67cb401388beaa266a0324fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.668136 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 6f73568a67cb401388beaa266a0324fc (DEFAULT_TABLE table=default.Table_fd8492b512fc4972890e5b661b979542 [id=54b0d33fa7c64724afb2f3cdca8b0e87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.668295 9263 tablet_service.cc:1467] Processing CreateTablet for tablet df88856c3e884d779628ab9ca5b2589d (DEFAULT_TABLE table=default.Table_352c130d9bb84d8984fd0573e0d78b7a [id=c94ce8f0303c48b1934ced63ec7f61e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.668449 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f73568a67cb401388beaa266a0324fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.668586 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df88856c3e884d779628ab9ca5b2589d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.671720 9393 tablet_service.cc:1467] Processing CreateTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 (DEFAULT_TABLE table=default.Table_a08023e8b16d4821a87ecf11c0a4f562 [id=4b359fee5bf94eaea60b237a51a5913a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.672407 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 (DEFAULT_TABLE table=default.Table_4f4696110aa04b4d98a90d7acf435e4d [id=ed4d70406f1943eebb32a0ce11147c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.673007 9403 tablet_service.cc:1467] Processing CreateTablet for tablet afab196535584fc0a953c28bb56bf511 (DEFAULT_TABLE table=default.Table_57e0f72948c241daa7c51ddedecbc5e3 [id=83297eea169e48e39d566cb16e57343f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.673550 9391 tablet_service.cc:1467] Processing CreateTablet for tablet b975f08ef6aa465ea14f00cf7a5c3b86 (DEFAULT_TABLE table=default.Table_ca849c59018c4806bcded6e030c16848 [id=d5bdc538880047348c00879c9f9c2a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.674252 9529 tablet_service.cc:1467] Processing CreateTablet for tablet df88856c3e884d779628ab9ca5b2589d (DEFAULT_TABLE table=default.Table_352c130d9bb84d8984fd0573e0d78b7a [id=c94ce8f0303c48b1934ced63ec7f61e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.674556 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df88856c3e884d779628ab9ca5b2589d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.677454 9855 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.678812 8948 catalog_manager.cc:5495] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:39.679386 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:39.679653 8948 catalog_manager.cc:5495] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:39.680068 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:39.680346 8948 catalog_manager.cc:5495] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:39.681789 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1317707bc6427080e37ef098e11c9a (DEFAULT_TABLE table=default.Table_836c57f02277490ab989a2438b10304c [id=3ec936c45d1048d99fa9f802dfd84ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.682192 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0dc1a1900846bca0041da5bb918acd (DEFAULT_TABLE table=default.Table_7993fc05acd649b492783050564153ac [id=4a95041dcafe44cf915ebe7b5da47554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.682336 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 21ffc5bee62845519a4b7ee8c914e70d (table default.Table_01fb8b545e2648849deb8c293b3b9cd6 [id=8aeb1610df884d82ac12f54569e7ed98]) successfully deleted
W20260928 14:50:39.682796 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4729fc718bf540ecb501c2cac3966bb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4729fc718bf540ecb501c2cac3966bb0 already in progress: creating tablet
I20260928 14:50:39.682839 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1317707bc6427080e37ef098e11c9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.683045 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 81ef55984cab462082310e195afbe516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81ef55984cab462082310e195afbe516 already in progress: creating tablet
W20260928 14:50:39.683333 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c40ddd4cd54e4d6c9edb0ce7be9102ed already in progress: creating tablet
W20260928 14:50:39.683661 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 69f79321ee2446f1aadebaaa79cf7247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f79321ee2446f1aadebaaa79cf7247 already in progress: creating tablet
W20260928 14:50:39.683950 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 already in progress: creating tablet
W20260928 14:50:39.684173 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9050b87026a2453688df6d403fa18d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9050b87026a2453688df6d403fa18d08 already in progress: creating tablet
I20260928 14:50:39.684342 9543 tablet_service.cc:1467] Processing CreateTablet for tablet f012865a2bf84e0f8454c1eaa9e9a529 (DEFAULT_TABLE table=default.Table_81ba99afeafb41d4be70bdcc7b135e1f [id=48089611e6f0416c8a9d5fb9c75d7053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.684865 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0dc1a1900846bca0041da5bb918acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.685034 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f012865a2bf84e0f8454c1eaa9e9a529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.685099 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1d934435241529be3b4300ef4aa58 (DEFAULT_TABLE table=default.Table_cf0711f56e724fedba65fee2b61378d2 [id=10beff82b0e94e23b4815d3dc56eff86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.685390 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1d934435241529be3b4300ef4aa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.691864 9855 tablet_bootstrap.cc:654] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.691890 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 9d0dc1a1900846bca0041da5bb918acd (DEFAULT_TABLE table=default.Table_7993fc05acd649b492783050564153ac [id=4a95041dcafe44cf915ebe7b5da47554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.692309 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0dc1a1900846bca0041da5bb918acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.694578 9851 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:39.694712 9851 ts_tablet_manager.cc:1397] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.205s user 0.013s sys 0.010s
I20260928 14:50:39.695231 8948 catalog_manager.cc:5495] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:39.695423 9851 raft_consensus.cc:348] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.695644 9851 raft_consensus.cc:374] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.695638 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:39.695712 9851 raft_consensus.cc:729] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.695902 9851 consensus_queue.cc:260] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.696396 9851 ts_tablet_manager.cc:1428] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:39.697753 10920 raft_consensus.cc:482] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.697911 10920 raft_consensus.cc:504] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.698479 10920 leader_election.cc:288] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.700465 9360 leader_election.cc:341] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: cf9342e920ae48278ab3f3c6d639fc94
W20260928 14:50:39.701004 9360 leader_election.cc:341] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cf9342e920ae48278ab3f3c6d639fc94
I20260928 14:50:39.701133 9360 leader_election.cc:302] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.701510 10920 raft_consensus.cc:2726] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.701949 9263 tablet_service.cc:1467] Processing CreateTablet for tablet f012865a2bf84e0f8454c1eaa9e9a529 (DEFAULT_TABLE table=default.Table_81ba99afeafb41d4be70bdcc7b135e1f [id=48089611e6f0416c8a9d5fb9c75d7053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.702503 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f012865a2bf84e0f8454c1eaa9e9a529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.704149 9851 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:39.705413 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5127a4bb7e114ec09235c9e29f614156 (table default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2]). Expected version 1 got 0
I20260928 14:50:39.706223 9848 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:39.707834 9851 tablet_bootstrap.cc:654] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.708630 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1195380515774c9f9e004d10db9d6907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.709765 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f73568a67cb401388beaa266a0324fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.710878 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 48f1d934435241529be3b4300ef4aa58 (DEFAULT_TABLE table=default.Table_cf0711f56e724fedba65fee2b61378d2 [id=10beff82b0e94e23b4815d3dc56eff86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.711620 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1317707bc6427080e37ef098e11c9a (DEFAULT_TABLE table=default.Table_836c57f02277490ab989a2438b10304c [id=3ec936c45d1048d99fa9f802dfd84ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.711930 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1317707bc6427080e37ef098e11c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.713798 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df88856c3e884d779628ab9ca5b2589d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.714047 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a7f6a0a32614b6f8f509a6bfa83c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.714812 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1317707bc6427080e37ef098e11c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.719549 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 324a4c2340c9408c8aba7bab99bbe99c (DEFAULT_TABLE table=default.Table_d05d8d79537247a1a6ef77e4e00859d5 [id=cbce2b9d6b6b498ea8cc931fe74da493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.720481 9848 tablet_bootstrap.cc:654] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.724684 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 227e203bdf454f7289d2c8cccb9da63f (DEFAULT_TABLE table=default.Table_bfa126b466444d33ab6b35eb4b09680b [id=90e87b9b625645f696a03cefb33a3fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.724997 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227e203bdf454f7289d2c8cccb9da63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.725274 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 4eca68f459834ce2983a27c21361eef3 (DEFAULT_TABLE table=default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf [id=cab9fafe49d3445d83b91c75b1ec39a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.725577 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eca68f459834ce2983a27c21361eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.730391 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 324a4c2340c9408c8aba7bab99bbe99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.732126 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 4cfab1937b3e48ef895dd12cbaa914cc (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.732183 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 32e609be5acd42b48b6b7423cd56401a (DEFAULT_TABLE table=default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.732445 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e609be5acd42b48b6b7423cd56401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.732781 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 89431db9b37d4d13a25cb736f67129bd (DEFAULT_TABLE table=default.Table_072f1034d9cd45109148c223b46617a5 [id=a460044d964a45408b19de05e3aee03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.733088 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89431db9b37d4d13a25cb736f67129bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.733611 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cfab1937b3e48ef895dd12cbaa914cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.734163 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf714191e8f4835aa8414bd902833a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.734733 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b80a390d7747e0b98e5bc6073fcdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.735297 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6ff1371ac546718b42d2ebc78d5ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.735874 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227e203bdf454f7289d2c8cccb9da63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.736380 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eca68f459834ce2983a27c21361eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.736855 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b6d93a18d84c6890e3bb5a0be1926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.737278 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e609be5acd42b48b6b7423cd56401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.737732 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89431db9b37d4d13a25cb736f67129bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.738169 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afab196535584fc0a953c28bb56bf511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.738385 10920 raft_consensus.cc:482] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.738509 10920 raft_consensus.cc:504] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.738626 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401b718f24e842f28d40a6d232d865b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.739046 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1d934435241529be3b4300ef4aa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.739128 10920 leader_election.cc:288] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:39.739452 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d0dc1a1900846bca0041da5bb918acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.739883 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f012865a2bf84e0f8454c1eaa9e9a529. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.739984 9360 leader_election.cc:341] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5b695c68118b49359f1899d30208b1b7
I20260928 14:50:39.740965 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b975f08ef6aa465ea14f00cf7a5c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.741791 9543 tablet_service.cc:1467] Processing CreateTablet for tablet b1b6d93a18d84c6890e3bb5a0be1926f (DEFAULT_TABLE table=default.Table_c602ad029b2647f381a367e5bac39fc7 [id=ecd3016c3e90491396d4bd91e3f68711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.742116 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b6d93a18d84c6890e3bb5a0be1926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.742780 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cfab1937b3e48ef895dd12cbaa914cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.746285 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 401b718f24e842f28d40a6d232d865b5 (DEFAULT_TABLE table=default.Table_f09fdf67c68c48d299fe22d83c67b4ba [id=a048bf3012ea4c7185c65fd3a584275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.746577 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401b718f24e842f28d40a6d232d865b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.752328 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf714191e8f4835aa8414bd902833a9 (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.752609 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf714191e8f4835aa8414bd902833a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.758426 9541 tablet_service.cc:1467] Processing CreateTablet for tablet b975f08ef6aa465ea14f00cf7a5c3b86 (DEFAULT_TABLE table=default.Table_ca849c59018c4806bcded6e030c16848 [id=d5bdc538880047348c00879c9f9c2a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.758709 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b975f08ef6aa465ea14f00cf7a5c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.762959 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5bf714191e8f4835aa8414bd902833a9 (DEFAULT_TABLE table=default.Table_d63bb9bf79f8478a94283ff271bade64 [id=d2b883b9317248b393eacdac123f4b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.763502 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 4cfab1937b3e48ef895dd12cbaa914cc (DEFAULT_TABLE table=default.Table_3bfbefb06f584af6a1c10690384a4e85 [id=34ee7a3a735a4a4899fabe93141f3f72]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:39.763787 9360 leader_election.cc:341] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 5b695c68118b49359f1899d30208b1b7
I20260928 14:50:39.763908 9360 leader_election.cc:302] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.764246 10920 raft_consensus.cc:2726] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.766520 9855 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:39.766700 9855 ts_tablet_manager.cc:1397] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.000s
I20260928 14:50:39.768550 9855 raft_consensus.cc:348] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.768801 9855 raft_consensus.cc:374] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.768904 9855 raft_consensus.cc:729] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.769155 9855 consensus_queue.cc:260] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.770666 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9b3cdddf432a4e949f2bf5a224730779" } modify_external_catalogs: true
I20260928 14:50:39.770902 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9b3cdddf432a4e949f2bf5a224730779" } modify_external_catalogs: true
I20260928 14:50:39.771453 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_acbd19c6e20748d9bba6a875da87b863" } modify_external_catalogs: true
I20260928 14:50:39.771622 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_acbd19c6e20748d9bba6a875da87b863" } modify_external_catalogs: true
I20260928 14:50:39.772061 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_47b964b20f4d4594b7cd7dac3a47388d" } modify_external_catalogs: true
I20260928 14:50:39.772233 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_47b964b20f4d4594b7cd7dac3a47388d" } modify_external_catalogs: true
I20260928 14:50:39.772743 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d315c68077734c4cb748f734ece08e9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.773265 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d315c68077734c4cb748f734ece08e9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.774120 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 (DEFAULT_TABLE table=default.Table_4f4696110aa04b4d98a90d7acf435e4d [id=ed4d70406f1943eebb32a0ce11147c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.774362 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f09fdf67c68c48d299fe22d83c67b4ba" } new_table_name: "default.Table_38c7c3087fe7474aa2d31c47bc84f0dd" modify_external_catalogs: true
I20260928 14:50:39.775764 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7dbee54af11845d4b4ecf8bd3fe1e953" } new_table_name: "default.Table_501091711363421190e5322913ccb3c8" modify_external_catalogs: true
I20260928 14:50:39.776173 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6ff1371ac546718b42d2ebc78d5ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.776901 9855 ts_tablet_manager.cc:1428] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260928 14:50:39.776829 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b9bc46525f874a939ce9829dedf7c86a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.777324 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9bc46525f874a939ce9829dedf7c86a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.778347 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_63f658dac2234f93b9ee38a7810c78ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.778748 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63f658dac2234f93b9ee38a7810c78ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.779732 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dd63720b8d7f42b98b0b3fc813207cf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.780143 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd63720b8d7f42b98b0b3fc813207cf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.790619 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6f24b3db09904135afe42a211b0442d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.791054 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f24b3db09904135afe42a211b0442d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.791024 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 89431db9b37d4d13a25cb736f67129bd (DEFAULT_TABLE table=default.Table_072f1034d9cd45109148c223b46617a5 [id=a460044d964a45408b19de05e3aee03f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:39.796542 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d604978c5289471a854c9b286d137f61 consensus state has no leader
W20260928 14:50:39.797894 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 401b718f24e842f28d40a6d232d865b5 consensus state has no leader
W20260928 14:50:39.805038 9360 consensus_peers.cc:487] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 -> Peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Couldn't send request to peer 9b4626c584ad47ffaf346e81daff846b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 727cb249723946578bc5bb086d6e6c40. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:39.805747 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 32e609be5acd42b48b6b7423cd56401a (DEFAULT_TABLE table=default.Table_c057e8b0272b426d8f23b17bc9c484b5 [id=c8772673692a4ab59c47f4fc1e817bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.805882 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 4eca68f459834ce2983a27c21361eef3 (DEFAULT_TABLE table=default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf [id=cab9fafe49d3445d83b91c75b1ec39a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.808686 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 227e203bdf454f7289d2c8cccb9da63f (DEFAULT_TABLE table=default.Table_bfa126b466444d33ab6b35eb4b09680b [id=90e87b9b625645f696a03cefb33a3fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.809468 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f1d934435241529be3b4300ef4aa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.812184 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 (DEFAULT_TABLE table=default.Table_4f4696110aa04b4d98a90d7acf435e4d [id=ed4d70406f1943eebb32a0ce11147c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.812219 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 401b718f24e842f28d40a6d232d865b5 (DEFAULT_TABLE table=default.Table_f09fdf67c68c48d299fe22d83c67b4ba [id=a048bf3012ea4c7185c65fd3a584275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.812538 9253 tablet_service.cc:1467] Processing CreateTablet for tablet b975f08ef6aa465ea14f00cf7a5c3b86 (DEFAULT_TABLE table=default.Table_ca849c59018c4806bcded6e030c16848 [id=d5bdc538880047348c00879c9f9c2a2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.813797 9252 tablet_service.cc:1467] Processing CreateTablet for tablet b1b6d93a18d84c6890e3bb5a0be1926f (DEFAULT_TABLE table=default.Table_c602ad029b2647f381a367e5bac39fc7 [id=ecd3016c3e90491396d4bd91e3f68711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.814296 9247 tablet_service.cc:1514] Processing DeleteTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.814358 9264 tablet_service.cc:1467] Processing CreateTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 (DEFAULT_TABLE table=default.Table_a08023e8b16d4821a87ecf11c0a4f562 [id=4b359fee5bf94eaea60b237a51a5913a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.814467 10975 raft_consensus.cc:482] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.814590 10975 raft_consensus.cc:504] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.814690 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 324a4c2340c9408c8aba7bab99bbe99c (DEFAULT_TABLE table=default.Table_d05d8d79537247a1a6ef77e4e00859d5 [id=cbce2b9d6b6b498ea8cc931fe74da493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.815114 10975 leader_election.cc:288] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.815800 9265 tablet_service.cc:1467] Processing CreateTablet for tablet afab196535584fc0a953c28bb56bf511 (DEFAULT_TABLE table=default.Table_57e0f72948c241daa7c51ddedecbc5e3 [id=83297eea169e48e39d566cb16e57343f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.816830 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bf714191e8f4835aa8414bd902833a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.816967 10973 raft_consensus.cc:482] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.816936 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.817440 9814 tablet_replica.cc:330] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.818892 9814 raft_consensus.cc:2229] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.818933 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.819031 9266 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:39.819201 9220 leader_election.cc:341] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.819667 9814 raft_consensus.cc:2258] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.820226 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32e609be5acd42b48b6b7423cd56401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.820616 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eca68f459834ce2983a27c21361eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.820505 10975 raft_consensus.cc:482] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.829213 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e (DEFAULT_TABLE table=default.Table_0ab04efebc02425ea04daf251cc46efe [id=82d84828c7d1409f8de41a90b65ba915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.777171 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.820996 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6ff1371ac546718b42d2ebc78d5ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.838605 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cfab1937b3e48ef895dd12cbaa914cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.838826 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 324a4c2340c9408c8aba7bab99bbe99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.839233 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afab196535584fc0a953c28bb56bf511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.841676 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89431db9b37d4d13a25cb736f67129bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.841873 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401b718f24e842f28d40a6d232d865b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.844599 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b80a390d7747e0b98e5bc6073fcdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.845721 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227e203bdf454f7289d2c8cccb9da63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.853785 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b975f08ef6aa465ea14f00cf7a5c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.821048 10975 raft_consensus.cc:504] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.855443 9855 tablet_bootstrap.cc:492] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:39.855820 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be232889594147bdbe2d4825c3e8c7d0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.856194 10920 raft_consensus.cc:482] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.856372 10920 raft_consensus.cc:504] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.856971 10920 leader_election.cc:288] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.858245 9219 leader_election.cc:341] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: be232889594147bdbe2d4825c3e8c7d0
W20260928 14:50:39.858639 9360 leader_election.cc:341] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:39.709475 9815 ts_tablet_manager.cc:1918] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.805438 10895 raft_consensus.cc:482] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.858636 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a08023e8b16d4821a87ecf11c0a4f562" } modify_external_catalogs: true
I20260928 14:50:39.858878 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a08023e8b16d4821a87ecf11c0a4f562" } modify_external_catalogs: true
I20260928 14:50:39.858822 10895 raft_consensus.cc:504] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.859458 10895 leader_election.cc:288] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.859531 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b6d93a18d84c6890e3bb5a0be1926f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.859532 9360 leader_election.cc:341] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:39.859665 9360 leader_election.cc:302] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.815653 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:39.859899 9568 raft_consensus.cc:2454] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:39.860029 10920 raft_consensus.cc:2726] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:39.860388 9220 leader_election.cc:341] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.860412 9219 leader_election.cc:302] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.860559 9220 leader_election.cc:302] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.860530 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_20bbbdb72afa4d21bac0c7114e28b3a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.860908 10552 raft_consensus.cc:2781] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:39.861052 10552 raft_consensus.cc:482] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:39.861176 10552 raft_consensus.cc:3037] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:39.861217 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b9f78ecb674ae691d407615680ca56" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.821098 9814 ts_tablet_manager.cc:1905] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:39.861711 9498 leader_election.cc:341] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.824703 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e (DEFAULT_TABLE table=default.Table_0ab04efebc02425ea04daf251cc46efe [id=82d84828c7d1409f8de41a90b65ba915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.862200 9848 tablet_bootstrap.cc:492] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:39.862385 9848 ts_tablet_manager.cc:1397] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.156s user 0.001s sys 0.001s
W20260928 14:50:39.862380 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20bbbdb72afa4d21bac0c7114e28b3a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.863040 9848 raft_consensus.cc:348] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.863303 9848 raft_consensus.cc:374] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:39.863423 9848 raft_consensus.cc:729] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:39.863637 9815 log.cc:1196] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/148e81f8add349f2b233862a7049e54c
I20260928 14:50:39.864506 9402 tablet_service.cc:1467] Processing CreateTablet for tablet e33ecd8df52d4355b187142ff61f24ef (DEFAULT_TABLE table=default.Table_e7821da8ba304407a101c795da981432 [id=5f481f1a07264321a0609fe21b13cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.865773 9396 tablet_service.cc:1467] Processing CreateTablet for tablet c6f09bae9c9a40c9a94823a92706a65d (DEFAULT_TABLE table=default.Table_f24a84b5dc26497789fa19d09f9c30fd [id=2063b7d702654b4896dda7dff94920b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.866448 9403 tablet_service.cc:1467] Processing CreateTablet for tablet d44619c4c46f46c897a2ab5bc63b817a (DEFAULT_TABLE table=default.Table_acbd19c6e20748d9bba6a875da87b863 [id=7277de329dd44ff4ac41709de44bd210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.866664 9388 tablet_service.cc:1467] Processing CreateTablet for tablet a18f885aa1b546cc85564fc8b70e85dd (DEFAULT_TABLE table=default.Table_10fc9af0b33143b39db7a62e6be6a0c4 [id=5d90693b4a964a57995d9bbd7fa3106c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.866933 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cf758f80364047e68998c94adca18aa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.867189 10920 raft_consensus.cc:482] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.867302 10920 raft_consensus.cc:504] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.867797 10920 leader_election.cc:288] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:39.867973 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf758f80364047e68998c94adca18aa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:39.868920 9360 leader_election.cc:341] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: f1dacb0eef514609bcaf503ccc9845e3
W20260928 14:50:39.869244 9360 leader_election.cc:341] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f1dacb0eef514609bcaf503ccc9845e3
I20260928 14:50:39.869342 9360 leader_election.cc:302] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:39.869577 10982 raft_consensus.cc:2726] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.869660 10920 raft_consensus.cc:2726] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.869855 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.870404 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd69130e0d34defbdce5edc925f7277 (DEFAULT_TABLE table=default.Table_9e9af23f6e3c4796b91d32916ea5ea6c [id=bc5a43cfac104d18a78ed9ef9ef38742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.870806 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 487eb1b259584d5e9ea8545ffab3144e (DEFAULT_TABLE table=default.Table_1e7414dbd8f84924b82024317a3b013c [id=751cad55761c44a2bf44458373945edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.871416 9815 ts_tablet_manager.cc:1939] T 148e81f8add349f2b233862a7049e54c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.871721 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:39.873150 9814 ts_tablet_manager.cc:1918] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.873234 9814 log.cc:1196] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:39.873654 9855 tablet_bootstrap.cc:654] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:39.875837 9400 tablet_service.cc:1467] Processing CreateTablet for tablet e2016863fa344d1f9efa602eb00816ba (DEFAULT_TABLE table=default.Table_7d848fc8c0f34a48a42cc566d5863054 [id=2684a62ce0f7489eaaa25d1290692a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.876531 10975 leader_election.cc:288] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.876614 9393 tablet_service.cc:1467] Processing CreateTablet for tablet e2bc64faf42b4f41b6f3134891f76fe3 (DEFAULT_TABLE table=default.Table_6cf6f89a8c62417ea311d36488b8c771 [id=fedebbd46b9a4619a1ae33ce782088fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.877079 9406 tablet_service.cc:1467] Processing CreateTablet for tablet ecc3cc0f6f6844508f9c06d649dd39c7 (DEFAULT_TABLE table=default.Table_0893e8c25e0045b98734a8da11360638 [id=7af886901e7c40358151799091e7046d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.878890 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d97a34797d9045f6ad58c57b453ed7a0" } new_table_name: "default.Table_3f7ee04cf1f44625a52bf577f216c98b" modify_external_catalogs: true
I20260928 14:50:39.880887 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fd673ea8aa19429c98194c13ed814ae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:39.883054 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd69130e0d34defbdce5edc925f7277 (DEFAULT_TABLE table=default.Table_9e9af23f6e3c4796b91d32916ea5ea6c [id=bc5a43cfac104d18a78ed9ef9ef38742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.883384 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd69130e0d34defbdce5edc925f7277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.874191 9815 tablet_replica.cc:330] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.884370 9536 tablet_service.cc:1467] Processing CreateTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 (DEFAULT_TABLE table=default.Table_a08023e8b16d4821a87ecf11c0a4f562 [id=4b359fee5bf94eaea60b237a51a5913a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.884881 9814 ts_tablet_manager.cc:1939] T d30d06c910fa4142a6248e8bfd00f4b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:39.882565 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd673ea8aa19429c98194c13ed814ae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.885634 9814 tablet_replica.cc:330] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.885805 9814 raft_consensus.cc:2229] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.885921 9814 raft_consensus.cc:2258] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.886364 9814 ts_tablet_manager.cc:1905] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.886777 9815 raft_consensus.cc:2229] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.886940 9815 raft_consensus.cc:2258] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.887399 9848 consensus_queue.cc:260] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.887866 10895 raft_consensus.cc:482] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:39.887980 10895 raft_consensus.cc:504] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:39.888526 10895 leader_election.cc:288] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.889171 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c54cb0e8f2347d9b139c8766fb61ab1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:39.889848 9498 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.890468 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2016863fa344d1f9efa602eb00816ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.891007 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2bc64faf42b4f41b6f3134891f76fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.891546 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc3cc0f6f6844508f9c06d649dd39c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.891919 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6f09bae9c9a40c9a94823a92706a65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.892278 9256 tablet_service.cc:1467] Processing CreateTablet for tablet e2bc64faf42b4f41b6f3134891f76fe3 (DEFAULT_TABLE table=default.Table_6cf6f89a8c62417ea311d36488b8c771 [id=fedebbd46b9a4619a1ae33ce782088fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.892597 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18f885aa1b546cc85564fc8b70e85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.892637 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2bc64faf42b4f41b6f3134891f76fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.892956 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d30d06c910fa4142a6248e8bfd00f4b2 (table default.Table_4e86b9df2c224f9083cc99ffe56ecbb4 [id=720e4385ef6d42cbbaa26b3fc3cb5521]) successfully deleted
I20260928 14:50:39.820772 10973 raft_consensus.cc:504] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:39.893450 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd69130e0d34defbdce5edc925f7277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.893711 9264 tablet_service.cc:1467] Processing CreateTablet for tablet c6f09bae9c9a40c9a94823a92706a65d (DEFAULT_TABLE table=default.Table_f24a84b5dc26497789fa19d09f9c30fd [id=2063b7d702654b4896dda7dff94920b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.894518 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0489aea8bb0a45daaaec6a48db756c51" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:39.894650 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6f09bae9c9a40c9a94823a92706a65d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.895035 9220 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:39.894519 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.894325 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 487eb1b259584d5e9ea8545ffab3144e (DEFAULT_TABLE table=default.Table_1e7414dbd8f84924b82024317a3b013c [id=751cad55761c44a2bf44458373945edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.901160 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_05d04a6e96fe450993476e530099d223" } new_table_name: "default.Table_c59d183a70bf44e8807921cc8ad2c6a4" modify_external_catalogs: true
I20260928 14:50:39.902413 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b80a390d7747e0b98e5bc6073fcdb2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:39.902905 9219 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:39.903010 9219 leader_election.cc:302] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:39.903753 9813 ts_tablet_manager.cc:1918] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.903888 9813 log.cc:1196] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ca7fa45e25b0455e92412b844cd78cdc
I20260928 14:50:39.904217 9813 ts_tablet_manager.cc:1939] T ca7fa45e25b0455e92412b844cd78cdc P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:39.904513 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487eb1b259584d5e9ea8545ffab3144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.906894 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 16ee19746a004a8d95a573e84f2e06b0
I20260928 14:50:39.907194 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44619c4c46f46c897a2ab5bc63b817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.907523 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_409ae5199a3841c4bac091a68a5b864e" } modify_external_catalogs: true
I20260928 14:50:39.907697 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_409ae5199a3841c4bac091a68a5b864e" } modify_external_catalogs: true
I20260928 14:50:39.908005 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.908847 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1e06b733c67341df93fe16a24397130c
I20260928 14:50:39.909441 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_13a7f2b04d9d4dccb7424df6a2e7bd3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.909979 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13a7f2b04d9d4dccb7424df6a2e7bd3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.911269 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d44619c4c46f46c897a2ab5bc63b817a
I20260928 14:50:39.912050 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0fe6bfafc8ad4f7c88f1954f4cf79b51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:39.912619 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fe6bfafc8ad4f7c88f1954f4cf79b51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:39.913132 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.913750 9251 tablet_service.cc:1467] Processing CreateTablet for tablet a18f885aa1b546cc85564fc8b70e85dd (DEFAULT_TABLE table=default.Table_10fc9af0b33143b39db7a62e6be6a0c4 [id=5d90693b4a964a57995d9bbd7fa3106c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.914103 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18f885aa1b546cc85564fc8b70e85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.906865 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_47b65a11c8a840138ed5b134b3444f11" } new_table_name: "default.Table_cb70ad9b55b44b53913e9843c9bfd3ca" modify_external_catalogs: true
I20260928 14:50:39.918699 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487eb1b259584d5e9ea8545ffab3144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.921152 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a2b80a390d7747e0b98e5bc6073fcdb2
I20260928 14:50:39.923785 9255 tablet_service.cc:1467] Processing CreateTablet for tablet e33ecd8df52d4355b187142ff61f24ef (DEFAULT_TABLE table=default.Table_e7821da8ba304407a101c795da981432 [id=5f481f1a07264321a0609fe21b13cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.894086 10973 leader_election.cc:288] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:39.924142 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33ecd8df52d4355b187142ff61f24ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.924227 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet d44619c4c46f46c897a2ab5bc63b817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.926509 10975 raft_consensus.cc:2726] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:39.926681 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e06b733c67341df93fe16a24397130c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.926980 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:39.930778 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b14339044619424c9be020fa99ad681e consensus state has no leader
I20260928 14:50:39.931741 9249 tablet_service.cc:1467] Processing CreateTablet for tablet d44619c4c46f46c897a2ab5bc63b817a (DEFAULT_TABLE table=default.Table_acbd19c6e20748d9bba6a875da87b863 [id=7277de329dd44ff4ac41709de44bd210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.932106 9262 tablet_service.cc:1467] Processing CreateTablet for tablet e2016863fa344d1f9efa602eb00816ba (DEFAULT_TABLE table=default.Table_7d848fc8c0f34a48a42cc566d5863054 [id=2684a62ce0f7489eaaa25d1290692a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.932430 9261 tablet_service.cc:1467] Processing CreateTablet for tablet ecc3cc0f6f6844508f9c06d649dd39c7 (DEFAULT_TABLE table=default.Table_0893e8c25e0045b98734a8da11360638 [id=7af886901e7c40358151799091e7046d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.935331 9814 ts_tablet_manager.cc:1918] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.935436 9814 log.cc:1196] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/be232889594147bdbe2d4825c3e8c7d0
I20260928 14:50:39.935722 9814 ts_tablet_manager.cc:1939] T be232889594147bdbe2d4825c3e8c7d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:39.938063 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet d44619c4c46f46c897a2ab5bc63b817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.938647 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.942950 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e06b733c67341df93fe16a24397130c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.944792 9815 ts_tablet_manager.cc:1905] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.945698 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44619c4c46f46c897a2ab5bc63b817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.945858 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33ecd8df52d4355b187142ff61f24ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.948374 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2016863fa344d1f9efa602eb00816ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.948591 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc3cc0f6f6844508f9c06d649dd39c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.952324 9815 ts_tablet_manager.cc:1918] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:39.952431 9815 log.cc:1196] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/42b9f78ecb674ae691d407615680ca56
I20260928 14:50:39.952692 9815 ts_tablet_manager.cc:1939] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:39.953169 9815 tablet_replica.cc:330] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:39.953359 9815 raft_consensus.cc:2229] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.957993 9814 tablet_replica.cc:330] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:39.958170 9814 raft_consensus.cc:2229] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.958288 9814 raft_consensus.cc:2258] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.960289 9848 ts_tablet_manager.cc:1428] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.098s user 0.001s sys 0.001s
I20260928 14:50:39.960625 9848 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:39.965250 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 206b8b256a484760b4e8d97e5ef12ce9 consensus state has no leader
I20260928 14:50:39.965289 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet be232889594147bdbe2d4825c3e8c7d0 (table default.Table_7bb67fe09d1544418318121e5efde0a0 [id=fa7396482f54455193f716a38798ca0f]) successfully deleted
I20260928 14:50:39.953500 9815 raft_consensus.cc:2258] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.974324 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 855) took 1515 ms. Trace:
I20260928 14:50:39.974434 9813 rpcz_store.cc:276] 0928 14:50:38.459099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.460535 (+ 1436us) service_pool.cc:227] Handling call
0928 14:50:39.638487 (+1177952us) ts_tablet_manager.cc:1145] Deleting tablet ca7fa45e25b0455e92412b844cd78cdc
0928 14:50:39.638498 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.797122 (+158624us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.890375 (+ 93253us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:39.974281 (+ 83906us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177737}
I20260928 14:50:39.974865 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 856) took 1502 ms. Trace:
I20260928 14:50:39.974972 9813 rpcz_store.cc:276] 0928 14:50:38.472250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.474939 (+ 2689us) service_pool.cc:227] Handling call
0928 14:50:39.974727 (+1499788us) ts_tablet_manager.cc:1145] Deleting tablet 6b8211c873b2414c94798169f73502c2
0928 14:50:39.974737 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.974824 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499549}
I20260928 14:50:39.975244 9813 tablet_replica.cc:330] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:39.975437 9813 raft_consensus.cc:2229] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:39.975595 9813 raft_consensus.cc:2258] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:39.976085 9813 ts_tablet_manager.cc:1905] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.976637 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 06e4b76705874f7185939d2f4e4d1df2
I20260928 14:50:39.977193 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:39.980818 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ca7fa45e25b0455e92412b844cd78cdc (table default.Table_6179576a67a644d9bf10f0a9fb84cf49 [id=6525db978f8141f88a1c7e04b8dbe21c]) successfully deleted
I20260928 14:50:39.981065 9815 ts_tablet_manager.cc:1905] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:39.982450 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.986950 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e16a0f674114ac8b4520fbce2d383d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 58a91c01ee3c422694e08505ce64e501) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:39.987757 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 324a4c2340c9408c8aba7bab99bbe99c (DEFAULT_TABLE table=default.Table_d05d8d79537247a1a6ef77e4e00859d5 [id=cbce2b9d6b6b498ea8cc931fe74da493]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:39.988626 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf94be2def6043cb8d0d39da62dd7c11 consensus state has no leader
I20260928 14:50:39.989964 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e (DEFAULT_TABLE table=default.Table_0ab04efebc02425ea04daf251cc46efe [id=82d84828c7d1409f8de41a90b65ba915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.990429 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd69130e0d34defbdce5edc925f7277 (DEFAULT_TABLE table=default.Table_9e9af23f6e3c4796b91d32916ea5ea6c [id=bc5a43cfac104d18a78ed9ef9ef38742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.990715 9529 tablet_service.cc:1467] Processing CreateTablet for tablet d44619c4c46f46c897a2ab5bc63b817a (DEFAULT_TABLE table=default.Table_acbd19c6e20748d9bba6a875da87b863 [id=7277de329dd44ff4ac41709de44bd210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.991003 9545 tablet_service.cc:1467] Processing CreateTablet for tablet e2016863fa344d1f9efa602eb00816ba (DEFAULT_TABLE table=default.Table_7d848fc8c0f34a48a42cc566d5863054 [id=2684a62ce0f7489eaaa25d1290692a58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.991138 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet a2b80a390d7747e0b98e5bc6073fcdb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.991204 9543 tablet_service.cc:1467] Processing CreateTablet for tablet c6f09bae9c9a40c9a94823a92706a65d (DEFAULT_TABLE table=default.Table_f24a84b5dc26497789fa19d09f9c30fd [id=2063b7d702654b4896dda7dff94920b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.990429 9541 tablet_service.cc:1467] Processing CreateTablet for tablet e33ecd8df52d4355b187142ff61f24ef (DEFAULT_TABLE table=default.Table_e7821da8ba304407a101c795da981432 [id=5f481f1a07264321a0609fe21b13cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.991442 9531 tablet_service.cc:1467] Processing CreateTablet for tablet e2bc64faf42b4f41b6f3134891f76fe3 (DEFAULT_TABLE table=default.Table_6cf6f89a8c62417ea311d36488b8c771 [id=fedebbd46b9a4619a1ae33ce782088fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.991560 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e4b76705874f7185939d2f4e4d1df2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.991577 9538 tablet_service.cc:1467] Processing CreateTablet for tablet a18f885aa1b546cc85564fc8b70e85dd (DEFAULT_TABLE table=default.Table_10fc9af0b33143b39db7a62e6be6a0c4 [id=5d90693b4a964a57995d9bbd7fa3106c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.991907 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ee19746a004a8d95a573e84f2e06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.992034 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 487eb1b259584d5e9ea8545ffab3144e (DEFAULT_TABLE table=default.Table_1e7414dbd8f84924b82024317a3b013c [id=751cad55761c44a2bf44458373945edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.992231 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e06b733c67341df93fe16a24397130c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.992408 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet d44619c4c46f46c897a2ab5bc63b817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:39.991210 9549 tablet_service.cc:1467] Processing CreateTablet for tablet ecc3cc0f6f6844508f9c06d649dd39c7 (DEFAULT_TABLE table=default.Table_0893e8c25e0045b98734a8da11360638 [id=7af886901e7c40358151799091e7046d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:39.992959 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 148e81f8add349f2b233862a7049e54c (table default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]) successfully deleted
I20260928 14:50:39.993691 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2bc64faf42b4f41b6f3134891f76fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.993861 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18f885aa1b546cc85564fc8b70e85dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.994009 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2016863fa344d1f9efa602eb00816ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.994266 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 324a4c2340c9408c8aba7bab99bbe99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.997623 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487eb1b259584d5e9ea8545ffab3144e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:39.998476 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0fe6bfafc8ad4f7c88f1954f4cf79b51" } new_table_name: "default.Table_6667c748d3ab46df824edf775ab65c38" modify_external_catalogs: true
I20260928 14:50:40.001049 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c057e8b0272b426d8f23b17bc9c484b5" } new_table_name: "default.Table_34ed3510a4a04fe386d546ba1bdf33af" modify_external_catalogs: true
I20260928 14:50:40.001331 9855 tablet_bootstrap.cc:492] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.001441 9855 ts_tablet_manager.cc:1397] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.146s user 0.002s sys 0.002s
I20260928 14:50:40.002126 9855 raft_consensus.cc:348] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.002311 9855 raft_consensus.cc:374] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.002372 9855 raft_consensus.cc:729] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.002569 9855 consensus_queue.cc:260] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.002719 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2d13650c95104f90a749ad7de60fc641"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:40.003115 9855 ts_tablet_manager.cc:1428] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260928 14:50:40.003180 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d13650c95104f90a749ad7de60fc641 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.003938 9848 tablet_bootstrap.cc:654] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.004570 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cda034a8dee64de597915af61ba85f2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.005025 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cda034a8dee64de597915af61ba85f2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.006027 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cb533e3a6e8f4101a37aa4ff6a0eaabb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.006446 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb533e3a6e8f4101a37aa4ff6a0eaabb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.007666 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 6d2bd32270694ec2af95c7bf5b906b1b from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:40.008358 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 42b9f78ecb674ae691d407615680ca56 (table default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]) successfully deleted
I20260928 14:50:40.009589 9428 raft_consensus.cc:3037] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.011399 11003 tablet.cc:1722] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:40.005411 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c54cb0e8f2347d9b139c8766fb61ab1" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.019784 10895 raft_consensus.cc:482] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.019914 10895 raft_consensus.cc:504] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.020485 10895 leader_election.cc:288] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.021042 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.021576 9498 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.023572 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b9f78ecb674ae691d407615680ca56" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.032604 9814 ts_tablet_manager.cc:1905] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.036391 9851 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.038501 9851 ts_tablet_manager.cc:1397] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.336s user 0.006s sys 0.014s
I20260928 14:50:40.041673 10895 raft_consensus.cc:482] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.041813 10895 raft_consensus.cc:504] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.042326 10895 leader_election.cc:288] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.040786 9536 tablet_service.cc:1467] Processing CreateTablet for tablet afab196535584fc0a953c28bb56bf511 (DEFAULT_TABLE table=default.Table_57e0f72948c241daa7c51ddedecbc5e3 [id=83297eea169e48e39d566cb16e57343f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.044735 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.045217 9498 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.046021 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.047111 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.047591 10895 raft_consensus.cc:482] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.047709 10895 raft_consensus.cc:504] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.048256 10895 leader_election.cc:288] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.048851 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf76b53ded84392a39c73d7e653615d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.048935 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6ce760698f14e12bc671edce34c0877 has no consensus state
W20260928 14:50:40.049307 9498 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.055657 9813 ts_tablet_manager.cc:1918] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.055943 9813 log.cc:1196] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/69e3c8ef3e20451dbf91b671655974e5
I20260928 14:50:40.056572 9813 ts_tablet_manager.cc:1939] T 69e3c8ef3e20451dbf91b671655974e5 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.061909 11006 tablet.cc:1722] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.063126 10816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260928 14:50:40.064553 9855 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:40.065150 10816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 14:50:40.065390 10816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 14:50:40.067014 11004 tablet.cc:1722] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.068598 9497 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.068873 9497 leader_election.cc:302] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.069635 10895 raft_consensus.cc:2726] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:40.070073 9497 leader_election.cc:341] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.070302 9497 leader_election.cc:302] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:40.070519 9497 raft_consensus.cc:2670] T 42b9f78ecb674ae691d407615680ca56 P 658e483a10314e8d93c2f6e9084f2a91: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:40.071125 9497 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.071298 9497 leader_election.cc:302] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.071565 10895 raft_consensus.cc:2726] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:40.071956 9497 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.072110 9497 leader_election.cc:302] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.072366 10895 raft_consensus.cc:2726] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.073119 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf76b53ded84392a39c73d7e653615d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.074132 10895 raft_consensus.cc:482] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.074249 10895 raft_consensus.cc:504] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.074724 10895 leader_election.cc:288] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.075359 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.076112 9498 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.076625 9851 raft_consensus.cc:348] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.077191 9851 raft_consensus.cc:374] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.077350 9851 raft_consensus.cc:729] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.077979 9851 consensus_queue.cc:260] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:40.086365 10816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 14:50:40.086625 10816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260928 14:50:40.085783 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 861) took 1489 ms. Trace:
W20260928 14:50:40.086787 10816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 14:50:40.087001 10816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 14:50:40.092818 9497 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.093272 9497 leader_election.cc:302] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.093856 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.097448 10895 raft_consensus.cc:2726] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:40.097860 9497 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.098160 9497 leader_election.cc:302] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.098469 10895 raft_consensus.cc:2726] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.099427 11018 tablet.cc:1722] T cdadb919c4554e5c89f8bb19cf3ddd75 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.102633 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32e609be5acd42b48b6b7423cd56401a consensus state has no leader
I20260928 14:50:40.107908 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_51baee36c72949b68d19be1ecd7bcb4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.108608 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51baee36c72949b68d19be1ecd7bcb4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.110117 11017 tablet.cc:1722] T cdadb919c4554e5c89f8bb19cf3ddd75 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:40.114264 10552 raft_consensus.cc:504] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.117048 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b6f84ba3f2fb4b5fa8fdb6fea7c1d946" } modify_external_catalogs: true
I20260928 14:50:40.117280 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b6f84ba3f2fb4b5fa8fdb6fea7c1d946" } modify_external_catalogs: true
I20260928 14:50:40.117486 9814 ts_tablet_manager.cc:1918] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.118283 9814 log.cc:1196] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:40.119087 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cb52782bde064ae2b1ea4ca8d30db871" } modify_external_catalogs: true
I20260928 14:50:40.119287 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cb52782bde064ae2b1ea4ca8d30db871" } modify_external_catalogs: true
I20260928 14:50:40.120220 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f23435e718764568affacdb5f1a5fa0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.120839 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f23435e718764568affacdb5f1a5fa0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.121990 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:40.122244 9567 raft_consensus.cc:3037] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.122609 9814 ts_tablet_manager.cc:1939] T 0489aea8bb0a45daaaec6a48db756c51 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:40.124337 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5127a4bb7e114ec09235c9e29f614156" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:40.125330 9848 tablet_bootstrap.cc:492] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.125452 9848 ts_tablet_manager.cc:1397] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.165s user 0.007s sys 0.002s
W20260928 14:50:40.124859 9220 leader_election.cc:341] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.125797 10552 leader_election.cc:288] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.127393 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d4428f89dc584ff1b0b45384b781c7ff" } modify_external_catalogs: true
I20260928 14:50:40.127554 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d4428f89dc584ff1b0b45384b781c7ff" } modify_external_catalogs: true
I20260928 14:50:40.126155 9848 raft_consensus.cc:348] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.128019 9848 raft_consensus.cc:374] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.128072 9848 raft_consensus.cc:729] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.128286 9848 consensus_queue.cc:260] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.131284 9848 ts_tablet_manager.cc:1428] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:40.131654 9848 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.133181 9848 tablet_bootstrap.cc:654] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.137459 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 0489aea8bb0a45daaaec6a48db756c51 (table default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]) successfully deleted
I20260928 14:50:40.139767 9567 raft_consensus.cc:2454] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:40.140213 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 16ee19746a004a8d95a573e84f2e06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ee19746a004a8d95a573e84f2e06b0 already in progress: creating tablet
I20260928 14:50:40.140556 9219 leader_election.cc:302] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.140842 10552 raft_consensus.cc:2781] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:40.141130 10552 raft_consensus.cc:686] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:40.142278 10552 consensus_queue.cc:237] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.142314 9851 ts_tablet_manager.cc:1428] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.102s user 0.002s sys 0.001s
I20260928 14:50:40.144182 11019 tablet.cc:1722] T cdadb919c4554e5c89f8bb19cf3ddd75 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.145251 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d44619c4c46f46c897a2ab5bc63b817a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44619c4c46f46c897a2ab5bc63b817a already in progress: creating tablet
I20260928 14:50:40.145823 9848 tablet_bootstrap.cc:492] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.145946 9848 ts_tablet_manager.cc:1397] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s
I20260928 14:50:40.146601 9848 raft_consensus.cc:348] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.146790 9848 raft_consensus.cc:374] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.146837 9848 raft_consensus.cc:729] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.147002 9848 consensus_queue.cc:260] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.147519 9848 ts_tablet_manager.cc:1428] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:40.150401 9851 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.152195 10816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.181.20:39469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.181.62:43149,127.8.181.61:41417,127.8.181.60:39777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.181.61:41417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.181.61
--webserver_port=36355
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 28 Sep 2026 14:00:13 UTC on ccycloud.quasar-sekvba.root.comops.site
build id 4677370
ASAN enabled
I20260928 14:50:40.153645 9851 tablet_bootstrap.cc:654] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.153916 10816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260928 14:50:40.154013 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1e06b733c67341df93fe16a24397130c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e06b733c67341df93fe16a24397130c already in progress: creating tablet
I20260928 14:50:40.154282 9848 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:40.154918 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a2b80a390d7747e0b98e5bc6073fcdb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b80a390d7747e0b98e5bc6073fcdb2 already in progress: creating tablet
I20260928 14:50:40.155618 9848 tablet_bootstrap.cc:654] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:40.156039 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 06e4b76705874f7185939d2f4e4d1df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e4b76705874f7185939d2f4e4d1df2 already in progress: creating tablet
I20260928 14:50:40.161046 10906 consensus_queue.cc:1035] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:40.164054 10816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 14:50:40.171356 9422 raft_consensus.cc:3037] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:40.176651 9220 consensus_peers.cc:487] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:40.178351 11018 tablet.cc:1722] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:40.188216 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ecb662da254a4311ae02dbe6dc348eb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.188875 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecb662da254a4311ae02dbe6dc348eb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.190987 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9213f41bf2e34deab11343f45fd4f5c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.191676 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9213f41bf2e34deab11343f45fd4f5c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.192533 9848 tablet_bootstrap.cc:492] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.192710 9848 ts_tablet_manager.cc:1397] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.006s
I20260928 14:50:40.193391 9848 raft_consensus.cc:348] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.193666 9848 raft_consensus.cc:374] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.195024 9848 raft_consensus.cc:729] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.195312 9848 consensus_queue.cc:260] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.195870 9848 ts_tablet_manager.cc:1428] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:40.196161 9848 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.198458 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_82daf59a1acc4e2fac99cb20233e41cd" } modify_external_catalogs: true
I20260928 14:50:40.198650 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_82daf59a1acc4e2fac99cb20233e41cd" } modify_external_catalogs: true
I20260928 14:50:40.197495 9848 tablet_bootstrap.cc:654] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.087179 9813 rpcz_store.cc:276] 0928 14:50:38.596370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.596830 (+ 460us) service_pool.cc:227] Handling call
0928 14:50:39.975182 (+1378352us) ts_tablet_manager.cc:1145] Deleting tablet 69e3c8ef3e20451dbf91b671655974e5
0928 14:50:39.975192 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:39.979003 (+ 3811us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.055435 (+ 76432us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.085356 (+ 29921us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1378203}
I20260928 14:50:40.207016 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 862) took 1605 ms. Trace:
I20260928 14:50:40.207103 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 69e3c8ef3e20451dbf91b671655974e5 (table default.Table_50d42e9768d34d79ad94f455c707b4b1 [id=b584e121a4404da8b4acad3d0667a55e]) successfully deleted
I20260928 14:50:40.207113 9813 rpcz_store.cc:276] 0928 14:50:38.601730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.601789 (+ 59us) service_pool.cc:227] Handling call
0928 14:50:40.206901 (+1605112us) ts_tablet_manager.cc:1145] Deleting tablet 66772fac8b3747f0983562195abcc64e
0928 14:50:40.206912 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.207001 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604951}
I20260928 14:50:40.207365 9813 tablet_replica.cc:330] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.207536 9813 raft_consensus.cc:2229] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.207670 9813 raft_consensus.cc:2258] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.207723 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 66772fac8b3747f0983562195abcc64e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66772fac8b3747f0983562195abcc64e already in progress: creating tablet
I20260928 14:50:40.208133 9813 ts_tablet_manager.cc:1905] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.216038 9848 tablet_bootstrap.cc:492] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.216174 9848 ts_tablet_manager.cc:1397] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260928 14:50:40.216769 9848 raft_consensus.cc:348] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.216965 9848 raft_consensus.cc:374] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.217018 9848 raft_consensus.cc:729] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.217195 9848 consensus_queue.cc:260] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.217693 9848 ts_tablet_manager.cc:1428] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260928 14:50:40.223256 9851 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.223376 9851 ts_tablet_manager.cc:1397] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.003s
I20260928 14:50:40.226935 9851 raft_consensus.cc:348] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.227528 9851 raft_consensus.cc:374] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.227736 9851 raft_consensus.cc:729] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.228336 9851 consensus_queue.cc:260] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.229379 9848 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.231431 9848 tablet_bootstrap.cc:654] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.232738 9813 ts_tablet_manager.cc:1918] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.232846 9813 log.cc:1196] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/767958659f4f450497eb5f2a3902993e
I20260928 14:50:40.233145 9813 ts_tablet_manager.cc:1939] T 767958659f4f450497eb5f2a3902993e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.238127 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 869) took 1627 ms. Trace:
I20260928 14:50:40.238214 9813 rpcz_store.cc:276] 0928 14:50:38.610201 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.610247 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:40.207328 (+1597081us) ts_tablet_manager.cc:1145] Deleting tablet 767958659f4f450497eb5f2a3902993e
0928 14:50:40.207338 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.210981 (+ 3643us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.232647 (+ 21666us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.238110 (+ 5463us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1543455}
I20260928 14:50:40.238570 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 870) took 1524 ms. Trace:
I20260928 14:50:40.238641 9813 rpcz_store.cc:276] 0928 14:50:38.714415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.714463 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:40.238455 (+1523992us) ts_tablet_manager.cc:1145] Deleting tablet 4117a5bc71ab4993bebe7d817ba46031
0928 14:50:40.238465 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.238555 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1523769}
I20260928 14:50:40.238740 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 767958659f4f450497eb5f2a3902993e (table default.Table_aec40460d7f342a2985b89fc3e947fae [id=4f30f78430574bd9b041b02c0d8c1b07]) successfully deleted
I20260928 14:50:40.238880 9813 tablet_replica.cc:330] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.239049 9813 raft_consensus.cc:2229] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.239181 9813 raft_consensus.cc:2258] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.239282 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4117a5bc71ab4993bebe7d817ba46031 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4117a5bc71ab4993bebe7d817ba46031 already in progress: creating tablet
I20260928 14:50:40.239775 9813 ts_tablet_manager.cc:1905] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.245206 9813 ts_tablet_manager.cc:1918] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.245314 9813 log.cc:1196] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/afe58ef9809540cb942e3ec44296e36f
I20260928 14:50:40.249766 9848 tablet_bootstrap.cc:492] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.249928 9848 ts_tablet_manager.cc:1397] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.007s
I20260928 14:50:40.250559 9848 raft_consensus.cc:348] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.252405 9848 raft_consensus.cc:374] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.252513 9848 raft_consensus.cc:729] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.252763 9848 consensus_queue.cc:260] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.253320 9848 ts_tablet_manager.cc:1428] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:40.253615 9848 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.254372 9851 ts_tablet_manager.cc:1428] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.031s user 0.000s sys 0.003s
I20260928 14:50:40.255380 8953 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_63aadbcdd6154e2c9a14c72dbf61a86a [id=164d4835accf45a8852840a00eae16ba] alter complete (version 2)
I20260928 14:50:40.255903 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_14c64dbddb824381846db69cd0640e63" } new_table_name: "default.Table_6bbca659342d47fa879bd3441a38f962" modify_external_catalogs: true
I20260928 14:50:40.257653 9813 ts_tablet_manager.cc:1939] T afe58ef9809540cb942e3ec44296e36f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.257992 9848 tablet_bootstrap.cc:654] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.263505 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 871) took 1541 ms. Trace:
I20260928 14:50:40.263589 9813 rpcz_store.cc:276] 0928 14:50:38.722497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.722667 (+ 170us) service_pool.cc:227] Handling call
0928 14:50:40.238845 (+1516178us) ts_tablet_manager.cc:1145] Deleting tablet afe58ef9809540cb942e3ec44296e36f
0928 14:50:40.238854 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.242537 (+ 3683us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.245132 (+ 2595us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.263486 (+ 18354us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1515978}
I20260928 14:50:40.264186 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet afe58ef9809540cb942e3ec44296e36f (table default.Table_03bbf67d11074023a23cb3067cf6b53d [id=122f8c1652b144e39ccc3d1465389c9a]) successfully deleted
W20260928 14:50:40.266317 11030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 14:50:40.266943 11032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:40.267349 9813 tablet_replica.cc:330] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:40.268126 11028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 14:50:40.268384 9813 raft_consensus.cc:2229] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:40.270275 9848 tablet_bootstrap.cc:492] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.270453 9848 ts_tablet_manager.cc:1397] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260928 14:50:40.271008 9813 raft_consensus.cc:2258] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.271162 9848 raft_consensus.cc:348] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.271485 9848 raft_consensus.cc:374] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.271579 9848 raft_consensus.cc:729] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.271819 9848 consensus_queue.cc:260] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.272451 9848 ts_tablet_manager.cc:1428] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:40.272768 9848 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.275233 11015 raft_consensus.cc:482] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.275343 11015 raft_consensus.cc:504] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.275601 9848 tablet_bootstrap.cc:654] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.275863 11015 leader_election.cc:288] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:40.276966 9360 leader_election.cc:341] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 28ee844aa3c24336b4acb66dc43186e9
W20260928 14:50:40.277161 9360 leader_election.cc:341] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 28ee844aa3c24336b4acb66dc43186e9
I20260928 14:50:40.277237 9360 leader_election.cc:302] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.277639 11015 raft_consensus.cc:2726] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.278427 9813 ts_tablet_manager.cc:1905] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.291106 11015 raft_consensus.cc:482] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.291224 11015 raft_consensus.cc:504] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.291702 11015 leader_election.cc:288] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:40.292649 9360 leader_election.cc:341] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2e16a0f674114ac8b4520fbce2d383d8
W20260928 14:50:40.292856 9360 leader_election.cc:341] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 2e16a0f674114ac8b4520fbce2d383d8
I20260928 14:50:40.292923 9360 leader_election.cc:302] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.293311 11015 raft_consensus.cc:2726] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.293963 10816 server_base.cc:1034] running on GCE node
I20260928 14:50:40.295354 10816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 14:50:40.295557 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:40.300447 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_985f91b220b847918afa77543b682d7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.301134 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_985f91b220b847918afa77543b682d7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.302050 9851 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.303768 9851 tablet_bootstrap.cc:654] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.304857 10816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 14:50:40.305078 9848 tablet_bootstrap.cc:492] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.305267 9848 ts_tablet_manager.cc:1397] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.003s
I20260928 14:50:40.306041 9848 raft_consensus.cc:348] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.306304 9848 raft_consensus.cc:374] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.306403 9848 raft_consensus.cc:729] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.306633 9848 consensus_queue.cc:260] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.307298 9848 ts_tablet_manager.cc:1428] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:40.310361 9848 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.319869 10552 consensus_queue.cc:1035] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:40.323827 9220 consensus_peers.cc:487] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:40.324424 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ade6066d90547b6bb9be50799bf8d5f consensus state has no leader
I20260928 14:50:40.324836 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_364b85cc352b4b39b203bfdf676c034b" } new_table_name: "default.Table_9688c52ed8bd4ad48826046444bf6411" modify_external_catalogs: true
W20260928 14:50:40.332849 9220 consensus_peers.cc:487] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:40.335269 10906 raft_consensus.cc:482] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.335407 10906 raft_consensus.cc:504] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.333036 9813 ts_tablet_manager.cc:1918] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:40.335983 10906 leader_election.cc:288] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.336570 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.337255 9220 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.336896 9813 log.cc:1196] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/727cb249723946578bc5bb086d6e6c40
I20260928 14:50:40.337831 10816 hybrid_clock.cc:648] HybridClock initialized: now 1790607040337413 us; error 470 us; skew 500 ppm
I20260928 14:50:40.338255 10816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 14:50:40.338724 9848 tablet_bootstrap.cc:654] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.337718 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:40.339547 9569 raft_consensus.cc:2454] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:40.339931 9219 leader_election.cc:302] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.340286 10975 raft_consensus.cc:2781] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:40.340384 10975 raft_consensus.cc:482] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:40.340447 10975 raft_consensus.cc:3037] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.340880 9813 ts_tablet_manager.cc:1939] T 727cb249723946578bc5bb086d6e6c40 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.341797 9851 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.342381 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 872) took 1619 ms. Trace:
I20260928 14:50:40.342480 9813 rpcz_store.cc:276] 0928 14:50:38.722621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.722899 (+ 278us) service_pool.cc:227] Handling call
0928 14:50:40.263833 (+1540934us) ts_tablet_manager.cc:1145] Deleting tablet 727cb249723946578bc5bb086d6e6c40
0928 14:50:40.265235 (+ 1402us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.293456 (+ 28221us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.329810 (+ 36354us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.342363 (+ 12553us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540719}
I20260928 14:50:40.342919 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 874) took 1589 ms. Trace:
I20260928 14:50:40.342903 10975 raft_consensus.cc:504] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.342986 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 727cb249723946578bc5bb086d6e6c40 (table default.Table_34ed3510a4a04fe386d546ba1bdf33af [id=c8772673692a4ab59c47f4fc1e817bc4]) successfully deleted
I20260928 14:50:40.343003 9813 rpcz_store.cc:276] 0928 14:50:38.753759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.754266 (+ 507us) service_pool.cc:227] Handling call
0928 14:50:40.342800 (+1588534us) ts_tablet_manager.cc:1145] Deleting tablet 39091da7a6fb4aceadd3434bd304c268
0928 14:50:40.342811 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.342903 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588330}
I20260928 14:50:40.343353 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 873) took 1604 ms. Trace:
I20260928 14:50:40.343457 10975 leader_election.cc:288] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.343425 9813 rpcz_store.cc:276] 0928 14:50:38.738901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.754676 (+ 15775us) service_pool.cc:227] Handling call
0928 14:50:40.343248 (+1588572us) ts_tablet_manager.cc:1145] Deleting tablet 79ef0426eb92482a83d9903e0d6153c1
0928 14:50:40.343259 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.343338 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588392}
W20260928 14:50:40.343490 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 39091da7a6fb4aceadd3434bd304c268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39091da7a6fb4aceadd3434bd304c268 already in progress: creating tablet
I20260928 14:50:40.343694 9813 tablet_replica.cc:330] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:40.343856 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 79ef0426eb92482a83d9903e0d6153c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ef0426eb92482a83d9903e0d6153c1 already in progress: creating tablet
I20260928 14:50:40.343900 9813 raft_consensus.cc:2229] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.343864 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:40.344044 9813 raft_consensus.cc:2258] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.342262 9851 ts_tablet_manager.cc:1397] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.001s
I20260928 14:50:40.344549 9813 ts_tablet_manager.cc:1905] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.344681 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:40.344842 9569 raft_consensus.cc:3037] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.346293 9848 tablet_bootstrap.cc:492] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.346429 9848 ts_tablet_manager.cc:1397] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.006s
I20260928 14:50:40.347203 9848 raft_consensus.cc:348] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.347422 9848 raft_consensus.cc:374] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.347481 9848 raft_consensus.cc:729] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.347694 9848 consensus_queue.cc:260] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.348253 9848 ts_tablet_manager.cc:1428] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:40.349503 9569 raft_consensus.cc:2454] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:40.344415 9220 leader_election.cc:341] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.350598 9848 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.350988 9219 leader_election.cc:302] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.351383 10975 raft_consensus.cc:2781] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:40.351493 10975 raft_consensus.cc:686] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:40.351683 10975 consensus_queue.cc:237] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.353425 9848 tablet_bootstrap.cc:654] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.360759 9813 ts_tablet_manager.cc:1918] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.360872 9813 log.cc:1196] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/63cf6b4c153f4fbdb4ffe16f5c91da7a
I20260928 14:50:40.361167 9813 ts_tablet_manager.cc:1939] T 63cf6b4c153f4fbdb4ffe16f5c91da7a P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.361443 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 875) took 1523 ms. Trace:
I20260928 14:50:40.361546 9813 rpcz_store.cc:276] 0928 14:50:38.838002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.838049 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:40.343651 (+1505602us) ts_tablet_manager.cc:1145] Deleting tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a
0928 14:50:40.343662 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.355722 (+ 12060us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.360679 (+ 4957us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.361426 (+ 747us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1503311}
I20260928 14:50:40.361881 9813 tablet_replica.cc:330] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.362077 9813 raft_consensus.cc:2229] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.362056 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 63cf6b4c153f4fbdb4ffe16f5c91da7a (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
I20260928 14:50:40.362265 9813 raft_consensus.cc:2258] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.362807 9813 ts_tablet_manager.cc:1905] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.365513 9848 tablet_bootstrap.cc:492] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.365689 9848 ts_tablet_manager.cc:1397] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.001s
I20260928 14:50:40.365906 11015 raft_consensus.cc:482] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.365978 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44619c4c46f46c897a2ab5bc63b817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.366024 11015 raft_consensus.cc:504] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.366420 9848 raft_consensus.cc:348] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.366591 11015 leader_election.cc:288] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:40.366626 9848 raft_consensus.cc:374] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.366677 9848 raft_consensus.cc:729] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.366856 9848 consensus_queue.cc:260] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.367309 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd69130e0d34defbdce5edc925f7277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.367440 9848 ts_tablet_manager.cc:1428] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:40.367695 9848 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.369917 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afab196535584fc0a953c28bb56bf511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.370972 9848 tablet_bootstrap.cc:654] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.371104 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e1e0fa282cd4c59ac8b52faaa0d022e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.373960 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33ecd8df52d4355b187142ff61f24ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.375330 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc3cc0f6f6844508f9c06d649dd39c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.375556 9813 ts_tablet_manager.cc:1918] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:40.375656 9813 log.cc:1196] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/091600d56fdc469d8b754acd8933808b
I20260928 14:50:40.375957 9813 ts_tablet_manager.cc:1939] T 091600d56fdc469d8b754acd8933808b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.376183 9855 tablet_bootstrap.cc:654] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.376195 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 876) took 1524 ms. Trace:
I20260928 14:50:40.376259 9813 rpcz_store.cc:276] 0928 14:50:38.851342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.851382 (+ 40us) service_pool.cc:227] Handling call
0928 14:50:40.361822 (+1510440us) ts_tablet_manager.cc:1145] Deleting tablet 091600d56fdc469d8b754acd8933808b
0928 14:50:40.361833 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.372958 (+ 11125us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.375490 (+ 2532us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.376183 (+ 693us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510269}
I20260928 14:50:40.376616 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 877) took 1519 ms. Trace:
I20260928 14:50:40.376684 9813 rpcz_store.cc:276] 0928 14:50:38.857114 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.857289 (+ 175us) service_pool.cc:227] Handling call
0928 14:50:40.376494 (+1519205us) ts_tablet_manager.cc:1145] Deleting tablet dbf40dcd1f57425a85193a3fe4b039b6
0928 14:50:40.376504 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.376600 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1518891}
I20260928 14:50:40.376713 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 091600d56fdc469d8b754acd8933808b (table default.Table_5a0e54b68ecb48adb9658774ac31c91c [id=52b5f678a6ee42beab450c26e91f92da]) successfully deleted
I20260928 14:50:40.376920 9813 tablet_replica.cc:330] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.377077 9813 raft_consensus.cc:2229] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.377192 9813 raft_consensus.cc:2258] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.377197 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet dbf40dcd1f57425a85193a3fe4b039b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbf40dcd1f57425a85193a3fe4b039b6 already in progress: creating tablet
I20260928 14:50:40.380306 9813 ts_tablet_manager.cc:1905] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:40.380719 9360 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:40.381095 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6f09bae9c9a40c9a94823a92706a65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.382449 9848 tablet_bootstrap.cc:492] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.382550 9848 ts_tablet_manager.cc:1397] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
W20260928 14:50:40.383123 9360 leader_election.cc:341] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:40.383211 9360 leader_election.cc:302] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.383462 9848 raft_consensus.cc:348] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.383620 10920 raft_consensus.cc:2726] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.383656 9848 raft_consensus.cc:374] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.383700 9848 raft_consensus.cc:729] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.383841 9848 consensus_queue.cc:260] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.384341 9848 ts_tablet_manager.cc:1428] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:40.384552 9848 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.388990 9848 tablet_bootstrap.cc:654] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.391047 9815 ts_tablet_manager.cc:1918] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.391152 9815 log.cc:1196] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/aaacc1f839914859b23ae755042e02d8
I20260928 14:50:40.391399 9815 ts_tablet_manager.cc:1939] T aaacc1f839914859b23ae755042e02d8 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.392262 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet aaacc1f839914859b23ae755042e02d8 (table default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]) successfully deleted
I20260928 14:50:40.392621 9815 tablet_replica.cc:330] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.394544 9813 ts_tablet_manager.cc:1918] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.394665 9813 log.cc:1196] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/1738a95895914cc4936a38e1d189d538
I20260928 14:50:40.394941 9813 ts_tablet_manager.cc:1939] T 1738a95895914cc4936a38e1d189d538 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.395192 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 878) took 1537 ms. Trace:
I20260928 14:50:40.395264 9813 rpcz_store.cc:276] 0928 14:50:38.857244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.857441 (+ 197us) service_pool.cc:227] Handling call
0928 14:50:40.376886 (+1519445us) ts_tablet_manager.cc:1145] Deleting tablet 1738a95895914cc4936a38e1d189d538
0928 14:50:40.376894 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.391129 (+ 14235us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.394478 (+ 3349us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.395177 (+ 699us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519237}
I20260928 14:50:40.395529 9813 tablet_replica.cc:330] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.395699 9813 raft_consensus.cc:2229] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.395747 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 1738a95895914cc4936a38e1d189d538 (table default.Table_18e52ce0d45d4eceaa2056ae3bb40d0c [id=260c642bc0254bdd851a39916ea9420d]) successfully deleted
I20260928 14:50:40.395819 9813 raft_consensus.cc:2258] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.398653 9813 ts_tablet_manager.cc:1905] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.398834 9851 raft_consensus.cc:348] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.399130 9851 raft_consensus.cc:374] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.399187 9851 raft_consensus.cc:729] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.399410 9851 consensus_queue.cc:260] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.399968 8951 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b] alter complete (version 2)
I20260928 14:50:40.401087 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_13cca1a2e79e4301b51736b5837ed4e7" } modify_external_catalogs: true
I20260928 14:50:40.401300 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_13cca1a2e79e4301b51736b5837ed4e7" } modify_external_catalogs: true
I20260928 14:50:40.401602 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f012857690f4f91a941a5f642b9c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.401835 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d5a67ec9ce403d91ef1f6d52380b96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.402014 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc978ea3a194282aacc6ede22076c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.402374 9851 ts_tablet_manager.cc:1428] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260928 14:50:40.402710 9848 tablet_bootstrap.cc:492] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.402814 9848 ts_tablet_manager.cc:1397] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.001s
I20260928 14:50:40.403334 9851 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.403793 9848 raft_consensus.cc:348] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.403968 9848 raft_consensus.cc:374] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.404018 9848 raft_consensus.cc:729] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.404181 9848 consensus_queue.cc:260] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.404708 9848 ts_tablet_manager.cc:1428] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:40.404934 9848 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.404964 9851 tablet_bootstrap.cc:654] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.409224 9848 tablet_bootstrap.cc:654] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.414546 9813 ts_tablet_manager.cc:1918] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.414654 9813 log.cc:1196] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cbd9f9cb48a945d19420a8bdb9bb9576
I20260928 14:50:40.414950 9813 ts_tablet_manager.cc:1939] T cbd9f9cb48a945d19420a8bdb9bb9576 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.415201 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 879) took 1528 ms. Trace:
I20260928 14:50:40.415269 9813 rpcz_store.cc:276] 0928 14:50:38.886932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.886979 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:40.395493 (+1508514us) ts_tablet_manager.cc:1145] Deleting tablet cbd9f9cb48a945d19420a8bdb9bb9576
0928 14:50:40.395501 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.411751 (+ 16250us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.414477 (+ 2726us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.415187 (+ 710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507939}
I20260928 14:50:40.415539 9813 tablet_replica.cc:330] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.415711 9813 raft_consensus.cc:2229] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.415724 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cbd9f9cb48a945d19420a8bdb9bb9576 (table default.Table_eb8e41236cc945d8957a137aca04ed41 [id=ef2ad363db754d659d4ff019dfebb745]) successfully deleted
I20260928 14:50:40.415838 9813 raft_consensus.cc:2258] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.416839 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 540a929843d3466f8f2d3ba7b2f994ca consensus state has no leader
I20260928 14:50:40.419206 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 92bf219c9c074585968764e134375172 (DEFAULT_TABLE table=default.Table_d315c68077734c4cb748f734ece08e9b [id=6a4077f67ab8403db25d6ed6f42bcf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.419425 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
I20260928 14:50:40.419551 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92bf219c9c074585968764e134375172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.420295 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b1df25948af14998a26b36bb5b466a1e (table default.Table_f9d1f83d4b0d4777b9d3b3755b556817 [id=37f211d75f004ca08ff659cd19d592e9]). Expected version 2 got 0
I20260928 14:50:40.423769 9848 tablet_bootstrap.cc:492] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.423882 9848 ts_tablet_manager.cc:1397] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260928 14:50:40.424817 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 92bf219c9c074585968764e134375172 (DEFAULT_TABLE table=default.Table_d315c68077734c4cb748f734ece08e9b [id=6a4077f67ab8403db25d6ed6f42bcf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.425472 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92bf219c9c074585968764e134375172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.426218 9848 raft_consensus.cc:348] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.426406 9848 raft_consensus.cc:374] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.426448 9848 raft_consensus.cc:729] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.426618 9848 consensus_queue.cc:260] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.427112 9848 ts_tablet_manager.cc:1428] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:40.427686 9848 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.429800 10816 webserver.cc:460] Webserver started at http://127.8.181.61:36355/ using document root <none> and password file <none>
I20260928 14:50:40.430775 9813 ts_tablet_manager.cc:1905] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.430924 10816 fs_manager.cc:359] Metadata directory not provided
I20260928 14:50:40.431075 10816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 14:50:40.431077 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 7d478ac9011d46e0b24f73b829fd2bac (DEFAULT_TABLE table=default.Table_b9bc46525f874a939ce9829dedf7c86a [id=8bacca7772184e9d8335566ab3aac7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.431398 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d478ac9011d46e0b24f73b829fd2bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.431476 9848 tablet_bootstrap.cc:654] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.411651 9855 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.436807 9855 ts_tablet_manager.cc:1397] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.373s user 0.011s sys 0.014s
I20260928 14:50:40.436837 9815 raft_consensus.cc:2229] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.436990 9815 raft_consensus.cc:2258] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.437482 9855 raft_consensus.cc:348] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.437681 9855 raft_consensus.cc:374] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.437723 9855 raft_consensus.cc:729] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.437915 9855 consensus_queue.cc:260] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.438252 9813 ts_tablet_manager.cc:1918] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.438342 9813 log.cc:1196] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f1dacb0eef514609bcaf503ccc9845e3
I20260928 14:50:40.438432 9855 ts_tablet_manager.cc:1428] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:40.438660 9813 ts_tablet_manager.cc:1939] T f1dacb0eef514609bcaf503ccc9845e3 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.438917 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 880) took 1527 ms. Trace:
I20260928 14:50:40.438988 9813 rpcz_store.cc:276] 0928 14:50:38.911018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.911063 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:40.415502 (+1504439us) ts_tablet_manager.cc:1145] Deleting tablet f1dacb0eef514609bcaf503ccc9845e3
0928 14:50:40.415512 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.434497 (+ 18985us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.438182 (+ 3685us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.438902 (+ 720us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1504233}
I20260928 14:50:40.439272 9813 tablet_replica.cc:330] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.439425 9813 raft_consensus.cc:2229] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.439539 9813 raft_consensus.cc:2258] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.439498 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f1dacb0eef514609bcaf503ccc9845e3 (table default.Table_179a0cdc7fb945369cf32b7380fb39fe [id=406fbbcbe232457bbe03bfe66ec127f3]) successfully deleted
I20260928 14:50:40.439973 9813 ts_tablet_manager.cc:1905] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.441700 11015 raft_consensus.cc:482] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.441810 11015 raft_consensus.cc:504] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.442307 11015 leader_election.cc:288] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:40.443209 9360 leader_election.cc:341] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 11f9b039838a430eac3fd422f0f4d087
I20260928 14:50:40.444975 9848 tablet_bootstrap.cc:492] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.445084 9848 ts_tablet_manager.cc:1397] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.005s
I20260928 14:50:40.445921 9848 raft_consensus.cc:348] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.446113 9848 raft_consensus.cc:374] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.446185 9848 raft_consensus.cc:729] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.446388 9848 consensus_queue.cc:260] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.447026 9848 ts_tablet_manager.cc:1428] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:40.447597 9848 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.456298 9855 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.456785 9848 tablet_bootstrap.cc:654] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.458393 9855 tablet_bootstrap.cc:654] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.461474 9813 ts_tablet_manager.cc:1918] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.461637 9813 log.cc:1196] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/c5c6b0867466459ca14413559800ff64
I20260928 14:50:40.461931 9813 ts_tablet_manager.cc:1939] T c5c6b0867466459ca14413559800ff64 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.462200 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 881) took 1484 ms. Trace:
I20260928 14:50:40.462286 9813 rpcz_store.cc:276] 0928 14:50:38.977464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.977637 (+ 173us) service_pool.cc:227] Handling call
0928 14:50:40.439234 (+1461597us) ts_tablet_manager.cc:1145] Deleting tablet c5c6b0867466459ca14413559800ff64
0928 14:50:40.439244 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.449185 (+ 9941us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.461400 (+ 12215us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.462185 (+ 785us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461430}
W20260928 14:50:40.462463 9360 leader_election.cc:341] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 11f9b039838a430eac3fd422f0f4d087
I20260928 14:50:40.462560 9360 leader_election.cc:302] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.462642 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 882) took 1467 ms. Trace:
I20260928 14:50:40.462692 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet c5c6b0867466459ca14413559800ff64 (table default.Table_ac61e6a117344388a152319868485978 [id=6c2f5a1d505e40e49e76743f070e55a6]) successfully deleted
I20260928 14:50:40.462702 9813 rpcz_store.cc:276] 0928 14:50:38.995006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:38.995068 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:40.462531 (+1467463us) ts_tablet_manager.cc:1145] Deleting tablet 0a5a14312acc4de39e72ac15cf74fcbf
0928 14:50:40.462541 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.462629 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1467299}
I20260928 14:50:40.462857 11015 raft_consensus.cc:2726] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.462935 9813 tablet_replica.cc:330] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.463081 9813 raft_consensus.cc:2229] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:40.463080 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0a5a14312acc4de39e72ac15cf74fcbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a5a14312acc4de39e72ac15cf74fcbf already in progress: creating tablet
I20260928 14:50:40.463208 9813 raft_consensus.cc:2258] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.463660 9813 ts_tablet_manager.cc:1905] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.464059 9815 ts_tablet_manager.cc:1905] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.465087 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 5743a715408c432fb63192f084a3cfac (DEFAULT_TABLE table=default.Table_63f658dac2234f93b9ee38a7810c78ff [id=0036e1271b34438bb9247e90a68e4ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.465408 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5743a715408c432fb63192f084a3cfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.469094 9848 tablet_bootstrap.cc:492] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.469199 9848 ts_tablet_manager.cc:1397] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20260928 14:50:40.469663 10895 raft_consensus.cc:482] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.469781 10895 raft_consensus.cc:504] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.469908 9848 raft_consensus.cc:348] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.470082 9848 raft_consensus.cc:374] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.470127 9848 raft_consensus.cc:729] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.470292 10895 leader_election.cc:288] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.470286 9848 consensus_queue.cc:260] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.470921 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:40.471009 9848 ts_tablet_manager.cc:1428] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:40.471092 8953 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_e9daf3dcd2ea41469f8e89a3f87ea208 [id=38a18331beae4386a199edd7e5491230]). Expected version 3 got 0
W20260928 14:50:40.471395 9498 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.472541 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.472728 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f9b039838a430eac3fd422f0f4d087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.472971 9848 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.472946 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet cadfdf093ab04b61af441cff6c9c510b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.472918 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cf0711f56e724fedba65fee2b61378d2" } new_table_name: "default.Table_278b8100c5df42a6985befad34ddc048" modify_external_catalogs: true
I20260928 14:50:40.473131 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ef356a4c9d34af4b300d38eab49a569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.474340 9848 tablet_bootstrap.cc:654] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.474440 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.474879 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 7d478ac9011d46e0b24f73b829fd2bac (DEFAULT_TABLE table=default.Table_b9bc46525f874a939ce9829dedf7c86a [id=8bacca7772184e9d8335566ab3aac7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.475037 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_468a5a67d9d142899157a128521dd34a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:40.475224 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d478ac9011d46e0b24f73b829fd2bac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:40.475579 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_468a5a67d9d142899157a128521dd34a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.475930 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3cc715f9621743d397d7ebb1b9d03a23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.476410 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cc715f9621743d397d7ebb1b9d03a23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:40.476679 9497 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.476769 9497 leader_election.cc:302] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.477061 10895 raft_consensus.cc:2726] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.480089 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 7d478ac9011d46e0b24f73b829fd2bac (DEFAULT_TABLE table=default.Table_b9bc46525f874a939ce9829dedf7c86a [id=8bacca7772184e9d8335566ab3aac7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.480501 9813 ts_tablet_manager.cc:1918] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.480577 9855 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.480590 9813 log.cc:1196] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ba281355b2f44b77a4ff99d49c084162
I20260928 14:50:40.480681 9855 ts_tablet_manager.cc:1397] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260928 14:50:40.480623 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5743a715408c432fb63192f084a3cfac (DEFAULT_TABLE table=default.Table_63f658dac2234f93b9ee38a7810c78ff [id=0036e1271b34438bb9247e90a68e4ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.480860 9813 ts_tablet_manager.cc:1939] T ba281355b2f44b77a4ff99d49c084162 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.481030 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5743a715408c432fb63192f084a3cfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.481594 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 5743a715408c432fb63192f084a3cfac (DEFAULT_TABLE table=default.Table_63f658dac2234f93b9ee38a7810c78ff [id=0036e1271b34438bb9247e90a68e4ca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.481916 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5743a715408c432fb63192f084a3cfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.482769 10975 consensus_queue.cc:1035] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:40.481417 9855 raft_consensus.cc:348] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.485692 9855 raft_consensus.cc:374] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.485795 9855 raft_consensus.cc:729] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.486088 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d478ac9011d46e0b24f73b829fd2bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.486025 9855 consensus_queue.cc:260] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.486265 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 884) took 1415 ms. Trace:
I20260928 14:50:40.486428 9813 rpcz_store.cc:276] 0928 14:50:39.070516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.070565 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:40.462900 (+1392335us) ts_tablet_manager.cc:1145] Deleting tablet ba281355b2f44b77a4ff99d49c084162
0928 14:50:40.462910 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.477438 (+ 14528us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.480437 (+ 2999us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.486248 (+ 5811us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392159}
I20260928 14:50:40.486949 9813 tablet_replica.cc:330] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.487025 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ba281355b2f44b77a4ff99d49c084162 (table default.Table_f0f4d7e303b24a83932decc1af4a5311 [id=0ecdb8af4dd7429c92b6487466ad1964]) successfully deleted
I20260928 14:50:40.487150 9855 ts_tablet_manager.cc:1428] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:40.487215 9813 raft_consensus.cc:2229] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.487432 9813 raft_consensus.cc:2258] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.487900 9855 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.489270 9855 tablet_bootstrap.cc:654] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.489167 9813 ts_tablet_manager.cc:1905] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.492247 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 92bf219c9c074585968764e134375172 (DEFAULT_TABLE table=default.Table_d315c68077734c4cb748f734ece08e9b [id=6a4077f67ab8403db25d6ed6f42bcf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:40.492594 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92bf219c9c074585968764e134375172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:40.510542 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:40.511132 8953 catalog_manager.cc:5495] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:40.511597 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b1df25948af14998a26b36bb5b466a1e (table default.Table_f9d1f83d4b0d4777b9d3b3755b556817 [id=37f211d75f004ca08ff659cd19d592e9]). Expected version 2 got 0
I20260928 14:50:40.511933 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:40.512248 8953 catalog_manager.cc:5495] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:40.512728 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0fd5bf5648c546ac9145328ff3e8b198
I20260928 14:50:40.513669 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.514443 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.515036 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd5bf5648c546ac9145328ff3e8b198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:40.515751 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0fd5bf5648c546ac9145328ff3e8b198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd5bf5648c546ac9145328ff3e8b198 already in progress: creating tablet
I20260928 14:50:40.517014 9815 ts_tablet_manager.cc:1918] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.517616 9815 log.cc:1196] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/edf76b53ded84392a39c73d7e653615d
I20260928 14:50:40.518074 9815 ts_tablet_manager.cc:1939] T edf76b53ded84392a39c73d7e653615d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.521801 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6d2bd32270694ec2af95c7bf5b906b1b
I20260928 14:50:40.522248 8950 catalog_manager.cc:6565] ReplaceTablet: tablet 6d2bd32270694ec2af95c7bf5b906b1b deleted and replaced by tablet 9ff6fb6b48b54b4aa9befdc032a72766
I20260928 14:50:40.523167 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8fcc42af91c247b1b80059e95e3659cf
I20260928 14:50:40.523213 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff6fb6b48b54b4aa9befdc032a72766) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.523725 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcc42af91c247b1b80059e95e3659cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.523916 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9ad13af827fd4a08b5bda4a53720c3e4
I20260928 14:50:40.524240 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcc42af91c247b1b80059e95e3659cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.524667 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5d08466aa7d54f12b137986258a6d174
W20260928 14:50:40.524907 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8fcc42af91c247b1b80059e95e3659cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcc42af91c247b1b80059e95e3659cf already in progress: creating tablet
I20260928 14:50:40.525838 10975 consensus_queue.cc:1035] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:40.526077 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d08466aa7d54f12b137986258a6d174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.526345 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.527304 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d08466aa7d54f12b137986258a6d174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.527451 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:40.527827 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5d08466aa7d54f12b137986258a6d174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d08466aa7d54f12b137986258a6d174 already in progress: creating tablet
W20260928 14:50:40.528151 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9ad13af827fd4a08b5bda4a53720c3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ad13af827fd4a08b5bda4a53720c3e4 already in progress: creating tablet
I20260928 14:50:40.528746 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff6fb6b48b54b4aa9befdc032a72766) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:40.529268 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6d2bd32270694ec2af95c7bf5b906b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2bd32270694ec2af95c7bf5b906b1b already in progress: creating tablet
I20260928 14:50:40.526810 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ad13af827fd4a08b5bda4a53720c3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.527092 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcc42af91c247b1b80059e95e3659cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.528589 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d08466aa7d54f12b137986258a6d174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.531872 9815 tablet_replica.cc:330] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.531993 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet edf76b53ded84392a39c73d7e653615d (table default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]) successfully deleted
I20260928 14:50:40.532070 9815 raft_consensus.cc:2229] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.532191 9815 raft_consensus.cc:2258] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.532647 9815 ts_tablet_manager.cc:1905] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.534854 11015 raft_consensus.cc:482] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.534976 11015 raft_consensus.cc:504] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:40.535444 9220 consensus_peers.cc:487] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:40.535514 11015 leader_election.cc:288] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:40.536341 9360 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: a2d5a67ec9ce403d91ef1f6d52380b96
W20260928 14:50:40.536988 9360 leader_election.cc:341] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: a2d5a67ec9ce403d91ef1f6d52380b96
I20260928 14:50:40.537041 10895 raft_consensus.cc:482] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.537093 9360 leader_election.cc:302] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.537143 10895 raft_consensus.cc:504] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.537372 11015 raft_consensus.cc:2726] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.537690 10895 leader_election.cc:288] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.538147 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622a7af04be44ddebc1af16fcc6325ae" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:40.538620 9848 tablet_bootstrap.cc:492] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:40.538579 9498 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.538731 9848 ts_tablet_manager.cc:1397] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.000s
I20260928 14:50:40.539136 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622a7af04be44ddebc1af16fcc6325ae" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.539381 9848 raft_consensus.cc:348] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.539561 11015 raft_consensus.cc:482] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:40.539548 9497 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.539589 9848 raft_consensus.cc:374] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.539637 9848 raft_consensus.cc:729] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.539651 9497 leader_election.cc:302] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.539657 11015 raft_consensus.cc:504] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.539795 9848 consensus_queue.cc:260] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.539942 10895 raft_consensus.cc:2726] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.540071 11015 leader_election.cc:288] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:40.540874 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.541586 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61fa4c4cff54e55b6e640d1b6376236" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:40.542038 9360 leader_election.cc:302] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.542268 9848 ts_tablet_manager.cc:1428] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:40.542340 10920 raft_consensus.cc:2726] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.542486 9848 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.544283 9848 tablet_bootstrap.cc:654] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.548713 9813 ts_tablet_manager.cc:1918] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.548801 9813 log.cc:1196] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cf9342e920ae48278ab3f3c6d639fc94
I20260928 14:50:40.549084 9813 ts_tablet_manager.cc:1939] T cf9342e920ae48278ab3f3c6d639fc94 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.554674 9848 tablet_bootstrap.cc:492] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.554896 9848 ts_tablet_manager.cc:1397] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20260928 14:50:40.555804 9848 raft_consensus.cc:348] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.556008 9848 raft_consensus.cc:374] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.556075 9848 raft_consensus.cc:729] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.556263 9848 consensus_queue.cc:260] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.557399 9855 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.557418 9848 ts_tablet_manager.cc:1428] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:40.557592 9855 ts_tablet_manager.cc:1397] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.010s
I20260928 14:50:40.557729 9848 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.512741 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5127a4bb7e114ec09235c9e29f614156 (table default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2]). Expected version 1 got 0
I20260928 14:50:40.558809 9855 raft_consensus.cc:348] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.559507 9855 raft_consensus.cc:374] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.559598 9848 tablet_bootstrap.cc:654] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.559712 9855 raft_consensus.cc:729] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.560014 9855 consensus_queue.cc:260] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.561671 9815 ts_tablet_manager.cc:1918] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.561815 9815 log.cc:1196] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1c54cb0e8f2347d9b139c8766fb61ab1
I20260928 14:50:40.561913 9855 ts_tablet_manager.cc:1428] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:40.562160 9815 ts_tablet_manager.cc:1939] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.563248 9422 raft_consensus.cc:3037] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.564779 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_537173ecbd8545f3ba14e0fd8c26e60e" } new_table_name: "default.Table_7eb610e21f4c41a2becd456b5bbe9946" modify_external_catalogs: true
I20260928 14:50:40.566133 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1b977595c51449c3b3250ad32efcd0d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.566686 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b977595c51449c3b3250ad32efcd0d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.567390 9815 tablet_replica.cc:330] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.567381 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1c54cb0e8f2347d9b139c8766fb61ab1 (table default.Table_455b19903e324720a3d1e2d9f4dc9718 [id=cc5e7eb9c7124567aeab82ebc8bf5050]) successfully deleted
W20260928 14:50:40.567808 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9050b87026a2453688df6d403fa18d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9050b87026a2453688df6d403fa18d08 already in progress: creating tablet
I20260928 14:50:40.567930 9815 raft_consensus.cc:2229] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.568070 9815 raft_consensus.cc:2258] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.568521 9815 ts_tablet_manager.cc:1905] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.568571 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_62f2b3da53c74c06893428d46c68d11c" } new_table_name: "default.Table_b5c970e54a3a462eb56b93f1c8b59f23" modify_external_catalogs: true
I20260928 14:50:40.562543 9855 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.570600 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d7cf2eb5b59649e099da1947c4ccf430
I20260928 14:50:40.571395 9855 tablet_bootstrap.cc:654] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.571292 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6368c0d7fee34bcfa87318701ce9ec68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.571785 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6368c0d7fee34bcfa87318701ce9ec68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.572187 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.572597 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.572849 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:40.573676 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d7cf2eb5b59649e099da1947c4ccf430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7cf2eb5b59649e099da1947c4ccf430 already in progress: creating tablet
I20260928 14:50:40.573777 9851 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.573896 9851 ts_tablet_manager.cc:1397] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.171s user 0.002s sys 0.001s
I20260928 14:50:40.574586 9851 raft_consensus.cc:348] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.574790 9851 raft_consensus.cc:374] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.574844 9851 raft_consensus.cc:729] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.575006 9851 consensus_queue.cc:260] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.576459 9815 ts_tablet_manager.cc:1918] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.576546 9815 log.cc:1196] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5a6755b697134b8e90e457b554b9599c
I20260928 14:50:40.576773 9815 ts_tablet_manager.cc:1939] T 5a6755b697134b8e90e457b554b9599c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.577652 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5a6755b697134b8e90e457b554b9599c (table default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]) successfully deleted
W20260928 14:50:40.578094 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a2b80a390d7747e0b98e5bc6073fcdb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b80a390d7747e0b98e5bc6073fcdb2 already in progress: creating tablet
W20260928 14:50:40.578449 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 06e4b76705874f7185939d2f4e4d1df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e4b76705874f7185939d2f4e4d1df2 already in progress: creating tablet
I20260928 14:50:40.579664 9855 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.579874 9855 ts_tablet_manager.cc:1397] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260928 14:50:40.580122 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 883) took 1509 ms. Trace:
I20260928 14:50:40.580236 9813 rpcz_store.cc:276] 0928 14:50:39.070381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.070830 (+ 449us) service_pool.cc:227] Handling call
0928 14:50:40.486887 (+1416057us) ts_tablet_manager.cc:1145] Deleting tablet cf9342e920ae48278ab3f3c6d639fc94
0928 14:50:40.486898 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.514929 (+ 28031us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.548630 (+ 33701us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.580078 (+ 31448us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415897}
I20260928 14:50:40.580667 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 888) took 1446 ms. Trace:
I20260928 14:50:40.580767 9813 rpcz_store.cc:276] 0928 14:50:39.134348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.134397 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:40.580524 (+1446127us) ts_tablet_manager.cc:1145] Deleting tablet 21ffc5bee62845519a4b7ee8c914e70d
0928 14:50:40.580534 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.580629 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1445886}
I20260928 14:50:40.581100 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 891) took 1423 ms. Trace:
I20260928 14:50:40.581059 9855 raft_consensus.cc:348] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.581207 9813 rpcz_store.cc:276] 0928 14:50:39.157170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.159816 (+ 2646us) service_pool.cc:227] Handling call
0928 14:50:40.580976 (+1421160us) ts_tablet_manager.cc:1145] Deleting tablet 4729fc718bf540ecb501c2cac3966bb0
0928 14:50:40.580985 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.581059 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420928}
I20260928 14:50:40.581290 9855 raft_consensus.cc:374] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.581383 9855 raft_consensus.cc:729] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.581545 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 898) took 1158 ms. Trace:
I20260928 14:50:40.581660 9813 rpcz_store.cc:276] 0928 14:50:39.423200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.423257 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:40.581403 (+1158146us) ts_tablet_manager.cc:1145] Deleting tablet 69f79321ee2446f1aadebaaa79cf7247
0928 14:50:40.581413 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.581481 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152856}
I20260928 14:50:40.581643 9855 consensus_queue.cc:260] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.581969 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 899) took 1158 ms. Trace:
I20260928 14:50:40.582065 9813 rpcz_store.cc:276] 0928 14:50:39.423679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.423740 (+ 61us) service_pool.cc:227] Handling call
0928 14:50:40.581854 (+1158114us) ts_tablet_manager.cc:1145] Deleting tablet 81ef55984cab462082310e195afbe516
0928 14:50:40.581863 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.581931 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153242}
I20260928 14:50:40.582363 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 900) took 1158 ms. Trace:
I20260928 14:50:40.582458 9813 rpcz_store.cc:276] 0928 14:50:39.424028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.424077 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:40.582249 (+1158172us) ts_tablet_manager.cc:1145] Deleting tablet c40ddd4cd54e4d6c9edb0ce7be9102ed
0928 14:50:40.582258 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.582325 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153602}
I20260928 14:50:40.582777 9813 tablet_replica.cc:330] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.582978 9813 raft_consensus.cc:2229] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.583552 9813 raft_consensus.cc:2258] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.583750 9855 ts_tablet_manager.cc:1428] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:40.583748 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cf9342e920ae48278ab3f3c6d639fc94 (table default.Table_80bae2129fb24491b999a368ecb99d3f [id=9793280eca254a92865bde9e52fe4588]) successfully deleted
I20260928 14:50:40.584082 9813 ts_tablet_manager.cc:1905] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:40.584092 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 21ffc5bee62845519a4b7ee8c914e70d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21ffc5bee62845519a4b7ee8c914e70d already in progress: creating tablet
W20260928 14:50:40.584365 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4729fc718bf540ecb501c2cac3966bb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4729fc718bf540ecb501c2cac3966bb0 already in progress: creating tablet
W20260928 14:50:40.584719 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 69f79321ee2446f1aadebaaa79cf7247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f79321ee2446f1aadebaaa79cf7247 already in progress: creating tablet
W20260928 14:50:40.584904 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 540a929843d3466f8f2d3ba7b2f994ca (table default.Table_9688c52ed8bd4ad48826046444bf6411 [id=6750432a1a624a9cb9ce840fb99389c7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 540a929843d3466f8f2d3ba7b2f994ca consensus state has no leader
W20260928 14:50:40.585016 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 81ef55984cab462082310e195afbe516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81ef55984cab462082310e195afbe516 already in progress: creating tablet
W20260928 14:50:40.585235 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c40ddd4cd54e4d6c9edb0ce7be9102ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c40ddd4cd54e4d6c9edb0ce7be9102ed already in progress: creating tablet
I20260928 14:50:40.588300 9813 ts_tablet_manager.cc:1918] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.588418 9813 log.cc:1196] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/a19995a0d8af4d3ca562bade80ce006f
I20260928 14:50:40.588712 9813 ts_tablet_manager.cc:1939] T a19995a0d8af4d3ca562bade80ce006f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.589264 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 901) took 1164 ms. Trace:
I20260928 14:50:40.589358 9813 rpcz_store.cc:276] 0928 14:50:39.424618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.424680 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:40.582714 (+1158034us) ts_tablet_manager.cc:1145] Deleting tablet a19995a0d8af4d3ca562bade80ce006f
0928 14:50:40.582723 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.586315 (+ 3592us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.588222 (+ 1907us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.589225 (+ 1003us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154031}
I20260928 14:50:40.589764 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 902) took 1088 ms. Trace:
I20260928 14:50:40.589797 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet a19995a0d8af4d3ca562bade80ce006f (table default.Table_f059d30d44564a2689382ef6ab37e7d5 [id=ffd01becfbfc4e92b80bb4fde9aba434]) successfully deleted
I20260928 14:50:40.589847 9813 rpcz_store.cc:276] 0928 14:50:39.500807 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.500888 (+ 81us) service_pool.cc:227] Handling call
0928 14:50:40.589653 (+1088765us) ts_tablet_manager.cc:1145] Deleting tablet 3f17eb03f5ed4cb581c29fc0d8619ff2
0928 14:50:40.589661 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.589733 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088570}
I20260928 14:50:40.590127 9813 tablet_replica.cc:330] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.590281 9813 raft_consensus.cc:2229] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:40.590312 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 already in progress: creating tablet
I20260928 14:50:40.590446 9813 raft_consensus.cc:2258] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.590853 9813 ts_tablet_manager.cc:1905] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.595614 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d2bd32270694ec2af95c7bf5b906b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff6fb6b48b54b4aa9befdc032a72766) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.597416 9855 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.598114 9813 ts_tablet_manager.cc:1918] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.598265 9813 log.cc:1196] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5b695c68118b49359f1899d30208b1b7
I20260928 14:50:40.598615 9813 ts_tablet_manager.cc:1939] T 5b695c68118b49359f1899d30208b1b7 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.599339 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 903) took 1053 ms. Trace:
I20260928 14:50:40.599454 9813 rpcz_store.cc:276] 0928 14:50:39.545913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.545965 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:40.590071 (+1044106us) ts_tablet_manager.cc:1145] Deleting tablet 5b695c68118b49359f1899d30208b1b7
0928 14:50:40.590079 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.592606 (+ 2527us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.598024 (+ 5418us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.599300 (+ 1276us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1043889}
I20260928 14:50:40.599774 9813 tablet_replica.cc:330] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.599931 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5b695c68118b49359f1899d30208b1b7 (table default.Table_5686e39c7ea54cef8e5e4e5570f30b00 [id=5349cf0b4c3340d6b877ac0b9e9d3955]) successfully deleted
I20260928 14:50:40.599969 9813 raft_consensus.cc:2229] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.600116 9813 raft_consensus.cc:2258] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.600653 9813 ts_tablet_manager.cc:1905] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.602442 9851 ts_tablet_manager.cc:1428] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
W20260928 14:50:40.603268 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 16ee19746a004a8d95a573e84f2e06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ee19746a004a8d95a573e84f2e06b0 already in progress: creating tablet
W20260928 14:50:40.603487 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1e06b733c67341df93fe16a24397130c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e06b733c67341df93fe16a24397130c already in progress: creating tablet
W20260928 14:50:40.603768 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d44619c4c46f46c897a2ab5bc63b817a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44619c4c46f46c897a2ab5bc63b817a already in progress: creating tablet
W20260928 14:50:40.603991 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0fd5bf5648c546ac9145328ff3e8b198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd5bf5648c546ac9145328ff3e8b198 already in progress: creating tablet
W20260928 14:50:40.604252 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9ad13af827fd4a08b5bda4a53720c3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ad13af827fd4a08b5bda4a53720c3e4 already in progress: creating tablet
W20260928 14:50:40.604514 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8fcc42af91c247b1b80059e95e3659cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcc42af91c247b1b80059e95e3659cf already in progress: creating tablet
W20260928 14:50:40.604835 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5d08466aa7d54f12b137986258a6d174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d08466aa7d54f12b137986258a6d174 already in progress: creating tablet
W20260928 14:50:40.605122 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d7cf2eb5b59649e099da1947c4ccf430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7cf2eb5b59649e099da1947c4ccf430 already in progress: creating tablet
W20260928 14:50:40.605481 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6d2bd32270694ec2af95c7bf5b906b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2bd32270694ec2af95c7bf5b906b1b already in progress: creating tablet
I20260928 14:50:40.608103 9855 tablet_bootstrap.cc:654] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.617321 9813 ts_tablet_manager.cc:1918] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.617467 9813 log.cc:1196] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/eefaf5e8e5f54ea080ce3f5e7ac7ec8b
I20260928 14:50:40.617895 9813 ts_tablet_manager.cc:1939] T eefaf5e8e5f54ea080ce3f5e7ac7ec8b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.618798 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 904) took 1072 ms. Trace:
I20260928 14:50:40.618925 9813 rpcz_store.cc:276] 0928 14:50:39.546422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.546463 (+ 41us) service_pool.cc:227] Handling call
0928 14:50:40.599712 (+1053249us) ts_tablet_manager.cc:1145] Deleting tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b
0928 14:50:40.599722 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.614024 (+ 14302us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.617206 (+ 3182us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.618751 (+ 1545us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053039}
I20260928 14:50:40.619268 9813 tablet_replica.cc:330] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.619364 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet eefaf5e8e5f54ea080ce3f5e7ac7ec8b (table default.Table_ea9c8d7bd23a4c1997dbdb43ec245185 [id=ce5b3b642b5e4e0a98e6059f2482a062]) successfully deleted
I20260928 14:50:40.619462 9813 raft_consensus.cc:2229] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.619711 9813 raft_consensus.cc:2258] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.620292 9813 ts_tablet_manager.cc:1905] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.623133 10816 fs_manager.cc:709] Time spent opening directory manager: real 0.188s user 0.009s sys 0.022s
I20260928 14:50:40.627588 9813 ts_tablet_manager.cc:1918] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.627920 9813 log.cc:1196] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/28ee844aa3c24336b4acb66dc43186e9
I20260928 14:50:40.628297 9813 ts_tablet_manager.cc:1939] T 28ee844aa3c24336b4acb66dc43186e9 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.629101 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 905) took 1046 ms. Trace:
I20260928 14:50:40.629230 9813 rpcz_store.cc:276] 0928 14:50:39.582396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.582475 (+ 79us) service_pool.cc:227] Handling call
0928 14:50:40.619199 (+1036724us) ts_tablet_manager.cc:1145] Deleting tablet 28ee844aa3c24336b4acb66dc43186e9
0928 14:50:40.619211 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.623257 (+ 4046us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.627476 (+ 4219us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:40.629022 (+ 1546us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1036517}
I20260928 14:50:40.629684 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 906) took 1014 ms. Trace:
I20260928 14:50:40.629688 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 28ee844aa3c24336b4acb66dc43186e9 (table default.Table_a504f7b0ef6d47ab81f7c3babb6fc17f [id=544d8d04f58f4aee9d4b04c45d9f9cd8]) successfully deleted
I20260928 14:50:40.629802 9813 rpcz_store.cc:276] 0928 14:50:39.615311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:39.615361 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:40.629503 (+1014142us) ts_tablet_manager.cc:1145] Deleting tablet 9050b87026a2453688df6d403fa18d08
0928 14:50:40.629517 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:40.629640 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1013925}
W20260928 14:50:40.630327 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9050b87026a2453688df6d403fa18d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9050b87026a2453688df6d403fa18d08 already in progress: creating tablet
W20260928 14:50:40.630843 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 16ee19746a004a8d95a573e84f2e06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16ee19746a004a8d95a573e84f2e06b0 already in progress: creating tablet
I20260928 14:50:40.630970 9813 tablet_replica.cc:330] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:40.631071 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d44619c4c46f46c897a2ab5bc63b817a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44619c4c46f46c897a2ab5bc63b817a already in progress: creating tablet
W20260928 14:50:40.631263 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a2b80a390d7747e0b98e5bc6073fcdb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b80a390d7747e0b98e5bc6073fcdb2 already in progress: creating tablet
I20260928 14:50:40.631336 9813 raft_consensus.cc:2229] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:40.631488 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1e06b733c67341df93fe16a24397130c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e06b733c67341df93fe16a24397130c already in progress: creating tablet
I20260928 14:50:40.631543 9813 raft_consensus.cc:2258] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.631834 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 06e4b76705874f7185939d2f4e4d1df2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e4b76705874f7185939d2f4e4d1df2 already in progress: creating tablet
I20260928 14:50:40.632113 9813 ts_tablet_manager.cc:1905] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.633327 9851 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.634258 11069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 14:50:40.634809 9851 tablet_bootstrap.cc:654] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.635061 9855 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.635255 9855 ts_tablet_manager.cc:1397] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.007s
I20260928 14:50:40.635970 9855 raft_consensus.cc:348] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.636255 9855 raft_consensus.cc:374] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.636358 9855 raft_consensus.cc:729] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.636600 9855 consensus_queue.cc:260] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.637470 9855 ts_tablet_manager.cc:1428] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:40.637785 9855 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.640292 9855 tablet_bootstrap.cc:654] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.641841 10920 raft_consensus.cc:482] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.641985 10920 raft_consensus.cc:504] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:40.642294 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48f1d934435241529be3b4300ef4aa58 consensus state has no leader
I20260928 14:50:40.642513 10920 leader_election.cc:288] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:40.642714 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 846a96509f32416087ee4667458c367e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:40.643476 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9fa35f27069447e9a08b9747aacb5038"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.644086 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fa35f27069447e9a08b9747aacb5038 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.646080 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_117bb3e870db4e31a62a105acb99a26f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.646672 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_117bb3e870db4e31a62a105acb99a26f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.648397 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.649746 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_aa0fc30f113e4003b8a584c1aece6128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.650640 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa0fc30f113e4003b8a584c1aece6128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.655375 10816 fs_manager.cc:725] Time spent opening block manager: real 0.030s user 0.004s sys 0.000s
W20260928 14:50:40.656026 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aa61fb67d494d8ab7dec29dbc5b61cc consensus state has no leader
I20260928 14:50:40.656540 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_94ab14281290410b96e76fea40cce424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.657059 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94ab14281290410b96e76fea40cce424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.655622 10816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data,/tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
uuid: "8d70b1b045bd4ec4b74be2dc2364ecba"
format_stamp: "Formatted at 2026-09-28 14:50:15 on dist-test-slave-g607"
I20260928 14:50:40.657281 10816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 14:50:40.658587 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_18d53f131bd340b1ae7716cce53117c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.659162 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18d53f131bd340b1ae7716cce53117c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.659734 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.659958 9814 tablet_replica.cc:330] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:40.660140 9814 raft_consensus.cc:2229] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.660288 9814 raft_consensus.cc:2258] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.660573 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 42f7fb96f92a4e35b8561832e1d812d8 (table default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96]). Expected version 2 got 0
I20260928 14:50:40.660758 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.660771 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:40.661017 9814 ts_tablet_manager.cc:1905] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.666664 9814 ts_tablet_manager.cc:1918] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.666759 9814 log.cc:1196] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/46fe647c6d80431bbb76899126d01c3b
I20260928 14:50:40.667028 9814 ts_tablet_manager.cc:1939] T 46fe647c6d80431bbb76899126d01c3b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:40.668010 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 46fe647c6d80431bbb76899126d01c3b (table default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]) successfully deleted
I20260928 14:50:40.668298 9814 tablet_replica.cc:330] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:40.668469 9814 raft_consensus.cc:2229] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.668594 9814 raft_consensus.cc:2258] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.654999 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1df25948af14998a26b36bb5b466a1e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:40.658210 10895 raft_consensus.cc:482] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.668963 9567 raft_consensus.cc:2379] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:40.668922 10895 raft_consensus.cc:504] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.669366 9814 ts_tablet_manager.cc:1905] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.669493 10895 leader_election.cc:288] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.669456 9360 leader_election.cc:302] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.669979 10920 raft_consensus.cc:3037] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.669950 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.670404 9498 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.672420 10920 raft_consensus.cc:2726] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.672875 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:40.673785 9497 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.673894 9497 leader_election.cc:302] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.674234 10895 raft_consensus.cc:2726] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.675429 9814 ts_tablet_manager.cc:1918] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.676896 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:40.677490 9814 log.cc:1196] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/71b5f68b570e4fff8f8748e4c762ad78
I20260928 14:50:40.678262 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.678285 9814 ts_tablet_manager.cc:1939] T 71b5f68b570e4fff8f8748e4c762ad78 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:40.679733 9814 tablet_replica.cc:330] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:40.679754 9422 raft_consensus.cc:3037] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:40.679821 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 71b5f68b570e4fff8f8748e4c762ad78 (table default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]) successfully deleted
I20260928 14:50:40.680814 9814 raft_consensus.cc:2229] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.680974 9814 raft_consensus.cc:2258] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.681432 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:40.681627 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:40.681929 9814 ts_tablet_manager.cc:1905] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.687094 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet f39c1da071164342aea8eab263d4eebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.687309 9815 tablet_replica.cc:330] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.686969 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 622a7af04be44ddebc1af16fcc6325ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.687494 9815 raft_consensus.cc:2229] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.687546 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d6975813b744fb80dcc432cec61cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.687649 9815 raft_consensus.cc:2258] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.687505 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.688371 9815 ts_tablet_manager.cc:1905] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.688347 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet b1df25948af14998a26b36bb5b466a1e (table default.Table_f9d1f83d4b0d4777b9d3b3755b556817 [id=37f211d75f004ca08ff659cd19d592e9]). Expected version 2 got 0
I20260928 14:50:40.688402 9848 tablet_bootstrap.cc:492] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.688527 9848 ts_tablet_manager.cc:1397] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.131s user 0.018s sys 0.052s
I20260928 14:50:40.689230 9848 raft_consensus.cc:348] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.689509 9848 raft_consensus.cc:374] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.689610 9848 raft_consensus.cc:729] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.689813 9848 consensus_queue.cc:260] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.690084 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 11714d0ca321429c95de223320794a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.690265 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet a303792e4c804844bc6037fabb425be4 with delete_type TABLET_DATA_DELETED (replaced by tablet 299ed0acd7cf46d3b78f4f4cea31858f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.690366 9848 ts_tablet_manager.cc:1428] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:40.690619 9848 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.690587 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet dfacaf069e3746aeb8ca11d95e65c5ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.692740 9848 tablet_bootstrap.cc:654] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.694062 9815 ts_tablet_manager.cc:1918] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.694208 9815 log.cc:1196] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/f39c1da071164342aea8eab263d4eebb
I20260928 14:50:40.694525 9815 ts_tablet_manager.cc:1939] T f39c1da071164342aea8eab263d4eebb P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.695479 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet f39c1da071164342aea8eab263d4eebb (table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]) successfully deleted
I20260928 14:50:40.695777 9815 tablet_replica.cc:330] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.695979 9815 raft_consensus.cc:2229] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.696285 9815 raft_consensus.cc:2258] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.696416 9814 ts_tablet_manager.cc:1918] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.696708 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e022fb82787e46f99f941ed27d582d42" } new_table_name: "default.Table_951f708456f94cd18c077cef81046c15" modify_external_catalogs: true
I20260928 14:50:40.696830 9814 log.cc:1196] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:40.696967 9815 ts_tablet_manager.cc:1905] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.697320 9814 ts_tablet_manager.cc:1939] T e760d7e556a54fda9dc91300b9968c68 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:40.698578 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e760d7e556a54fda9dc91300b9968c68 (table default.Table_6b9ef5b0cda2426bb8bf6a02c4e950cc [id=dbed9bfa98404b708a11688e563f1f86]) successfully deleted
I20260928 14:50:40.698745 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1f27f67005ab45f8a688c438160b9119" } new_table_name: "default.Table_712e858037a84d03a2f09ca4ae764c1d" modify_external_catalogs: true
I20260928 14:50:40.702020 9848 tablet_bootstrap.cc:492] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.702172 9848 ts_tablet_manager.cc:1397] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
I20260928 14:50:40.702484 9813 ts_tablet_manager.cc:1918] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.702656 9813 log.cc:1196] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2e16a0f674114ac8b4520fbce2d383d8
I20260928 14:50:40.702874 9848 raft_consensus.cc:348] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.703094 9848 raft_consensus.cc:374] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.703114 9813 ts_tablet_manager.cc:1939] T 2e16a0f674114ac8b4520fbce2d383d8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.703177 9848 raft_consensus.cc:729] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.703380 9848 consensus_queue.cc:260] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.703879 9848 ts_tablet_manager.cc:1428] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:40.704399 9848 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.705660 9813 tablet_replica.cc:330] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.705801 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2e16a0f674114ac8b4520fbce2d383d8 (table default.Table_9141134a84af4e0e83ec4d03d5b91f65 [id=a698602659c34c3bb5664692e177ca14]) successfully deleted
I20260928 14:50:40.707818 9813 raft_consensus.cc:2229] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.707984 9813 raft_consensus.cc:2258] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.708447 9813 ts_tablet_manager.cc:1905] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.710624 9855 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.710709 9815 ts_tablet_manager.cc:1918] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.706173 9848 tablet_bootstrap.cc:654] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.707285 11018 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:40.713620 9815 log.cc:1196] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/622a7af04be44ddebc1af16fcc6325ae
I20260928 14:50:40.713763 9813 ts_tablet_manager.cc:1918] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.710791 9855 ts_tablet_manager.cc:1397] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.005s
I20260928 14:50:40.713874 9813 log.cc:1196] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/1f012857690f4f91a941a5f642b9c989
I20260928 14:50:40.714545 9855 raft_consensus.cc:348] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.714814 9855 raft_consensus.cc:374] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.714915 9855 raft_consensus.cc:729] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.715171 9855 consensus_queue.cc:260] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.718575 9855 ts_tablet_manager.cc:1428] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:40.721423 9855 tablet_bootstrap.cc:492] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.722903 9855 tablet_bootstrap.cc:654] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.723426 9815 ts_tablet_manager.cc:1939] T 622a7af04be44ddebc1af16fcc6325ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.725698 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 622a7af04be44ddebc1af16fcc6325ae (table default.Table_28471d752bd8446eb00cba5559e560f2 [id=f5ad8b4a8b20466ebd2410f788f02694]) successfully deleted
I20260928 14:50:40.725976 9815 tablet_replica.cc:330] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.726190 9815 raft_consensus.cc:2229] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.728300 9851 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.728433 9851 ts_tablet_manager.cc:1397] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.000s
I20260928 14:50:40.728543 9815 raft_consensus.cc:2258] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.729242 9815 ts_tablet_manager.cc:1905] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.729466 9851 raft_consensus.cc:348] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.729686 9851 raft_consensus.cc:374] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.729745 9851 raft_consensus.cc:729] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.729933 9851 consensus_queue.cc:260] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.730799 9851 ts_tablet_manager.cc:1428] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260928 14:50:40.734117 9813 ts_tablet_manager.cc:1939] T 1f012857690f4f91a941a5f642b9c989 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.734966 9813 tablet_replica.cc:330] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.735106 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 1f012857690f4f91a941a5f642b9c989 (table default.Table_f4fab128ab184dc0b574746a3df0aae3 [id=986dfa24f0654f289cc470d33d324253]) successfully deleted
I20260928 14:50:40.735179 9813 raft_consensus.cc:2229] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.735306 9813 raft_consensus.cc:2258] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.735773 9813 ts_tablet_manager.cc:1905] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.736763 9851 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.738624 9851 tablet_bootstrap.cc:654] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.741742 9813 ts_tablet_manager.cc:1918] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.741847 9813 log.cc:1196] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/a2d5a67ec9ce403d91ef1f6d52380b96
I20260928 14:50:40.742107 9813 ts_tablet_manager.cc:1939] T a2d5a67ec9ce403d91ef1f6d52380b96 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.744366 9813 tablet_replica.cc:330] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.744545 9813 raft_consensus.cc:2229] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.744692 9813 raft_consensus.cc:2258] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:40.745102 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b40cc10ec1d4ec8a74d38387e2fdb4c consensus state has no leader
I20260928 14:50:40.745368 9813 ts_tablet_manager.cc:1905] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.746243 9855 tablet_bootstrap.cc:492] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.746352 9855 ts_tablet_manager.cc:1397] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260928 14:50:40.747375 9855 raft_consensus.cc:348] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.747553 9855 raft_consensus.cc:374] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.747607 9855 raft_consensus.cc:729] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.747641 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:40.747820 9855 consensus_queue.cc:260] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.748445 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2e4efa71e8884b1589be170349cfe1c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.748987 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e4efa71e8884b1589be170349cfe1c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.749910 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet 6feba01e78004e50a71c610c9a63aeb5 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:40.750527 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_46ac9accd4964534a60ae4d76d6a1f54" } modify_external_catalogs: true
I20260928 14:50:40.750739 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_46ac9accd4964534a60ae4d76d6a1f54" } modify_external_catalogs: true
I20260928 14:50:40.750957 9813 ts_tablet_manager.cc:1918] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.751049 9813 log.cc:1196] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5fc978ea3a194282aacc6ede22076c21
I20260928 14:50:40.751132 9855 ts_tablet_manager.cc:1428] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260928 14:50:40.751312 9813 ts_tablet_manager.cc:1939] T 5fc978ea3a194282aacc6ede22076c21 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.752025 9813 tablet_replica.cc:330] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.752218 9855 tablet_bootstrap.cc:492] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.752208 9813 raft_consensus.cc:2229] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.752324 9813 raft_consensus.cc:2258] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.752982 9813 ts_tablet_manager.cc:1905] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.753680 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet a2d5a67ec9ce403d91ef1f6d52380b96 (table default.Table_c19e95d4db2943829d59bae7577a5e2a [id=d3863ee470554f5f96236856f07485fa]) successfully deleted
I20260928 14:50:40.753954 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5fc978ea3a194282aacc6ede22076c21 (table default.Table_4b71bddcb3ea4e7e8c5371b94e1340cc [id=16b3ec01cc5543edb63fe12b708eca8c]) successfully deleted
I20260928 14:50:40.754398 9855 tablet_bootstrap.cc:654] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.755995 10895 raft_consensus.cc:482] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.756107 10895 raft_consensus.cc:504] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.756657 10895 leader_election.cc:288] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.756647 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]). Expected version 2 got 0
I20260928 14:50:40.756850 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:40.757064 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet b61fa4c4cff54e55b6e640d1b6376236 (table default.Table_e9daf3dcd2ea41469f8e89a3f87ea208 [id=38a18331beae4386a199edd7e5491230]). Expected version 3 got 0
I20260928 14:50:40.757378 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.757856 9498 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.758083 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.758283 9813 ts_tablet_manager.cc:1918] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.758366 9813 log.cc:1196] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/274ab65ebc2d41db9dc5d8a0139f9bc9
I20260928 14:50:40.758603 9813 ts_tablet_manager.cc:1939] T 274ab65ebc2d41db9dc5d8a0139f9bc9 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:40.758563 9497 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.758663 9497 leader_election.cc:302] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.759262 9813 tablet_replica.cc:330] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.759238 10895 raft_consensus.cc:2726] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.759409 9813 raft_consensus.cc:2229] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.759516 9813 raft_consensus.cc:2258] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.759469 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_081cef36a86d487a87f4a9f1ecf6c8b3" } modify_external_catalogs: true
I20260928 14:50:40.759601 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_081cef36a86d487a87f4a9f1ecf6c8b3" } modify_external_catalogs: true
I20260928 14:50:40.760123 9813 ts_tablet_manager.cc:1905] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.760260 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 274ab65ebc2d41db9dc5d8a0139f9bc9 (table default.Table_09403204efb345808fc758bce9e3fb5e [id=5535d01c2555465cb71e7a22e88eb4f6]) successfully deleted
I20260928 14:50:40.760696 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.765393 9813 ts_tablet_manager.cc:1918] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.765491 9813 log.cc:1196] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/11f9b039838a430eac3fd422f0f4d087
I20260928 14:50:40.765852 9813 ts_tablet_manager.cc:1939] T 11f9b039838a430eac3fd422f0f4d087 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.766583 9813 tablet_replica.cc:330] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.766748 9813 raft_consensus.cc:2229] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.766870 9813 raft_consensus.cc:2258] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.767472 9815 ts_tablet_manager.cc:1918] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.767549 9813 ts_tablet_manager.cc:1905] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.768882 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 11f9b039838a430eac3fd422f0f4d087 (table default.Table_e762fd7ab0074c308dc4407d3c3f70a9 [id=e249dfbd0f314fe7a4283f46d66dfd61]) successfully deleted
I20260928 14:50:40.769261 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d267fa0a698437986feb52cd9c15cc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2949cff5a7694015ad1708ed7fab3447) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.773202 9813 ts_tablet_manager.cc:1918] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.773372 9813 log.cc:1196] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cadfdf093ab04b61af441cff6c9c510b
I20260928 14:50:40.773653 9813 ts_tablet_manager.cc:1939] T cadfdf093ab04b61af441cff6c9c510b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.774398 9813 tablet_replica.cc:330] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.774552 9813 raft_consensus.cc:2229] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.774598 9815 log.cc:1196] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:40.774676 9813 raft_consensus.cc:2258] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.775178 9815 ts_tablet_manager.cc:1939] T 62d6975813b744fb80dcc432cec61cb4 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.775360 9813 ts_tablet_manager.cc:1905] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.776226 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cadfdf093ab04b61af441cff6c9c510b (table default.Table_ad76e04bff34480284586d17fd78ba4e [id=569a3c495e1c48a7b8924389a46e1402]) successfully deleted
I20260928 14:50:40.777890 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 62d6975813b744fb80dcc432cec61cb4 (table default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c [id=63833e63efa7423e9eabe903f17d5996]) successfully deleted
I20260928 14:50:40.778144 9815 tablet_replica.cc:330] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.778360 9815 raft_consensus.cc:2229] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.780721 9815 raft_consensus.cc:2258] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.781364 9813 ts_tablet_manager.cc:1918] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.781467 9813 log.cc:1196] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7ef356a4c9d34af4b300d38eab49a569
I20260928 14:50:40.781641 9815 ts_tablet_manager.cc:1905] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.781755 9813 ts_tablet_manager.cc:1939] T 7ef356a4c9d34af4b300d38eab49a569 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.783162 9813 tablet_replica.cc:330] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.783347 9813 raft_consensus.cc:2229] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.783474 9813 raft_consensus.cc:2258] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.784159 9813 ts_tablet_manager.cc:1905] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.784350 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7ef356a4c9d34af4b300d38eab49a569 (table default.Table_095d6dc7887348e1ab7bcb8be6278f3d [id=4a8fc144084248b4a52bfdd400caa86d]) successfully deleted
W20260928 14:50:40.784543 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0fd5bf5648c546ac9145328ff3e8b198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd5bf5648c546ac9145328ff3e8b198 already in progress: creating tablet
W20260928 14:50:40.784703 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6d2bd32270694ec2af95c7bf5b906b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2bd32270694ec2af95c7bf5b906b1b already in progress: creating tablet
W20260928 14:50:40.784825 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8fcc42af91c247b1b80059e95e3659cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fcc42af91c247b1b80059e95e3659cf already in progress: creating tablet
W20260928 14:50:40.784945 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5d08466aa7d54f12b137986258a6d174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d08466aa7d54f12b137986258a6d174 already in progress: creating tablet
W20260928 14:50:40.785068 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9ad13af827fd4a08b5bda4a53720c3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ad13af827fd4a08b5bda4a53720c3e4 already in progress: creating tablet
W20260928 14:50:40.785203 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d7cf2eb5b59649e099da1947c4ccf430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7cf2eb5b59649e099da1947c4ccf430 already in progress: creating tablet
I20260928 14:50:40.785475 10895 raft_consensus.cc:482] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.785600 10895 raft_consensus.cc:504] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.786082 10895 leader_election.cc:288] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.786551 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:40.787200 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:40.787744 9498 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:40.788228 9497 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.788302 9497 leader_election.cc:302] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.788697 10895 raft_consensus.cc:2726] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.790290 9855 tablet_bootstrap.cc:492] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.790477 9855 ts_tablet_manager.cc:1397] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260928 14:50:40.791247 9855 raft_consensus.cc:348] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.791504 9855 raft_consensus.cc:374] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.791594 9855 raft_consensus.cc:729] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.791859 9855 consensus_queue.cc:260] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.792555 9855 ts_tablet_manager.cc:1428] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:40.792805 9813 ts_tablet_manager.cc:1918] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.792934 9813 log.cc:1196] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/11714d0ca321429c95de223320794a0e
I20260928 14:50:40.793241 9813 ts_tablet_manager.cc:1939] T 11714d0ca321429c95de223320794a0e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.794030 9813 tablet_replica.cc:330] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.794272 9813 raft_consensus.cc:2229] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.794440 9813 raft_consensus.cc:2258] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.794538 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 11714d0ca321429c95de223320794a0e (table default.Table_fbd97ee29f194fc6b1d87ef35df81670 [id=4228cbe2481648bdbe6f725f72d6f3c5]) successfully deleted
I20260928 14:50:40.795168 9813 ts_tablet_manager.cc:1905] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.801201 9855 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.802951 9855 tablet_bootstrap.cc:654] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.803107 9813 ts_tablet_manager.cc:1918] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.803212 9813 log.cc:1196] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/a303792e4c804844bc6037fabb425be4
I20260928 14:50:40.803465 9813 ts_tablet_manager.cc:1939] T a303792e4c804844bc6037fabb425be4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.804193 9813 tablet_replica.cc:330] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.804309 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet a303792e4c804844bc6037fabb425be4 (table default.Table_39fb4e4216bf46188c6df0df4e908528 [id=6d447d56ce46413f934c0d407c8b7eb9]) successfully deleted
I20260928 14:50:40.804361 9813 raft_consensus.cc:2229] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.804474 9813 raft_consensus.cc:2258] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.805148 9813 ts_tablet_manager.cc:1905] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.808471 9815 ts_tablet_manager.cc:1918] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.808578 9815 log.cc:1196] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:40.808861 9815 ts_tablet_manager.cc:1939] T 52993ae8b63d4fbaa8cf38720af3dea5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.809769 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 52993ae8b63d4fbaa8cf38720af3dea5 (table default.Table_2969f92d404942518e3feadd54948444 [id=d19993a468fd4f7d994003f4977a1c59]) successfully deleted
I20260928 14:50:40.811455 9813 ts_tablet_manager.cc:1918] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.811573 9813 log.cc:1196] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/dfacaf069e3746aeb8ca11d95e65c5ea
I20260928 14:50:40.812300 9813 ts_tablet_manager.cc:1939] T dfacaf069e3746aeb8ca11d95e65c5ea P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.820225 9813 tablet_replica.cc:330] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.820425 9813 raft_consensus.cc:2229] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.820426 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet dfacaf069e3746aeb8ca11d95e65c5ea (table default.Table_85a8c601ea1f447bbb522d1548841757 [id=9292103511164a37a46f55dfa370d35c]) successfully deleted
I20260928 14:50:40.820552 9813 raft_consensus.cc:2258] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.821206 9813 ts_tablet_manager.cc:1905] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.826970 9813 ts_tablet_manager.cc:1918] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.827091 9813 log.cc:1196] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:40.827373 9813 ts_tablet_manager.cc:1939] T 86f11c5ca3154bac934cae3842f16de4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.828166 9813 tablet_replica.cc:330] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.828303 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 86f11c5ca3154bac934cae3842f16de4 (table default.Table_6b34a358cd1549abb1b21255b0d0edcf [id=b13813392d9f4fffa84000a459e046c9]) successfully deleted
I20260928 14:50:40.828343 9813 raft_consensus.cc:2229] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.828459 9813 raft_consensus.cc:2258] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.828895 10920 raft_consensus.cc:482] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.829000 10920 raft_consensus.cc:504] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.829110 9813 ts_tablet_manager.cc:1905] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.829551 10920 leader_election.cc:288] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:40.830101 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.836953 9813 ts_tablet_manager.cc:1918] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.837055 9813 log.cc:1196] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7d267fa0a698437986feb52cd9c15cc1
I20260928 14:50:40.837320 9813 ts_tablet_manager.cc:1939] T 7d267fa0a698437986feb52cd9c15cc1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.838073 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eb915b10e70840468170d6c85ffae469" } modify_external_catalogs: true
I20260928 14:50:40.838277 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eb915b10e70840468170d6c85ffae469" } modify_external_catalogs: true
I20260928 14:50:40.839397 9851 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.839537 9851 ts_tablet_manager.cc:1397] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
I20260928 14:50:40.839692 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7d267fa0a698437986feb52cd9c15cc1 (table default.Table_6e3a73ecfc16413ea124559696001ab6 [id=fd9ec5ab1ebe4cfa928b4cfe1241ef35]) successfully deleted
I20260928 14:50:40.840368 9851 raft_consensus.cc:348] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.840606 9851 raft_consensus.cc:374] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.840662 9851 raft_consensus.cc:729] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.840852 9851 consensus_queue.cc:260] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.844491 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50f7410dd549f399449487556f813d" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:40.844805 9851 ts_tablet_manager.cc:1428] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:40.847116 9360 leader_election.cc:302] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:40.847432 10920 raft_consensus.cc:2726] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.848209 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ed2b822b497a4466ba6ce258dbb3a135" } modify_external_catalogs: true
I20260928 14:50:40.848368 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ed2b822b497a4466ba6ce258dbb3a135" } modify_external_catalogs: true
I20260928 14:50:40.848881 9848 tablet_bootstrap.cc:492] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.848980 9848 ts_tablet_manager.cc:1397] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.145s user 0.013s sys 0.087s
I20260928 14:50:40.849560 9848 raft_consensus.cc:348] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.849728 9848 raft_consensus.cc:374] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.849768 9848 raft_consensus.cc:729] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.849866 9855 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.849858 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:40.849967 9855 ts_tablet_manager.cc:1397] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.005s
I20260928 14:50:40.849910 9848 consensus_queue.cc:260] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:40.850260 8952 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 consensus state has no leader
I20260928 14:50:40.850343 9848 ts_tablet_manager.cc:1428] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:40.850637 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f4696110aa04b4d98a90d7acf435e4d" } modify_external_catalogs: true
I20260928 14:50:40.850602 9855 raft_consensus.cc:348] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.850744 9848 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:40.850780 9855 raft_consensus.cc:374] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.850768 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4f4696110aa04b4d98a90d7acf435e4d" } modify_external_catalogs: true
I20260928 14:50:40.850826 9855 raft_consensus.cc:729] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.850994 9855 consensus_queue.cc:260] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.851914 9848 tablet_bootstrap.cc:654] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.852837 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a0ec01ddefa34c6f87a1ba767f50336f" } new_table_name: "default.Table_873b3a81bf8744d58006a5de41eecf57" modify_external_catalogs: true
I20260928 14:50:40.854596 9851 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.855988 9851 tablet_bootstrap.cc:654] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.856119 9855 ts_tablet_manager.cc:1428] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260928 14:50:40.859122 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 86f11c5ca3154bac934cae3842f16de4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.859627 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet ad844de91e4040c3a8ae4873c0fa6ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.859813 9813 tablet_replica.cc:330] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:40.859951 8940 catalog_manager.cc:4808] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 86f11c5ca3154bac934cae3842f16de4 because the tablet was not found. No further retry: Not found: Tablet not found: 86f11c5ca3154bac934cae3842f16de4
I20260928 14:50:40.859995 9813 raft_consensus.cc:2229] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.860076 9855 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.860116 9813 raft_consensus.cc:2258] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.860769 9813 ts_tablet_manager.cc:1905] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.861510 9855 tablet_bootstrap.cc:654] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.866652 9813 ts_tablet_manager.cc:1918] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.866760 9813 log.cc:1196] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ad844de91e4040c3a8ae4873c0fa6ba4
I20260928 14:50:40.869925 9813 ts_tablet_manager.cc:1939] T ad844de91e4040c3a8ae4873c0fa6ba4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.870793 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ad844de91e4040c3a8ae4873c0fa6ba4 (table default.Table_e4c780211fed497b923908fb5dda2c9e [id=94d075738ed047ebbf6366ea6c21895c]) successfully deleted
I20260928 14:50:40.887633 11091 tablet.cc:1722] T 8048f3de070f48f4ab8d08a35c727c8e P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.890868 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb09b496476948e2a4f3652c75800e36 consensus state has no leader
I20260928 14:50:40.894832 11092 tablet.cc:1722] T 8048f3de070f48f4ab8d08a35c727c8e P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.897841 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e4f703cc19c453cbc46432a4430a204 consensus state has no leader
I20260928 14:50:40.902806 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_365a675e1c6e411f8e2e632d45a8d948"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.903362 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_365a675e1c6e411f8e2e632d45a8d948 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.905215 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet befd032922a64c07b5beddc631ca22a3
I20260928 14:50:40.906534 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet befd032922a64c07b5beddc631ca22a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.907061 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet befd032922a64c07b5beddc631ca22a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.907946 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet befd032922a64c07b5beddc631ca22a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:40.908535 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet befd032922a64c07b5beddc631ca22a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet befd032922a64c07b5beddc631ca22a3 already in progress: creating tablet
W20260928 14:50:40.908851 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet befd032922a64c07b5beddc631ca22a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet befd032922a64c07b5beddc631ca22a3 already in progress: creating tablet
W20260928 14:50:40.910344 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet befd032922a64c07b5beddc631ca22a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet befd032922a64c07b5beddc631ca22a3 already in progress: creating tablet
I20260928 14:50:40.910876 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0f5bbd802e804ccd82f8c29e78c1b570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.911367 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f5bbd802e804ccd82f8c29e78c1b570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.916854 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 390f10fd4b5f42e182b686cc1ccefb26
I20260928 14:50:40.917791 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.918037 10895 raft_consensus.cc:482] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.918048 9815 tablet_replica.cc:330] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.918188 10895 raft_consensus.cc:504] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.918308 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.918504 9813 tablet_replica.cc:330] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:40.918497 9815 raft_consensus.cc:2229] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.918676 9813 raft_consensus.cc:2229] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.918697 9815 raft_consensus.cc:2258] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.918782 10895 leader_election.cc:288] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.918867 9813 raft_consensus.cc:2258] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.919247 9815 ts_tablet_manager.cc:1905] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.919292 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9afcc868244aeb830fae2735da28d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:40.919544 9813 ts_tablet_manager.cc:1905] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:40.919757 9498 leader_election.cc:341] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.923564 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e43b73b053d24ce8b18f98f8db76e366" } new_table_name: "default.Table_cc49a055388e414ab8c4f774ccb90d8c" modify_external_catalogs: true
I20260928 14:50:40.925696 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9afcc868244aeb830fae2735da28d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:40.926177 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 390f10fd4b5f42e182b686cc1ccefb26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.926404 9814 tablet_replica.cc:330] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:40.926589 9814 raft_consensus.cc:2229] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
W20260928 14:50:40.926703 9497 leader_election.cc:341] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.926817 9497 leader_election.cc:302] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.926923 9814 raft_consensus.cc:2258] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.927165 10895 raft_consensus.cc:2726] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.927435 9814 ts_tablet_manager.cc:1905] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:40.931001 9815 ts_tablet_manager.cc:1918] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:40.931140 9815 log.cc:1196] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/390f10fd4b5f42e182b686cc1ccefb26
I20260928 14:50:40.931494 9815 ts_tablet_manager.cc:1939] T 390f10fd4b5f42e182b686cc1ccefb26 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.935708 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet fbf7193095e54214a5b9241728239c8c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:40.937017 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e5ac853c5b6f4f9cb9de91e6aa448c75
W20260928 14:50:40.937101 9220 consensus_peers.cc:487] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:40.937708 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:40.937999 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:40.938177 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:40.940016 8956 master_service.cc:946] ReplaceTablet: received request to replace tablet e00bf3d07eeb42219d79326705b3e440 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:40.940466 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]) successfully deleted
I20260928 14:50:40.940821 9815 tablet_replica.cc:330] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:40.941037 9815 raft_consensus.cc:2229] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:40.941210 9815 raft_consensus.cc:2258] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:40.941704 9815 ts_tablet_manager.cc:1905] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:40.942977 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66096599d4c5458db2af10eb9bac947b consensus state has no leader
I20260928 14:50:40.943857 9814 ts_tablet_manager.cc:1918] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:40.943962 9814 log.cc:1196] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/390f10fd4b5f42e182b686cc1ccefb26
I20260928 14:50:40.944299 9814 ts_tablet_manager.cc:1939] T 390f10fd4b5f42e182b686cc1ccefb26 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:40.945145 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]) successfully deleted
I20260928 14:50:40.945395 9813 ts_tablet_manager.cc:1918] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:40.945490 9813 log.cc:1196] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/390f10fd4b5f42e182b686cc1ccefb26
I20260928 14:50:40.945815 9813 ts_tablet_manager.cc:1939] T 390f10fd4b5f42e182b686cc1ccefb26 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:40.946568 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 390f10fd4b5f42e182b686cc1ccefb26 (table default.Table_081cef36a86d487a87f4a9f1ecf6c8b3 [id=1f1e9534d0714b6fa3aa6cf1e25669ff]) successfully deleted
W20260928 14:50:40.946815 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5ac853c5b6f4f9cb9de91e6aa448c75 already in progress: creating tablet
I20260928 14:50:40.948266 11091 tablet.cc:1722] T 42f7fb96f92a4e35b8561832e1d812d8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:40.948414 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5ac853c5b6f4f9cb9de91e6aa448c75 already in progress: creating tablet
I20260928 14:50:40.948355 11092 tablet.cc:1722] T 42f7fb96f92a4e35b8561832e1d812d8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:40.951310 9848 tablet_bootstrap.cc:492] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:40.951433 9848 ts_tablet_manager.cc:1397] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.009s
I20260928 14:50:40.952054 9848 raft_consensus.cc:348] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.952262 9848 raft_consensus.cc:374] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.952312 9848 raft_consensus.cc:729] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.952482 9848 consensus_queue.cc:260] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.952946 9848 ts_tablet_manager.cc:1428] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:40.953516 9815 ts_tablet_manager.cc:1918] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:40.953647 9815 log.cc:1196] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e5ac853c5b6f4f9cb9de91e6aa448c75
I20260928 14:50:40.953943 9815 ts_tablet_manager.cc:1939] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:40.957819 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d102cb269e9f482c9f877dff8885cd60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:40.958091 9848 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:40.958336 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d102cb269e9f482c9f877dff8885cd60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.959465 9855 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.959591 9855 ts_tablet_manager.cc:1397] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.100s user 0.000s sys 0.003s
I20260928 14:50:40.959674 9848 tablet_bootstrap.cc:654] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.960222 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9ba2afa5ed7b4c7ea59ef904512529e9" } new_table_name: "default.Table_05cd4949a06e4b61818961daa08dd6e9" modify_external_catalogs: true
I20260928 14:50:40.961805 9851 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:40.962527 9855 raft_consensus.cc:348] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.963910 9855 raft_consensus.cc:374] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.964046 9855 raft_consensus.cc:729] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.964340 9855 consensus_queue.cc:260] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.967290 9855 ts_tablet_manager.cc:1428] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260928 14:50:40.967849 10982 raft_consensus.cc:482] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:40.967973 10982 raft_consensus.cc:504] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.968168 9855 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:40.968559 10982 leader_election.cc:288] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:40.968983 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b4b4c775fe4eacaaa557d4daa2a600" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:40.969506 9220 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:40.972543 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:40.973428 9855 tablet_bootstrap.cc:654] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.973295 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8c906a32eb8a4a9ba01333465d55e96a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.974102 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c906a32eb8a4a9ba01333465d55e96a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:40.975147 9219 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:40.975248 9219 leader_election.cc:302] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:40.975553 10982 raft_consensus.cc:2726] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:40.975881 9851 ts_tablet_manager.cc:1397] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.008s
I20260928 14:50:40.981474 9851 raft_consensus.cc:348] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.982082 9851 raft_consensus.cc:374] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.982265 9851 raft_consensus.cc:729] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.982537 9851 consensus_queue.cc:260] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:40.984273 9851 ts_tablet_manager.cc:1428] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260928 14:50:40.985438 9851 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:40.987661 9851 tablet_bootstrap.cc:654] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:40.989683 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (table default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]) successfully deleted
I20260928 14:50:40.991187 9855 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:40.991427 9855 ts_tablet_manager.cc:1397] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20260928 14:50:40.992340 9855 raft_consensus.cc:348] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.992614 9855 raft_consensus.cc:374] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:40.992560 8948 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:40.992748 9855 raft_consensus.cc:729] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:40.993029 9855 consensus_queue.cc:260] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:40.993312 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_56bcdd59329c4f14bc16e8fbbccc473b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:40.993858 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56bcdd59329c4f14bc16e8fbbccc473b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:40.996218 9855 ts_tablet_manager.cc:1428] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:40.996717 9855 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:41.000509 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e89370dcc9f645b5b585ba900c05821d consensus state has no leader
I20260928 14:50:41.000854 9855 tablet_bootstrap.cc:654] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.003481 9848 tablet_bootstrap.cc:492] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.003607 9848 ts_tablet_manager.cc:1397] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.002s
I20260928 14:50:41.003444 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f7b29b2be4fe487ca26ef324590e0a87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.004061 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b29b2be4fe487ca26ef324590e0a87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.004211 9848 raft_consensus.cc:348] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.004392 9848 raft_consensus.cc:374] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.004438 9848 raft_consensus.cc:729] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.004629 9848 consensus_queue.cc:260] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.007007 9848 ts_tablet_manager.cc:1428] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:41.009287 9848 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.009923 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fbf7193095e54214a5b9241728239c8c
I20260928 14:50:41.010303 8949 catalog_manager.cc:6565] ReplaceTablet: tablet fbf7193095e54214a5b9241728239c8c deleted and replaced by tablet 6cfe81624ecb41889dd2eeeaa5d0e771
I20260928 14:50:41.010725 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf7193095e54214a5b9241728239c8c with delete_type TABLET_DATA_DELETED (replaced by tablet 6cfe81624ecb41889dd2eeeaa5d0e771) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.011176 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf7193095e54214a5b9241728239c8c with delete_type TABLET_DATA_DELETED (replaced by tablet 6cfe81624ecb41889dd2eeeaa5d0e771) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.011854 10920 raft_consensus.cc:482] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.011969 10920 raft_consensus.cc:504] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.012478 10920 leader_election.cc:288] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:41.014441 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fbf7193095e54214a5b9241728239c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf7193095e54214a5b9241728239c8c already in progress: creating tablet
I20260928 14:50:41.015268 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.015769 11086 raft_consensus.cc:482] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.015957 11086 raft_consensus.cc:504] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.016593 11086 leader_election.cc:288] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.016652 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf7193095e54214a5b9241728239c8c with delete_type TABLET_DATA_DELETED (replaced by tablet 6cfe81624ecb41889dd2eeeaa5d0e771) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.017120 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet be232889594147bdbe2d4825c3e8c7d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.017318 9813 tablet_replica.cc:330] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:41.017478 9813 raft_consensus.cc:2229] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.017654 9813 raft_consensus.cc:2258] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.017632 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7376f56883dc4032b120cc4494fa8936" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.017968 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fbf7193095e54214a5b9241728239c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf7193095e54214a5b9241728239c8c already in progress: creating tablet
I20260928 14:50:41.017978 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7376f56883dc4032b120cc4494fa8936" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.018265 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8048f3de070f48f4ab8d08a35c727c8e" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:41.018471 9497 leader_election.cc:341] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.018677 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b2d1d9d89eea4bfab15897c49448c30e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.019186 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2d1d9d89eea4bfab15897c49448c30e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.020717 9848 tablet_bootstrap.cc:654] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:41.020692 9498 leader_election.cc:341] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.020798 9498 leader_election.cc:302] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.021131 10895 raft_consensus.cc:2726] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.021793 9813 ts_tablet_manager.cc:1905] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.022050 9360 leader_election.cc:302] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:41.022359 10920 raft_consensus.cc:2726] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:41.025147 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fbf7193095e54214a5b9241728239c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf7193095e54214a5b9241728239c8c already in progress: creating tablet
I20260928 14:50:41.026741 9855 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.026925 9855 ts_tablet_manager.cc:1397] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260928 14:50:41.027630 9855 raft_consensus.cc:348] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.028136 9855 raft_consensus.cc:374] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.028264 9855 raft_consensus.cc:729] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.028538 9855 consensus_queue.cc:260] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.028769 9813 ts_tablet_manager.cc:1918] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.028865 9813 log.cc:1196] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/be232889594147bdbe2d4825c3e8c7d0
I20260928 14:50:41.029124 9813 ts_tablet_manager.cc:1939] T be232889594147bdbe2d4825c3e8c7d0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:41.030043 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet be232889594147bdbe2d4825c3e8c7d0 (table default.Table_7bb67fe09d1544418318121e5efde0a0 [id=fa7396482f54455193f716a38798ca0f]) successfully deleted
W20260928 14:50:41.031179 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1fa3dda1beb4812b3e61e6a233f2aa5 consensus state has no leader
I20260928 14:50:41.035334 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f8d66cd6fbd648378a9cc5e211990b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.035571 9848 tablet_bootstrap.cc:492] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.035681 9848 ts_tablet_manager.cc:1397] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
W20260928 14:50:41.035835 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8d66cd6fbd648378a9cc5e211990b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.036185 9848 raft_consensus.cc:348] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.036351 9848 raft_consensus.cc:374] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.036391 9848 raft_consensus.cc:729] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.036542 9848 consensus_queue.cc:260] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.038828 9855 ts_tablet_manager.cc:1428] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:41.040197 9848 ts_tablet_manager.cc:1428] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:41.041790 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ffc5bee62845519a4b7ee8c914e70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.042152 9813 tablet_replica.cc:330] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:41.042317 9813 raft_consensus.cc:2229] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.042448 9813 raft_consensus.cc:2258] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.043978 9855 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.044750 9848 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.045755 9851 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.045892 9851 ts_tablet_manager.cc:1397] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.004s
I20260928 14:50:41.046916 9851 raft_consensus.cc:348] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.047026 9813 ts_tablet_manager.cc:1905] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.047128 9851 raft_consensus.cc:374] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.047259 9851 raft_consensus.cc:729] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.047557 9851 consensus_queue.cc:260] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.048050 9851 ts_tablet_manager.cc:1428] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:41.048621 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet eff9afcc868244aeb830fae2735da28d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:41.049013 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9621a96cd09542778ace154ae8deef0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.049172 9855 tablet_bootstrap.cc:654] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:41.049494 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9621a96cd09542778ace154ae8deef0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.050169 9851 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.054831 10982 raft_consensus.cc:482] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.054981 10982 raft_consensus.cc:504] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.055567 10982 leader_election.cc:288] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.055932 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56151b288b634d6bb0bc7113afa5fbaa" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.056772 9219 leader_election.cc:341] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 56151b288b634d6bb0bc7113afa5fbaa
W20260928 14:50:41.057161 9220 leader_election.cc:341] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.057248 9220 leader_election.cc:302] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.057617 10982 raft_consensus.cc:2726] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.059357 9813 ts_tablet_manager.cc:1918] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.060213 9848 tablet_bootstrap.cc:654] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.063156 9813 log.cc:1196] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/21ffc5bee62845519a4b7ee8c914e70d
I20260928 14:50:41.063526 9813 ts_tablet_manager.cc:1939] T 21ffc5bee62845519a4b7ee8c914e70d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:41.064064 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 21ffc5bee62845519a4b7ee8c914e70d (table default.Table_01fb8b545e2648849deb8c293b3b9cd6 [id=8aeb1610df884d82ac12f54569e7ed98]) successfully deleted
I20260928 14:50:41.065671 9851 tablet_bootstrap.cc:654] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.070838 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:41.072075 9851 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.072203 9851 ts_tablet_manager.cc:1397] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260928 14:50:41.072477 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:41.072562 9408 tablet_service.cc:1467] Processing CreateTablet for tablet d1babf69858147c4a0c13ede961c0506 (DEFAULT_TABLE table=default.Table_9213f41bf2e34deab11343f45fd4f5c5 [id=97f67c2ae795409c8b5833b0210df19e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.072695 8950 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 7376f56883dc4032b120cc4494fa8936 (table default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]). Expected version 2 got 0
I20260928 14:50:41.072929 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1babf69858147c4a0c13ede961c0506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.074291 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d193edcfa684b8795b084f3106903c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.074287 9851 raft_consensus.cc:348] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.074504 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b22c3f9578a464a96be0bac6127e56d with delete_type TABLET_DATA_DELETED (replaced by tablet b8738a1591f644758f44fc720fd694a3) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.074862 9815 tablet_replica.cc:330] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:41.075172 9815 raft_consensus.cc:2229] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.075430 9815 raft_consensus.cc:2258] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.079241 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:41.074471 9851 raft_consensus.cc:374] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.080116 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 75e82d8412c94d088a4df05739bb3565 (DEFAULT_TABLE table=default.Table_ecb662da254a4311ae02dbe6dc348eb3 [id=fff722d329d34f2487510988ca8fc00d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.080229 9851 raft_consensus.cc:729] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.080444 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e82d8412c94d088a4df05739bb3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.081108 9855 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.081287 9855 ts_tablet_manager.cc:1397] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.005s
I20260928 14:50:41.081864 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 (DEFAULT_TABLE table=default.Table_cda034a8dee64de597915af61ba85f2a [id=bb3e4e8e651b47208122292c55fdc4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.082214 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0728defd0fb44c37bb8aa1e18825f3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.082101 9855 raft_consensus.cc:348] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.082330 9855 raft_consensus.cc:374] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.082420 9855 raft_consensus.cc:729] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.082691 9855 consensus_queue.cc:260] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.083297 9248 tablet_service.cc:1467] Processing CreateTablet for tablet d1babf69858147c4a0c13ede961c0506 (DEFAULT_TABLE table=default.Table_9213f41bf2e34deab11343f45fd4f5c5 [id=97f67c2ae795409c8b5833b0210df19e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.083693 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1babf69858147c4a0c13ede961c0506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.084723 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d (DEFAULT_TABLE table=default.Table_13a7f2b04d9d4dccb7424df6a2e7bd3b [id=0172362e009649f18eddb63b41cbb042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.085068 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.085803 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 75e82d8412c94d088a4df05739bb3565 (DEFAULT_TABLE table=default.Table_ecb662da254a4311ae02dbe6dc348eb3 [id=fff722d329d34f2487510988ca8fc00d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.086138 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e82d8412c94d088a4df05739bb3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.086319 9855 ts_tablet_manager.cc:1428] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 14:50:41.086493 9851 consensus_queue.cc:260] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.086989 9851 ts_tablet_manager.cc:1428] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260928 14:50:41.087231 9851 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.088968 9851 tablet_bootstrap.cc:654] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.090658 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 58f6ede52c4d450482e2d46dabaa76e9 (DEFAULT_TABLE table=default.Table_cf758f80364047e68998c94adca18aa5 [id=c4ee2c7da667461b8a299fb398e691a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.090997 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f6ede52c4d450482e2d46dabaa76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.090993 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 1359e24362764fd2ac5c880b6ff7f423 (DEFAULT_TABLE table=default.Table_20bbbdb72afa4d21bac0c7114e28b3a2 [id=2a5330e0680d426fa7498fc2ab7ba877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.091041 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d (DEFAULT_TABLE table=default.Table_13a7f2b04d9d4dccb7424df6a2e7bd3b [id=0172362e009649f18eddb63b41cbb042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.091292 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1359e24362764fd2ac5c880b6ff7f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.091475 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 (DEFAULT_TABLE table=default.Table_cda034a8dee64de597915af61ba85f2a [id=bb3e4e8e651b47208122292c55fdc4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.091754 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0728defd0fb44c37bb8aa1e18825f3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.092341 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 (DEFAULT_TABLE table=default.Table_cda034a8dee64de597915af61ba85f2a [id=bb3e4e8e651b47208122292c55fdc4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.092782 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 1359e24362764fd2ac5c880b6ff7f423 (DEFAULT_TABLE table=default.Table_20bbbdb72afa4d21bac0c7114e28b3a2 [id=2a5330e0680d426fa7498fc2ab7ba877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.093300 9529 tablet_service.cc:1467] Processing CreateTablet for tablet d1babf69858147c4a0c13ede961c0506 (DEFAULT_TABLE table=default.Table_9213f41bf2e34deab11343f45fd4f5c5 [id=97f67c2ae795409c8b5833b0210df19e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.093626 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.090996 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 1359e24362764fd2ac5c880b6ff7f423 (DEFAULT_TABLE table=default.Table_20bbbdb72afa4d21bac0c7114e28b3a2 [id=2a5330e0680d426fa7498fc2ab7ba877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.094372 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1359e24362764fd2ac5c880b6ff7f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.095497 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 75e82d8412c94d088a4df05739bb3565 (DEFAULT_TABLE table=default.Table_ecb662da254a4311ae02dbe6dc348eb3 [id=fff722d329d34f2487510988ca8fc00d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.096208 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d (DEFAULT_TABLE table=default.Table_13a7f2b04d9d4dccb7424df6a2e7bd3b [id=0172362e009649f18eddb63b41cbb042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.097483 10895 raft_consensus.cc:482] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.097649 10895 raft_consensus.cc:504] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.098182 10895 leader_election.cc:288] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.098666 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.099161 9498 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.099488 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fb3d4a9426ed47abaf9d0e8f72d1c525" } new_table_name: "default.Table_68fddad60cad4d3ba0620b55723c9d48" modify_external_catalogs: true
I20260928 14:50:41.101156 9815 ts_tablet_manager.cc:1905] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.101152 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f26ec6b306324d17822c998752ec5188" } new_table_name: "default.Table_fca71ded3560464280ee9479a36ae856" modify_external_catalogs: true
I20260928 14:50:41.106045 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:41.107378 9497 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.107509 9497 leader_election.cc:302] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.107931 10895 raft_consensus.cc:2726] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.108479 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_985f91b220b847918afa77543b682d7c" } modify_external_catalogs: true
I20260928 14:50:41.108675 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0728defd0fb44c37bb8aa1e18825f3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.108691 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_985f91b220b847918afa77543b682d7c" } modify_external_catalogs: true
I20260928 14:50:41.109329 9396 tablet_service.cc:1467] Processing CreateTablet for tablet aa437acd904b417d81524383fc94646b (DEFAULT_TABLE table=default.Table_51baee36c72949b68d19be1ecd7bcb4a [id=ae11bf0102444a04bd97c64c2c9c28f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.109871 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa437acd904b417d81524383fc94646b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.110328 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 58f6ede52c4d450482e2d46dabaa76e9 (DEFAULT_TABLE table=default.Table_cf758f80364047e68998c94adca18aa5 [id=c4ee2c7da667461b8a299fb398e691a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.110678 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f6ede52c4d450482e2d46dabaa76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.110606 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 58f6ede52c4d450482e2d46dabaa76e9 (DEFAULT_TABLE table=default.Table_cf758f80364047e68998c94adca18aa5 [id=c4ee2c7da667461b8a299fb398e691a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.114856 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 5867660a149442e58396c3221ce8a6f4 (DEFAULT_TABLE table=default.Table_cb533e3a6e8f4101a37aa4ff6a0eaabb [id=3f976abaf4b24382bc9cc721edee8d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.114939 9549 tablet_service.cc:1467] Processing CreateTablet for tablet aa437acd904b417d81524383fc94646b (DEFAULT_TABLE table=default.Table_51baee36c72949b68d19be1ecd7bcb4a [id=ae11bf0102444a04bd97c64c2c9c28f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.115180 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5867660a149442e58396c3221ce8a6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.116206 9262 tablet_service.cc:1467] Processing CreateTablet for tablet aa437acd904b417d81524383fc94646b (DEFAULT_TABLE table=default.Table_51baee36c72949b68d19be1ecd7bcb4a [id=ae11bf0102444a04bd97c64c2c9c28f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.116817 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa437acd904b417d81524383fc94646b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.122457 9855 tablet_bootstrap.cc:492] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.124562 9403 tablet_service.cc:1467] Processing CreateTablet for tablet ce64a75bc55a4496bcd96070290a324c (DEFAULT_TABLE table=default.Table_6f24b3db09904135afe42a211b0442d6 [id=34005c0fde7d4c408ca6320de385d8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.124871 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce64a75bc55a4496bcd96070290a324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.125737 9535 tablet_service.cc:1467] Processing CreateTablet for tablet e138e7db93c94300ae4b4f622e3a91fd (DEFAULT_TABLE table=default.Table_2d13650c95104f90a749ad7de60fc641 [id=93be40e6b3194e049594c97ed0bb31aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.126133 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 5867660a149442e58396c3221ce8a6f4 (DEFAULT_TABLE table=default.Table_cb533e3a6e8f4101a37aa4ff6a0eaabb [id=3f976abaf4b24382bc9cc721edee8d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.131938 9390 tablet_service.cc:1467] Processing CreateTablet for tablet e138e7db93c94300ae4b4f622e3a91fd (DEFAULT_TABLE table=default.Table_2d13650c95104f90a749ad7de60fc641 [id=93be40e6b3194e049594c97ed0bb31aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.132076 9264 tablet_service.cc:1467] Processing CreateTablet for tablet ce64a75bc55a4496bcd96070290a324c (DEFAULT_TABLE table=default.Table_6f24b3db09904135afe42a211b0442d6 [id=34005c0fde7d4c408ca6320de385d8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.132385 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce64a75bc55a4496bcd96070290a324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.133097 9396 tablet_service.cc:1467] Processing CreateTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d (DEFAULT_TABLE table=default.Table_fd673ea8aa19429c98194c13ed814ae8 [id=fdd1fc6b75a54812b24e4a54a191ca89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.133697 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 7376f56883dc4032b120cc4494fa8936 (table default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]). Expected version 2 got 0
I20260928 14:50:41.133494 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e138e7db93c94300ae4b4f622e3a91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.136639 10982 raft_consensus.cc:482] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.136761 10982 raft_consensus.cc:504] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.137194 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7f3aeffb2a4a9683b728e17aa28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.137356 10982 leader_election.cc:288] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:41.138304 9219 leader_election.cc:341] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ea7b363d546c45ceb3efb9352cf184f4
I20260928 14:50:41.138530 10895 raft_consensus.cc:482] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.138666 10895 raft_consensus.cc:504] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.139173 10895 leader_election.cc:288] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.139573 9851 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.139751 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ad7685ece44665896f687697bddccf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.139846 9851 ts_tablet_manager.cc:1397] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.001s
W20260928 14:50:41.140270 9498 leader_election.cc:341] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.140427 9408 tablet_service.cc:1467] Processing CreateTablet for tablet e6ce760698f14e12bc671edce34c0877 (DEFAULT_TABLE table=default.Table_6667c748d3ab46df824edf775ab65c38 [id=af76a06e86db4913a36cf32642e94e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.140704 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ce760698f14e12bc671edce34c0877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.141705 9851 raft_consensus.cc:348] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.142201 9851 raft_consensus.cc:374] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.142349 9851 raft_consensus.cc:729] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.144259 9531 tablet_service.cc:1467] Processing CreateTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d (DEFAULT_TABLE table=default.Table_fd673ea8aa19429c98194c13ed814ae8 [id=fdd1fc6b75a54812b24e4a54a191ca89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.144284 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ad7685ece44665896f687697bddccf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.144452 9538 tablet_service.cc:1467] Processing CreateTablet for tablet ce64a75bc55a4496bcd96070290a324c (DEFAULT_TABLE table=default.Table_6f24b3db09904135afe42a211b0442d6 [id=34005c0fde7d4c408ca6320de385d8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.143267 9851 consensus_queue.cc:260] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.145560 9848 tablet_bootstrap.cc:492] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.145772 9848 ts_tablet_manager.cc:1397] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.000s
I20260928 14:50:41.146852 9848 raft_consensus.cc:348] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.147176 9848 raft_consensus.cc:374] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.147290 9848 raft_consensus.cc:729] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.147550 9848 consensus_queue.cc:260] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.147943 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_deed66b243364250aaf9cb96c87c879f" } modify_external_catalogs: true
I20260928 14:50:41.148162 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_deed66b243364250aaf9cb96c87c879f" } modify_external_catalogs: true
I20260928 14:50:41.148334 9848 ts_tablet_manager.cc:1428] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:41.150713 9848 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.151721 9257 tablet_service.cc:1467] Processing CreateTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d (DEFAULT_TABLE table=default.Table_fd673ea8aa19429c98194c13ed814ae8 [id=fdd1fc6b75a54812b24e4a54a191ca89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.152069 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7f3aeffb2a4a9683b728e17aa28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.153225 9848 tablet_bootstrap.cc:654] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.154732 9425 raft_consensus.cc:3037] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.155123 9851 ts_tablet_manager.cc:1428] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260928 14:50:41.155848 9403 tablet_service.cc:1467] Processing CreateTablet for tablet e29b60b66bce4f328c10560112c0d28c (DEFAULT_TABLE table=default.Table_f23435e718764568affacdb5f1a5fa0b [id=69c28f2c81534cdd8a49d2bb885723b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.154904 9262 tablet_service.cc:1467] Processing CreateTablet for tablet e6ce760698f14e12bc671edce34c0877 (DEFAULT_TABLE table=default.Table_6667c748d3ab46df824edf775ab65c38 [id=af76a06e86db4913a36cf32642e94e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.156445 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29b60b66bce4f328c10560112c0d28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.159162 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea7b363d546c45ceb3efb9352cf184f4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.159396 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ce760698f14e12bc671edce34c0877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.158802 9851 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.164803 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d9b15696059a4e5397b27d343b448e62 (DEFAULT_TABLE table=default.Table_dd63720b8d7f42b98b0b3fc813207cf1 [id=a4a37142b81d4f2db20678e0f473b13d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.164842 9497 leader_election.cc:341] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.164877 9545 tablet_service.cc:1467] Processing CreateTablet for tablet e6ce760698f14e12bc671edce34c0877 (DEFAULT_TABLE table=default.Table_6667c748d3ab46df824edf775ab65c38 [id=af76a06e86db4913a36cf32642e94e18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.165113 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9b15696059a4e5397b27d343b448e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.164942 9497 leader_election.cc:302] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.165665 10895 raft_consensus.cc:2726] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.166298 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6762e5eabfad4539af773bee85caf7af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.166821 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6762e5eabfad4539af773bee85caf7af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:41.166706 9220 leader_election.cc:341] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.167495 9533 tablet_service.cc:1467] Processing CreateTablet for tablet e29b60b66bce4f328c10560112c0d28c (DEFAULT_TABLE table=default.Table_f23435e718764568affacdb5f1a5fa0b [id=69c28f2c81534cdd8a49d2bb885723b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.166970 9220 leader_election.cc:302] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.169553 10982 raft_consensus.cc:2726] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.171808 9257 tablet_service.cc:1467] Processing CreateTablet for tablet e29b60b66bce4f328c10560112c0d28c (DEFAULT_TABLE table=default.Table_f23435e718764568affacdb5f1a5fa0b [id=69c28f2c81534cdd8a49d2bb885723b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.174387 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 5867660a149442e58396c3221ce8a6f4 (DEFAULT_TABLE table=default.Table_cb533e3a6e8f4101a37aa4ff6a0eaabb [id=3f976abaf4b24382bc9cc721edee8d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.177897 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29b60b66bce4f328c10560112c0d28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.178455 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0d6ff1371ac546718b42d2ebc78d5ea7
I20260928 14:50:41.179785 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.180819 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.181851 10895 raft_consensus.cc:482] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:41.181830 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6ff1371ac546718b42d2ebc78d5ea7 already in progress: creating tablet
I20260928 14:50:41.181972 10895 raft_consensus.cc:504] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.182097 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7a261ccd5aba4972bf333e1e56b99003" } modify_external_catalogs: true
I20260928 14:50:41.182302 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7a261ccd5aba4972bf333e1e56b99003" } modify_external_catalogs: true
I20260928 14:50:41.182524 10895 leader_election.cc:288] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.183059 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b92039b9a484a768efa3714b58248ef" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.183553 9498 leader_election.cc:341] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.184355 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b92039b9a484a768efa3714b58248ef" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:41.185360 9497 leader_election.cc:341] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.185487 9497 leader_election.cc:302] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.185938 10895 raft_consensus.cc:2726] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.185860 9851 tablet_bootstrap.cc:654] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.188417 9546 tablet_service.cc:1467] Processing CreateTablet for tablet d9b15696059a4e5397b27d343b448e62 (DEFAULT_TABLE table=default.Table_dd63720b8d7f42b98b0b3fc813207cf1 [id=a4a37142b81d4f2db20678e0f473b13d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.184532 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.189167 9255 tablet_service.cc:1467] Processing CreateTablet for tablet d9b15696059a4e5397b27d343b448e62 (DEFAULT_TABLE table=default.Table_dd63720b8d7f42b98b0b3fc813207cf1 [id=a4a37142b81d4f2db20678e0f473b13d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.190560 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6ff1371ac546718b42d2ebc78d5ea7 already in progress: creating tablet
I20260928 14:50:41.191462 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5867660a149442e58396c3221ce8a6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.196100 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c510694f8a28461f9d7f3b420c112456 (DEFAULT_TABLE table=default.Table_985f91b220b847918afa77543b682d7c [id=26f33322beea47228968b407cd63c0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.196888 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c510694f8a28461f9d7f3b420c112456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.194103 9248 tablet_service.cc:1467] Processing CreateTablet for tablet e138e7db93c94300ae4b4f622e3a91fd (DEFAULT_TABLE table=default.Table_2d13650c95104f90a749ad7de60fc641 [id=93be40e6b3194e049594c97ed0bb31aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.197108 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 873469257ed14808be231b92f3149642
I20260928 14:50:41.198041 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 873469257ed14808be231b92f3149642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.198573 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 873469257ed14808be231b92f3149642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:41.199016 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 873469257ed14808be231b92f3149642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 873469257ed14808be231b92f3149642 already in progress: creating tablet
W20260928 14:50:41.199549 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 873469257ed14808be231b92f3149642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 873469257ed14808be231b92f3149642 already in progress: creating tablet
I20260928 14:50:41.199717 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 873469257ed14808be231b92f3149642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.201119 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7eb037389ef54e5f97821cf8134be4ab" } new_table_name: "default.Table_51a8abb8f77e4a418a85f6114687b694" modify_external_catalogs: true
I20260928 14:50:41.201139 10982 consensus_queue.cc:1035] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:41.204681 10816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 14:50:41.213414 9530 tablet_service.cc:1467] Processing CreateTablet for tablet c510694f8a28461f9d7f3b420c112456 (DEFAULT_TABLE table=default.Table_985f91b220b847918afa77543b682d7c [id=26f33322beea47228968b407cd63c0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.214555 9249 tablet_service.cc:1467] Processing CreateTablet for tablet c510694f8a28461f9d7f3b420c112456 (DEFAULT_TABLE table=default.Table_985f91b220b847918afa77543b682d7c [id=26f33322beea47228968b407cd63c0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.215354 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet eff9afcc868244aeb830fae2735da28d
I20260928 14:50:41.215838 8955 catalog_manager.cc:6565] ReplaceTablet: tablet eff9afcc868244aeb830fae2735da28d deleted and replaced by tablet 9e20e581a30e46889dd4c4d358d09c88
I20260928 14:50:41.216157 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet eff9afcc868244aeb830fae2735da28d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e20e581a30e46889dd4c4d358d09c88) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:41.217294 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet eff9afcc868244aeb830fae2735da28d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eff9afcc868244aeb830fae2735da28d already in progress: creating tablet
I20260928 14:50:41.217973 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet eff9afcc868244aeb830fae2735da28d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e20e581a30e46889dd4c4d358d09c88) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.219877 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6d551c06d8bf4d97a6a09ba38546de30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.220530 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d551c06d8bf4d97a6a09ba38546de30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.224733 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet eff9afcc868244aeb830fae2735da28d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e20e581a30e46889dd4c4d358d09c88) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:41.226780 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet eff9afcc868244aeb830fae2735da28d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eff9afcc868244aeb830fae2735da28d already in progress: creating tablet
I20260928 14:50:41.226747 9851 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.226971 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c510694f8a28461f9d7f3b420c112456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.227119 9851 ts_tablet_manager.cc:1397] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.000s
I20260928 14:50:41.231390 9851 raft_consensus.cc:348] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.232261 9851 raft_consensus.cc:374] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.232478 9851 raft_consensus.cc:729] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.228492 10816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 14:50:41.232577 9815 ts_tablet_manager.cc:1918] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.233425 9851 consensus_queue.cc:260] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.239126 11092 tablet.cc:1722] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.238370 11091 tablet.cc:1722] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.239789 10816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 14:50:41.234584 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e138e7db93c94300ae4b4f622e3a91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.242267 9815 log.cc:1196] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6d193edcfa684b8795b084f3106903c5
I20260928 14:50:41.245080 9851 ts_tablet_manager.cc:1428] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260928 14:50:41.249711 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa437acd904b417d81524383fc94646b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.249926 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d768ad9006a4a4ab9dc3fa5769ad30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.250099 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e82d8412c94d088a4df05739bb3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.250357 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9b15696059a4e5397b27d343b448e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.250722 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce64a75bc55a4496bcd96070290a324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.250989 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c510694f8a28461f9d7f3b420c112456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.251423 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7f3aeffb2a4a9683b728e17aa28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.251551 9855 tablet_bootstrap.cc:654] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.252239 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ce760698f14e12bc671edce34c0877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.257464 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29b60b66bce4f328c10560112c0d28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.257660 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1359e24362764fd2ac5c880b6ff7f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.262274 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5867660a149442e58396c3221ce8a6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.266110 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1babf69858147c4a0c13ede961c0506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.267963 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e138e7db93c94300ae4b4f622e3a91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.269629 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f6ede52c4d450482e2d46dabaa76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.271699 9851 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.271701 9848 tablet_bootstrap.cc:492] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.272231 9848 ts_tablet_manager.cc:1397] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.122s user 0.002s sys 0.003s
I20260928 14:50:41.281781 10906 raft_consensus.cc:482] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.281903 10906 raft_consensus.cc:504] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.282542 10906 leader_election.cc:288] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.283234 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:41.283420 9568 raft_consensus.cc:2454] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:41.283926 9219 leader_election.cc:302] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:41.284246 10906 raft_consensus.cc:2781] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:41.284315 10906 raft_consensus.cc:482] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:41.284369 10906 raft_consensus.cc:3037] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:41.284633 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9efbbfe864d448ccb6b5e7cddfc8e702 consensus state has no leader
I20260928 14:50:41.284837 9851 tablet_bootstrap.cc:654] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.285557 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7921bc68641f4c9f8729326915f0fd0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.286365 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7921bc68641f4c9f8729326915f0fd0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.287199 10906 raft_consensus.cc:504] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.287468 9855 tablet_bootstrap.cc:492] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.287616 9855 ts_tablet_manager.cc:1397] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.166s user 0.010s sys 0.007s
I20260928 14:50:41.287732 10906 leader_election.cc:288] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.282408 9848 raft_consensus.cc:348] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.288439 9848 raft_consensus.cc:374] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.288345 9855 raft_consensus.cc:348] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.288509 9848 raft_consensus.cc:729] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.288539 9855 raft_consensus.cc:374] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.288589 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:41.288766 9568 raft_consensus.cc:3037] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.288724 9848 consensus_queue.cc:260] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.291319 9568 raft_consensus.cc:2454] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:41.292472 10920 raft_consensus.cc:482] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.292583 10920 raft_consensus.cc:504] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.293054 10920 leader_election.cc:288] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.293689 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.294215 9851 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.294341 9851 ts_tablet_manager.cc:1397] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20260928 14:50:41.294878 9219 leader_election.cc:302] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:41.294976 9851 raft_consensus.cc:348] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.295212 9851 raft_consensus.cc:374] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.295264 9851 raft_consensus.cc:729] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.295445 9851 consensus_queue.cc:260] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.295751 10975 raft_consensus.cc:2781] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:41.295750 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a08d91a06ca4effbc8fc4e83d88fe93" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:41.295867 10975 raft_consensus.cc:686] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:41.295984 9851 ts_tablet_manager.cc:1428] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:41.296067 10975 consensus_queue.cc:237] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.296260 9851 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.296295 9360 leader_election.cc:302] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:41.296638 10920 raft_consensus.cc:2726] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.297659 9851 tablet_bootstrap.cc:654] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.288589 9855 raft_consensus.cc:729] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.300999 9855 consensus_queue.cc:260] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.302341 9855 ts_tablet_manager.cc:1428] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260928 14:50:41.303213 9855 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.304422 9855 tablet_bootstrap.cc:654] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:41.307821 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96e5111ae94740feb9dd57c7f4f12b2c consensus state has no leader
I20260928 14:50:41.308043 9422 raft_consensus.cc:3037] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.308216 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_96b6e8f2c5cd403da0aeaae9a7daba11" } new_table_name: "default.Table_bdefeb6ebf894943b10200ce3517f6c2" modify_external_catalogs: true
I20260928 14:50:41.309408 8950 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30] alter complete (version 2)
I20260928 14:50:41.317415 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet c510694f8a28461f9d7f3b420c112456
I20260928 14:50:41.318222 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e18a59d02d3441e1bc6f6704a4f9d67b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.317691 11117 tablet.cc:1722] T 8048f3de070f48f4ab8d08a35c727c8e P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:41.318843 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e18a59d02d3441e1bc6f6704a4f9d67b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.320972 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet c510694f8a28461f9d7f3b420c112456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.321605 10975 consensus_queue.cc:1035] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:41.321955 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet c510694f8a28461f9d7f3b420c112456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c510694f8a28461f9d7f3b420c112456 already in progress: creating tablet
I20260928 14:50:41.325675 11117 tablet.cc:1722] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.331107 9851 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.331224 9851 ts_tablet_manager.cc:1397] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.004s
I20260928 14:50:41.331848 9851 raft_consensus.cc:348] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.332032 9851 raft_consensus.cc:374] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.332078 9851 raft_consensus.cc:729] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.332232 9851 consensus_queue.cc:260] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.332652 9851 ts_tablet_manager.cc:1428] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260928 14:50:41.332873 9851 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.334133 9851 tablet_bootstrap.cc:654] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.336374 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.336802 10906 raft_consensus.cc:482] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.337836 10906 raft_consensus.cc:504] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:41.338009 8940 consensus_peers.cc:487] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656 -> Peer 8d70b1b045bd4ec4b74be2dc2364ecba (127.8.181.61:41417): Couldn't send request to peer 8d70b1b045bd4ec4b74be2dc2364ecba. Status: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 14:50:41.338359 10906 leader_election.cc:288] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.339670 8949 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_6c6af3e87d464c9092a434bb1e6be6f1 [id=82ac2d539ff5441d90b267e47f95ce96] alter complete (version 2)
I20260928 14:50:41.340989 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bc3579d72196492f94142c12326547da" } new_table_name: "default.Table_c328ffbfb1a84325adc8c65610601bf5" modify_external_catalogs: true
I20260928 14:50:41.342486 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a1a4a02d7dc24b6c98671ec33ea09688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.343190 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1a4a02d7dc24b6c98671ec33ea09688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.345834 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 514630efd793439fb757ab7f48c93198
I20260928 14:50:41.346621 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d57b7d81e0b6433189e5a27563cb7f4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.347270 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d57b7d81e0b6433189e5a27563cb7f4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:41.350003 9219 leader_election.cc:341] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:41.336663 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e325cbe459440cfa0f3cf9fd026cbb2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:41.337407 9426 raft_consensus.cc:3037] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.349018 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 514630efd793439fb757ab7f48c93198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.350777 9851 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.350886 9851 ts_tablet_manager.cc:1397] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.005s
I20260928 14:50:41.351526 9851 raft_consensus.cc:348] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.351764 9851 raft_consensus.cc:374] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.351826 9851 raft_consensus.cc:729] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:41.351815 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 514630efd793439fb757ab7f48c93198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514630efd793439fb757ab7f48c93198 already in progress: creating tablet
I20260928 14:50:41.352043 9851 consensus_queue.cc:260] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.352635 9851 ts_tablet_manager.cc:1428] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:41.352913 9851 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.355034 9851 tablet_bootstrap.cc:654] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.359149 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet c510694f8a28461f9d7f3b420c112456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.364012 9851 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.364151 9851 ts_tablet_manager.cc:1397] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260928 14:50:41.306653 9815 ts_tablet_manager.cc:1939] T 6d193edcfa684b8795b084f3106903c5 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:41.318233 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet c510694f8a28461f9d7f3b420c112456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.340914 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.340999 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 66772fac8b3747f0983562195abcc64e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.341096 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.346920 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 514630efd793439fb757ab7f48c93198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.349449 10895 raft_consensus.cc:482] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.365736 10895 raft_consensus.cc:504] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.366117 9851 raft_consensus.cc:348] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.366302 9851 raft_consensus.cc:374] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.366359 9851 raft_consensus.cc:729] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.366528 9851 consensus_queue.cc:260] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.367033 9851 ts_tablet_manager.cc:1428] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:41.367285 9851 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.367050 10895 leader_election.cc:288] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.368028 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:41.368600 9497 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.368952 10895 raft_consensus.cc:482] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.369261 9851 tablet_bootstrap.cc:654] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.369161 10895 raft_consensus.cc:504] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.370339 10895 leader_election.cc:288] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.370540 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:41.371687 9220 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:41.371948 9220 leader_election.cc:341] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:41.372349 9497 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.373139 9848 ts_tablet_manager.cc:1428] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.101s user 0.002s sys 0.002s
I20260928 14:50:41.373281 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 514630efd793439fb757ab7f48c93198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.373410 9848 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.372558 10982 consensus_queue.cc:1035] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 14:50:41.374441 8939 catalog_manager.cc:4808] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet c510694f8a28461f9d7f3b420c112456 because the tablet was not found. No further retry: Not found: Tablet not found: c510694f8a28461f9d7f3b420c112456
W20260928 14:50:41.374714 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 514630efd793439fb757ab7f48c93198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514630efd793439fb757ab7f48c93198 already in progress: creating tablet
I20260928 14:50:41.376008 9848 tablet_bootstrap.cc:654] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.377039 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.377916 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.378469 9498 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:41.378769 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24f53d04326f4e639be23564563034e0 consensus state has no leader
I20260928 14:50:41.379160 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3913883ec5c147228a2fd6f88cd71bbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.379680 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3913883ec5c147228a2fd6f88cd71bbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.379930 9498 leader_election.cc:302] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:41.380275 9498 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.380376 9498 leader_election.cc:302] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.380749 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ca2f614f5c964581ba64d31f0564f0f9
I20260928 14:50:41.381371 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_901e0bed8c684dc280db304a5b7ff2e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.381850 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_901e0bed8c684dc280db304a5b7ff2e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.382051 11086 raft_consensus.cc:2726] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.382191 11086 raft_consensus.cc:2726] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.383141 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:41.383718 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ca2f614f5c964581ba64d31f0564f0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca2f614f5c964581ba64d31f0564f0f9 already in progress: creating tablet
I20260928 14:50:41.388303 9851 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.388370 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.388638 9814 tablet_replica.cc:330] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.388813 9814 raft_consensus.cc:2229] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.388931 9814 raft_consensus.cc:2258] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.389237 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.389619 9814 ts_tablet_manager.cc:1905] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.394408 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_614ce0085880408f95148c5cd1d4bdf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.397504 9855 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.398330 9855 ts_tablet_manager.cc:1397] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.001s
I20260928 14:50:41.399909 9814 ts_tablet_manager.cc:1918] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.401157 9855 raft_consensus.cc:348] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.401463 9855 raft_consensus.cc:374] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.401598 9855 raft_consensus.cc:729] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.401865 9855 consensus_queue.cc:260] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.402748 9855 ts_tablet_manager.cc:1428] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:41.403060 9855 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.402151 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet ca2f614f5c964581ba64d31f0564f0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.404678 9814 log.cc:1196] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/56151b288b634d6bb0bc7113afa5fbaa
I20260928 14:50:41.404664 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4153f81ed6014b388a2fa418d74e21a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.404961 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5ad3ee185f47c3b8b3deb4ac354f51" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.405270 9814 ts_tablet_manager.cc:1939] T 56151b288b634d6bb0bc7113afa5fbaa P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:41.406369 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 56151b288b634d6bb0bc7113afa5fbaa (table default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]) successfully deleted
W20260928 14:50:41.407806 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_614ce0085880408f95148c5cd1d4bdf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.408030 10895 raft_consensus.cc:482] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:41.408035 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ca2f614f5c964581ba64d31f0564f0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca2f614f5c964581ba64d31f0564f0f9 already in progress: creating tablet
I20260928 14:50:41.408140 10895 raft_consensus.cc:504] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:41.408912 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4153f81ed6014b388a2fa418d74e21a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.409243 10895 leader_election.cc:288] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.409739 9855 tablet_bootstrap.cc:654] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.409699 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.410199 9498 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.406839 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.388423 9851 ts_tablet_manager.cc:1397] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.004s
I20260928 14:50:41.411675 9814 tablet_replica.cc:330] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.411973 9814 raft_consensus.cc:2229] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.412160 9814 raft_consensus.cc:2258] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.412148 9851 raft_consensus.cc:348] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.412352 9851 raft_consensus.cc:374] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.412417 9851 raft_consensus.cc:729] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.412602 9851 consensus_queue.cc:260] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:41.412932 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cc42a43c9d0483f846a7f11ff1554fe consensus state has no leader
I20260928 14:50:41.412958 9814 ts_tablet_manager.cc:1905] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:41.407514 9220 leader_election.cc:341] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.408960 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.413540 9220 leader_election.cc:302] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.413789 11122 raft_consensus.cc:2726] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:41.413954 9497 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.414054 9497 leader_election.cc:302] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.413085 9851 ts_tablet_manager.cc:1428] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:41.414412 9851 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.416301 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2378f0131076405ab6f9ad2247f22c2b" } modify_external_catalogs: true
I20260928 14:50:41.416566 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2378f0131076405ab6f9ad2247f22c2b" } modify_external_catalogs: true
I20260928 14:50:41.416785 9851 tablet_bootstrap.cc:654] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.424350 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7d607b7787a24d45ab4b4132688daf5f" } modify_external_catalogs: true
I20260928 14:50:41.424708 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7d607b7787a24d45ab4b4132688daf5f" } modify_external_catalogs: true
I20260928 14:50:41.430061 9851 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.430181 9851 ts_tablet_manager.cc:1397] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260928 14:50:41.430871 9851 raft_consensus.cc:348] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.431058 9851 raft_consensus.cc:374] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.431118 9851 raft_consensus.cc:729] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.431293 9851 consensus_queue.cc:260] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.434122 9848 tablet_bootstrap.cc:492] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.434285 9851 ts_tablet_manager.cc:1428] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:41.434283 9848 ts_tablet_manager.cc:1397] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.000s
I20260928 14:50:41.434523 9851 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.435014 9848 raft_consensus.cc:348] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.435267 9848 raft_consensus.cc:374] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.435374 9848 raft_consensus.cc:729] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.435715 9851 tablet_bootstrap.cc:654] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.435649 9848 consensus_queue.cc:260] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.436362 9848 ts_tablet_manager.cc:1428] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:41.436775 9848 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:41.445612 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2ef75af63c84656b0e308b0df621c98 consensus state has no leader
I20260928 14:50:41.424481 10895 raft_consensus.cc:2726] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.449602 9851 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.449719 9851 ts_tablet_manager.cc:1397] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260928 14:50:41.450246 9851 raft_consensus.cc:348] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.452488 9851 raft_consensus.cc:374] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.452603 9851 raft_consensus.cc:729] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.452805 9851 consensus_queue.cc:260] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.456097 9851 ts_tablet_manager.cc:1428] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:41.456444 9851 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.461916 9851 tablet_bootstrap.cc:654] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.465087 10895 raft_consensus.cc:482] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.465353 10895 raft_consensus.cc:504] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.466451 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66772fac8b3747f0983562195abcc64e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:41.467159 9497 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.467514 10895 leader_election.cc:288] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.468158 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66772fac8b3747f0983562195abcc64e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.469158 9498 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.469378 9498 leader_election.cc:302] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.471395 10895 raft_consensus.cc:2726] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.472214 9422 raft_consensus.cc:3037] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.474225 9851 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.474347 9851 ts_tablet_manager.cc:1397] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260928 14:50:41.477596 9851 raft_consensus.cc:348] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.477789 9851 raft_consensus.cc:374] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.477844 9851 raft_consensus.cc:729] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.478377 9851 consensus_queue.cc:260] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.478906 9851 ts_tablet_manager.cc:1428] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:41.479166 9851 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.479514 11091 tablet.cc:1722] T b1df25948af14998a26b36bb5b466a1e P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.481424 11092 tablet.cc:1722] T b1df25948af14998a26b36bb5b466a1e P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.482861 9851 tablet_bootstrap.cc:654] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.484122 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9b15696059a4e5397b27d343b448e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.489061 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ce86cfe203734bd4bd139c7bf581ac85" } new_table_name: "default.Table_1e632aeda14542fe8c699a2695560792" modify_external_catalogs: true
I20260928 14:50:41.496649 9851 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.496770 9851 ts_tablet_manager.cc:1397] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260928 14:50:41.497406 9851 raft_consensus.cc:348] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.497620 9851 raft_consensus.cc:374] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.497673 9851 raft_consensus.cc:729] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.497834 9851 consensus_queue.cc:260] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.498317 9851 ts_tablet_manager.cc:1428] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:41.498550 9851 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.506184 8956 catalog_manager.cc:5495] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:41.506651 8956 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:41.508023 9402 tablet_service.cc:1467] Processing CreateTablet for tablet cc0af0c3fc1c46489904acc70707937b (DEFAULT_TABLE table=default.Table_f8d66cd6fbd648378a9cc5e211990b8d [id=4413b49e88be41e595238c4e1482423d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.508383 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0af0c3fc1c46489904acc70707937b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.508859 9851 tablet_bootstrap.cc:654] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.509579 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6d193edcfa684b8795b084f3106903c5 (table default.Table_7b0fb0bac48645b68ed77a4a2605c08b [id=02744da757694610abd1cde1b4d28fb6]) successfully deleted
I20260928 14:50:41.510326 9248 tablet_service.cc:1467] Processing CreateTablet for tablet ac3269b07250416d98493f5d33f59210 (DEFAULT_TABLE table=default.Table_f7b29b2be4fe487ca26ef324590e0a87 [id=d16f2f3a45454e1d8271a3023bf61563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.510692 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3269b07250416d98493f5d33f59210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.512028 9264 tablet_service.cc:1467] Processing CreateTablet for tablet cc0af0c3fc1c46489904acc70707937b (DEFAULT_TABLE table=default.Table_f8d66cd6fbd648378a9cc5e211990b8d [id=4413b49e88be41e595238c4e1482423d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.512422 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0af0c3fc1c46489904acc70707937b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.513789 9408 tablet_service.cc:1467] Processing CreateTablet for tablet ac3269b07250416d98493f5d33f59210 (DEFAULT_TABLE table=default.Table_f7b29b2be4fe487ca26ef324590e0a87 [id=d16f2f3a45454e1d8271a3023bf61563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.514144 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3269b07250416d98493f5d33f59210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.514451 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 573cd4dd48474eb7ad518a19b214b931 (DEFAULT_TABLE table=default.Table_8c906a32eb8a4a9ba01333465d55e96a [id=7c10261b48fc4c0ca11f3b902bff0961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.514760 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573cd4dd48474eb7ad518a19b214b931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.515796 9529 tablet_service.cc:1467] Processing CreateTablet for tablet cc0af0c3fc1c46489904acc70707937b (DEFAULT_TABLE table=default.Table_f8d66cd6fbd648378a9cc5e211990b8d [id=4413b49e88be41e595238c4e1482423d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.516249 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0af0c3fc1c46489904acc70707937b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.518356 9534 tablet_service.cc:1467] Processing CreateTablet for tablet ac3269b07250416d98493f5d33f59210 (DEFAULT_TABLE table=default.Table_f7b29b2be4fe487ca26ef324590e0a87 [id=d16f2f3a45454e1d8271a3023bf61563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.518711 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3269b07250416d98493f5d33f59210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.519250 9815 tablet_replica.cc:330] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:41.519568 9851 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.519692 9851 ts_tablet_manager.cc:1397] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260928 14:50:41.520107 9815 raft_consensus.cc:2229] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.520212 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_075a808990274110b90e02a28f3bddba" } new_table_name: "default.Table_6f023f5deddd4af3ad807ca57668ae16" modify_external_catalogs: true
I20260928 14:50:41.520350 9851 raft_consensus.cc:348] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.520535 9851 raft_consensus.cc:374] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.520591 9851 raft_consensus.cc:729] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.520769 9851 consensus_queue.cc:260] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.521257 9851 ts_tablet_manager.cc:1428] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:41.524933 9815 raft_consensus.cc:2258] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.525309 9851 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.527056 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6bdb6a6cea334521b13b5ebd47fbab98
I20260928 14:50:41.531431 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.531675 9813 tablet_replica.cc:330] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:41.531869 9813 raft_consensus.cc:2229] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.531987 9851 tablet_bootstrap.cc:654] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.532033 9813 raft_consensus.cc:2258] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.532526 9813 ts_tablet_manager.cc:1905] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.534605 9815 ts_tablet_manager.cc:1905] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.539880 9813 ts_tablet_manager.cc:1918] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:41.539988 9813 log.cc:1196] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6bdb6a6cea334521b13b5ebd47fbab98
I20260928 14:50:41.540248 9848 tablet_bootstrap.cc:654] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.540614 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 1f42b0c58c5745b088e519844f09e67b (DEFAULT_TABLE table=default.Table_9fa35f27069447e9a08b9747aacb5038 [id=0580256a46cc433f9d9db03e8ba9b43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.540956 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f42b0c58c5745b088e519844f09e67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.537897 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.549394 9813 ts_tablet_manager.cc:1939] T 6bdb6a6cea334521b13b5ebd47fbab98 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:41.552752 10975 raft_consensus.cc:482] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.552944 10975 raft_consensus.cc:504] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.554018 10975 leader_election.cc:288] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.554183 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]) successfully deleted
W20260928 14:50:41.554807 9219 leader_election.cc:341] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8234670cb2604ba7b405ad7f70e03a2f
I20260928 14:50:41.555228 9261 tablet_service.cc:1467] Processing CreateTablet for tablet b84089ebfc664cbc803dc2a4fc9c1173 (DEFAULT_TABLE table=default.Table_2e4efa71e8884b1589be170349cfe1c5 [id=4ddfae2047964ab681d33b6e7f203bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.555575 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b84089ebfc664cbc803dc2a4fc9c1173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.558385 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcce70975f045eca0f3a646dd2b979e (DEFAULT_TABLE table=default.Table_18d53f131bd340b1ae7716cce53117c0 [id=66c83cd38a834489a4f89f0f7848b020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.558756 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcce70975f045eca0f3a646dd2b979e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.560278 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d" } modify_external_catalogs: true
I20260928 14:50:41.560583 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_170e3a1d0e8b42e6b98c656cf3b8a59d" } modify_external_catalogs: true
I20260928 14:50:41.562239 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cb70ad9b55b44b53913e9843c9bfd3ca" } modify_external_catalogs: true
I20260928 14:50:41.562503 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cb70ad9b55b44b53913e9843c9bfd3ca" } modify_external_catalogs: true
I20260928 14:50:41.563935 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_942304a4c0664627bf1669576e0dbb21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.564527 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_942304a4c0664627bf1669576e0dbb21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.566318 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 8048f3de070f48f4ab8d08a35c727c8e (table default.Table_d7af89d7c1d5498394ab0e7a0a78a953 [id=dcd8a6c7a1f14a699d65dac5a1178c30]). Expected version 2 got 0
I20260928 14:50:41.566363 9535 tablet_service.cc:1467] Processing CreateTablet for tablet b84089ebfc664cbc803dc2a4fc9c1173 (DEFAULT_TABLE table=default.Table_2e4efa71e8884b1589be170349cfe1c5 [id=4ddfae2047964ab681d33b6e7f203bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.566758 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b84089ebfc664cbc803dc2a4fc9c1173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.566952 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 7376f56883dc4032b120cc4494fa8936 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:41.575122 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2fefa0493748569a9426efdd55e1e8 (DEFAULT_TABLE table=default.Table_6368c0d7fee34bcfa87318701ce9ec68 [id=ee43a283d6ff4fa7ba30905879999983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.576761 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5905e89144477eb0e9ca76665b6572 (DEFAULT_TABLE table=default.Table_468a5a67d9d142899157a128521dd34a [id=fc4ac94763934903b8d4e4a523628684]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.578641 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e13976317a32495ab377654b738667ca consensus state has no leader
I20260928 14:50:41.579173 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 1f42b0c58c5745b088e519844f09e67b (DEFAULT_TABLE table=default.Table_9fa35f27069447e9a08b9747aacb5038 [id=0580256a46cc433f9d9db03e8ba9b43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.579375 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2fefa0493748569a9426efdd55e1e8 (DEFAULT_TABLE table=default.Table_6368c0d7fee34bcfa87318701ce9ec68 [id=ee43a283d6ff4fa7ba30905879999983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.579520 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f42b0c58c5745b088e519844f09e67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.579761 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2fefa0493748569a9426efdd55e1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.582378 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5905e89144477eb0e9ca76665b6572 (DEFAULT_TABLE table=default.Table_468a5a67d9d142899157a128521dd34a [id=fc4ac94763934903b8d4e4a523628684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.582717 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5905e89144477eb0e9ca76665b6572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.586164 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 1f42b0c58c5745b088e519844f09e67b (DEFAULT_TABLE table=default.Table_9fa35f27069447e9a08b9747aacb5038 [id=0580256a46cc433f9d9db03e8ba9b43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.586488 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f42b0c58c5745b088e519844f09e67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.588214 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b1df25948af14998a26b36bb5b466a1e (table default.Table_f9d1f83d4b0d4777b9d3b3755b556817 [id=37f211d75f004ca08ff659cd19d592e9]). Expected version 2 got 0
I20260928 14:50:41.588569 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5127a4bb7e114ec09235c9e29f614156 (table default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2]). Expected version 1 got 0
I20260928 14:50:41.588802 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:41.590205 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2fefa0493748569a9426efdd55e1e8 (DEFAULT_TABLE table=default.Table_6368c0d7fee34bcfa87318701ce9ec68 [id=ee43a283d6ff4fa7ba30905879999983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.590519 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2fefa0493748569a9426efdd55e1e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:41.590816 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 24f53d04326f4e639be23564563034e0 (table default.Table_51a8abb8f77e4a418a85f6114687b694 [id=64049fd699aa4619b8af272af12c59ad], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 24f53d04326f4e639be23564563034e0 consensus state has no leader
I20260928 14:50:41.592384 9848 tablet_bootstrap.cc:492] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.592509 9848 ts_tablet_manager.cc:1397] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.002s
I20260928 14:50:41.593278 9848 raft_consensus.cc:348] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.593465 9848 raft_consensus.cc:374] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.593506 9848 raft_consensus.cc:729] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.593731 9848 consensus_queue.cc:260] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.594434 9848 ts_tablet_manager.cc:1428] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:41.594705 9848 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.595225 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 7481ecb5620149f1a1bd3b55ca721314 (DEFAULT_TABLE table=default.Table_3cc715f9621743d397d7ebb1b9d03a23 [id=68463b033b674cc29107f929b3d30120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.595510 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7481ecb5620149f1a1bd3b55ca721314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.595697 9851 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.595804 9851 ts_tablet_manager.cc:1397] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.071s user 0.015s sys 0.003s
I20260928 14:50:41.597301 9814 ts_tablet_manager.cc:1918] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.597406 9814 log.cc:1196] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:41.597316 9851 raft_consensus.cc:348] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.598184 9851 raft_consensus.cc:374] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.598246 9851 raft_consensus.cc:729] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.598423 9851 consensus_queue.cc:260] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.598907 9851 ts_tablet_manager.cc:1428] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:41.599131 9851 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.600759 9851 tablet_bootstrap.cc:654] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.600924 9855 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.601022 9855 ts_tablet_manager.cc:1397] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.198s user 0.017s sys 0.053s
I20260928 14:50:41.601805 9855 raft_consensus.cc:348] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.601986 9855 raft_consensus.cc:374] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.602042 9855 raft_consensus.cc:729] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.602216 9855 consensus_queue.cc:260] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.606029 10975 raft_consensus.cc:482] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.606160 10975 raft_consensus.cc:504] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.606592 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 30d197a8ba8848d98ba0f03b2e83d3f6
I20260928 14:50:41.606614 10982 raft_consensus.cc:482] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.606714 10982 raft_consensus.cc:504] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.607204 10982 leader_election.cc:288] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.608371 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.608609 10975 leader_election.cc:288] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.609179 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.609581 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:41.609741 9220 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.610002 9855 ts_tablet_manager.cc:1428] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:41.610378 9814 ts_tablet_manager.cc:1939] T c6b4b4c775fe4eacaaa557d4daa2a600 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:41.610680 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7921bc68641f4c9f8729326915f0fd0e" } new_table_name: "default.Table_08d5149e88d34336b608256fcc4d3224" modify_external_catalogs: true
I20260928 14:50:41.611871 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c6b4b4c775fe4eacaaa557d4daa2a600 (table default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]) successfully deleted
I20260928 14:50:41.611995 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f038da6d97b4464a345085edf1bbe19" } modify_external_catalogs: true
I20260928 14:50:41.612185 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f038da6d97b4464a345085edf1bbe19" } modify_external_catalogs: true
W20260928 14:50:41.612226 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30d197a8ba8848d98ba0f03b2e83d3f6 already in progress: creating tablet
I20260928 14:50:41.612812 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:41.612987 9568 raft_consensus.cc:2454] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:41.613360 9219 leader_election.cc:302] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.613444 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_972da0796cdf4773bd29790b1ac8a479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.614423 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_972da0796cdf4773bd29790b1ac8a479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.614701 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.615320 9851 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.615427 9851 ts_tablet_manager.cc:1397] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
W20260928 14:50:41.615504 9219 leader_election.cc:341] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:41.615890 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcce70975f045eca0f3a646dd2b979e (DEFAULT_TABLE table=default.Table_18d53f131bd340b1ae7716cce53117c0 [id=66c83cd38a834489a4f89f0f7848b020]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.616027 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30d197a8ba8848d98ba0f03b2e83d3f6 already in progress: creating tablet
I20260928 14:50:41.616261 9851 raft_consensus.cc:348] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.616446 9851 raft_consensus.cc:374] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.616506 9851 raft_consensus.cc:729] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.616683 9851 consensus_queue.cc:260] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.616966 10982 raft_consensus.cc:2781] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:41.617038 10982 raft_consensus.cc:482] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:41.617110 10982 raft_consensus.cc:3037] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.617165 9851 ts_tablet_manager.cc:1428] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:41.617633 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 7481ecb5620149f1a1bd3b55ca721314 (DEFAULT_TABLE table=default.Table_3cc715f9621743d397d7ebb1b9d03a23 [id=68463b033b674cc29107f929b3d30120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.618160 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b84089ebfc664cbc803dc2a4fc9c1173 (DEFAULT_TABLE table=default.Table_2e4efa71e8884b1589be170349cfe1c5 [id=4ddfae2047964ab681d33b6e7f203bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.619246 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 7481ecb5620149f1a1bd3b55ca721314 (DEFAULT_TABLE table=default.Table_3cc715f9621743d397d7ebb1b9d03a23 [id=68463b033b674cc29107f929b3d30120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.619459 10982 raft_consensus.cc:504] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.619740 9248 tablet_service.cc:1467] Processing CreateTablet for tablet 573cd4dd48474eb7ad518a19b214b931 (DEFAULT_TABLE table=default.Table_8c906a32eb8a4a9ba01333465d55e96a [id=7c10261b48fc4c0ca11f3b902bff0961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.619971 10982 leader_election.cc:288] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.620500 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2fefa0493748569a9426efdd55e1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.620682 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcce70975f045eca0f3a646dd2b979e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.621393 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:41.622224 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5905e89144477eb0e9ca76665b6572. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:41.622341 9220 leader_election.cc:341] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.623811 9848 tablet_bootstrap.cc:654] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.625290 9851 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.626557 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7481ecb5620149f1a1bd3b55ca721314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.628882 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b84089ebfc664cbc803dc2a4fc9c1173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.618839 10895 raft_consensus.cc:482] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.631999 10895 raft_consensus.cc:504] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.632474 10895 leader_election.cc:288] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.620332 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcce70975f045eca0f3a646dd2b979e (DEFAULT_TABLE table=default.Table_18d53f131bd340b1ae7716cce53117c0 [id=66c83cd38a834489a4f89f0f7848b020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.633029 9851 tablet_bootstrap.cc:654] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.633001 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.633190 9284 raft_consensus.cc:2454] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:41.632740 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7481ecb5620149f1a1bd3b55ca721314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.622545 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b08f7c9a1e4fcab0951eb5d4cd059a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:41.633625 9567 raft_consensus.cc:3037] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.633744 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.634325 9498 leader_election.cc:341] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.636411 9567 raft_consensus.cc:2454] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:41.636766 9219 leader_election.cc:302] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.637224 10982 raft_consensus.cc:2781] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:41.637583 10982 raft_consensus.cc:686] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:41.637679 9497 leader_election.cc:302] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.637831 10982 consensus_queue.cc:237] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.638001 10895 raft_consensus.cc:2781] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:41.638065 10895 raft_consensus.cc:482] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:41.638118 10895 raft_consensus.cc:3037] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.638984 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcce70975f045eca0f3a646dd2b979e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.640286 10895 raft_consensus.cc:504] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.640776 10895 leader_election.cc:288] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.641117 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573cd4dd48474eb7ad518a19b214b931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.622874 9855 tablet_bootstrap.cc:492] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:41.642884 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 462da126db8e4027b042cb7933c87737 consensus state has no leader
I20260928 14:50:41.643112 9855 tablet_bootstrap.cc:654] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.645488 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:41.645689 9284 raft_consensus.cc:3037] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.645778 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:41.646296 9498 leader_election.cc:341] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.647210 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_66b6cbc54205480b9265a3f67d94916e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.647843 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66b6cbc54205480b9265a3f67d94916e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.648105 9284 raft_consensus.cc:2454] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:41.648995 9497 leader_election.cc:302] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.655911 9855 tablet_bootstrap.cc:492] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.656236 9395 tablet_service.cc:1467] Processing CreateTablet for tablet a4b08ba099b942a18a582d3e02360428 (DEFAULT_TABLE table=default.Table_d102cb269e9f482c9f877dff8885cd60 [id=ba8e995dccee430b9b4d2b04f39e3dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.656574 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b08ba099b942a18a582d3e02360428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.657148 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff6fb6b48b54b4aa9befdc032a72766 (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.657429 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff6fb6b48b54b4aa9befdc032a72766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.658555 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 04acfde38f894aa08686379d283861ae (DEFAULT_TABLE table=default.Table_9621a96cd09542778ace154ae8deef0b [id=f7a03560f8ba47b489a6c15cd12155d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.658864 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04acfde38f894aa08686379d283861ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.663547 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8766eb621974471c9c8c5850088f4b54
I20260928 14:50:41.663749 9406 tablet_service.cc:1467] Processing CreateTablet for tablet d568c7a3ee674e738fdafa29fbefba40 (DEFAULT_TABLE table=default.Table_117bb3e870db4e31a62a105acb99a26f [id=f0b99e7bd0a04c469c49da1a91ad83c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.664206 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bf94be2def6043cb8d0d39da62dd7c11
I20260928 14:50:41.664700 11111 raft_consensus.cc:482] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.664738 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 8766eb621974471c9c8c5850088f4b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.664847 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.664824 11111 raft_consensus.cc:504] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.664196 11086 raft_consensus.cc:2781] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 14:50:41.665292 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8766eb621974471c9c8c5850088f4b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8766eb621974471c9c8c5850088f4b54 already in progress: creating tablet
I20260928 14:50:41.665354 11111 leader_election.cc:288] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:41.665665 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bf94be2def6043cb8d0d39da62dd7c11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf94be2def6043cb8d0d39da62dd7c11 already in progress: creating tablet
I20260928 14:50:41.666033 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "286f5e0fb1414305ab0a1b5df3ed4ff3" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.666208 9360 leader_election.cc:341] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: a7be6013a04c4222ab34a19e77e48a37
W20260928 14:50:41.666492 9220 leader_election.cc:341] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.666592 9220 leader_election.cc:302] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.666692 9848 tablet_bootstrap.cc:492] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.666810 9848 ts_tablet_manager.cc:1397] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.072s user 0.001s sys 0.003s
I20260928 14:50:41.667553 9848 raft_consensus.cc:348] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.667753 9848 raft_consensus.cc:374] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.667821 9848 raft_consensus.cc:729] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.668027 9848 consensus_queue.cc:260] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.668385 10975 raft_consensus.cc:2726] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.668995 9848 ts_tablet_manager.cc:1428] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:41.670205 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 04acfde38f894aa08686379d283861ae (DEFAULT_TABLE table=default.Table_9621a96cd09542778ace154ae8deef0b [id=f7a03560f8ba47b489a6c15cd12155d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.670236 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 6fd0f711d52f4d5ab7a8d3eae5441754 (DEFAULT_TABLE table=default.Table_56bcdd59329c4f14bc16e8fbbccc473b [id=55ea791a2bf54201916c37984b44ffd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.670635 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fd0f711d52f4d5ab7a8d3eae5441754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.671144 9256 tablet_service.cc:1467] Processing CreateTablet for tablet a4b08ba099b942a18a582d3e02360428 (DEFAULT_TABLE table=default.Table_d102cb269e9f482c9f877dff8885cd60 [id=ba8e995dccee430b9b4d2b04f39e3dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.671435 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b08ba099b942a18a582d3e02360428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.675531 9855 ts_tablet_manager.cc:1397] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.001s
I20260928 14:50:41.676528 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04acfde38f894aa08686379d283861ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.616881 9815 ts_tablet_manager.cc:1918] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.676970 9815 log.cc:1196] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1b22c3f9578a464a96be0bac6127e56d
I20260928 14:50:41.677070 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 04acfde38f894aa08686379d283861ae (DEFAULT_TABLE table=default.Table_9621a96cd09542778ace154ae8deef0b [id=f7a03560f8ba47b489a6c15cd12155d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.677387 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 6fd0f711d52f4d5ab7a8d3eae5441754 (DEFAULT_TABLE table=default.Table_56bcdd59329c4f14bc16e8fbbccc473b [id=55ea791a2bf54201916c37984b44ffd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.677479 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04acfde38f894aa08686379d283861ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.677868 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 6fd0f711d52f4d5ab7a8d3eae5441754 (DEFAULT_TABLE table=default.Table_56bcdd59329c4f14bc16e8fbbccc473b [id=55ea791a2bf54201916c37984b44ffd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.678231 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8234670cb2604ba7b405ad7f70e03a2f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.678781 9220 leader_election.cc:341] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.678879 9220 leader_election.cc:302] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.678992 10895 raft_consensus.cc:482] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.679111 10895 raft_consensus.cc:504] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.679571 10895 leader_election.cc:288] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.680454 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fd0f711d52f4d5ab7a8d3eae5441754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.681699 9848 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.683578 9848 tablet_bootstrap.cc:654] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.683804 10982 raft_consensus.cc:2726] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.684280 9815 ts_tablet_manager.cc:1939] T 1b22c3f9578a464a96be0bac6127e56d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:41.685760 9360 leader_election.cc:341] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: a7be6013a04c4222ab34a19e77e48a37
I20260928 14:50:41.685884 9360 leader_election.cc:302] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:41.686019 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.686091 11111 raft_consensus.cc:2726] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.686888 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:41.685505 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 8d5905e89144477eb0e9ca76665b6572 (DEFAULT_TABLE table=default.Table_468a5a67d9d142899157a128521dd34a [id=fc4ac94763934903b8d4e4a523628684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.688205 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff6fb6b48b54b4aa9befdc032a72766 (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.689447 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.689740 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 8766eb621974471c9c8c5850088f4b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.690454 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d5905e89144477eb0e9ca76665b6572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.691489 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_05205c49cc5d404d922ebef15030f7a6" } new_table_name: "default.Table_33d213a97ea349d6ab97a84fd1571e6d" modify_external_catalogs: true
W20260928 14:50:41.686569 9497 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.692866 11106 tablet.cc:1722] T b1df25948af14998a26b36bb5b466a1e P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:41.692858 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a6e4e218f153439fb376d1de25c66fb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.693396 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6e4e218f153439fb376d1de25c66fb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.693925 9533 tablet_service.cc:1467] Processing CreateTablet for tablet a4b08ba099b942a18a582d3e02360428 (DEFAULT_TABLE table=default.Table_d102cb269e9f482c9f877dff8885cd60 [id=ba8e995dccee430b9b4d2b04f39e3dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.694224 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b08ba099b942a18a582d3e02360428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.694844 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 71ec7763cd5e4578919ce5824eea1329 (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.697628 9498 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.697948 9498 leader_election.cc:302] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.698680 10895 raft_consensus.cc:2726] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.700995 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 8766eb621974471c9c8c5850088f4b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.701088 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet bf94be2def6043cb8d0d39da62dd7c11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.701467 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff6fb6b48b54b4aa9befdc032a72766 (DEFAULT_TABLE table=default.Table_148c366515f54e61a270e84886a7af20 [id=ae1047d2fa6b4f7992136c40f3237730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.701822 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff6fb6b48b54b4aa9befdc032a72766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.703585 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 71ec7763cd5e4578919ce5824eea1329 (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.703598 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 9e20e581a30e46889dd4c4d358d09c88 (DEFAULT_TABLE table=default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.704082 9264 tablet_service.cc:1467] Processing CreateTablet for tablet d568c7a3ee674e738fdafa29fbefba40 (DEFAULT_TABLE table=default.Table_117bb3e870db4e31a62a105acb99a26f [id=f0b99e7bd0a04c469c49da1a91ad83c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.704222 9395 tablet_service.cc:1467] Processing CreateTablet for tablet f5099fbd2303490da02af5047982afa9 (DEFAULT_TABLE table=default.Table_1b977595c51449c3b3250ad32efcd0d3 [id=e3da5f3bb5fe441e9cb3ab20e18c9044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.704612 10982 raft_consensus.cc:482] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.704704 9530 tablet_service.cc:1467] Processing CreateTablet for tablet d568c7a3ee674e738fdafa29fbefba40 (DEFAULT_TABLE table=default.Table_117bb3e870db4e31a62a105acb99a26f [id=f0b99e7bd0a04c469c49da1a91ad83c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.704798 10982 raft_consensus.cc:504] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.704984 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d568c7a3ee674e738fdafa29fbefba40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.705503 10982 leader_election.cc:288] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.708621 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.709137 9220 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.709820 9393 tablet_service.cc:1467] Processing CreateTablet for tablet a3d0060df4264a80b623bce21f41a906 (DEFAULT_TABLE table=default.Table_365a675e1c6e411f8e2e632d45a8d948 [id=04d7baf2c8494d82820ae8131dc61d48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.710114 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 (DEFAULT_TABLE table=default.Table_b2d1d9d89eea4bfab15897c49448c30e [id=17938a3fd9c448518a54f786289343db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.712869 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:41.713162 9567 raft_consensus.cc:2454] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:41.713589 9219 leader_election.cc:302] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.714174 10982 raft_consensus.cc:2781] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:41.714296 10982 raft_consensus.cc:482] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:41.714417 10982 raft_consensus.cc:3037] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.717269 10982 raft_consensus.cc:504] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.718287 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:41.718451 9567 raft_consensus.cc:3037] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.720893 9567 raft_consensus.cc:2454] T 91262a2cf39e4e5bb4854998332ca1f1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:41.721242 9219 leader_election.cc:302] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:41.721451 10975 raft_consensus.cc:2781] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:41.721596 10975 raft_consensus.cc:686] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:41.721789 10975 consensus_queue.cc:237] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.722232 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 71ec7763cd5e4578919ce5824eea1329 (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.722656 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ec7763cd5e4578919ce5824eea1329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.709837 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 9e20e581a30e46889dd4c4d358d09c88 (DEFAULT_TABLE table=default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.724911 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:41.725171 8940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.181.61:41417: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260928 14:50:41.726262 9851 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.726382 9851 ts_tablet_manager.cc:1397] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.024s
I20260928 14:50:41.727403 9401 tablet_service.cc:1467] Processing CreateTablet for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb (DEFAULT_TABLE table=default.Table_0f5bbd802e804ccd82f8c29e78c1b570 [id=fec6c245096d405d960ee143532b88bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.727787 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 58ae3fd1c4de40d193beb5738358cfa0 (DEFAULT_TABLE table=default.Table_94ab14281290410b96e76fea40cce424 [id=aa9eb44808a543d49ce255588d9dc04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.728451 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 9e20e581a30e46889dd4c4d358d09c88 (DEFAULT_TABLE table=default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.728821 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e20e581a30e46889dd4c4d358d09c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.727089 9851 raft_consensus.cc:348] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.729221 9851 raft_consensus.cc:374] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.729292 9851 raft_consensus.cc:729] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.729568 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdb6a6cea334521b13b5ebd47fbab98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.731688 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 573cd4dd48474eb7ad518a19b214b931 (DEFAULT_TABLE table=default.Table_8c906a32eb8a4a9ba01333465d55e96a [id=7c10261b48fc4c0ca11f3b902bff0961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.732033 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573cd4dd48474eb7ad518a19b214b931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.729473 9851 consensus_queue.cc:260] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.734009 9851 ts_tablet_manager.cc:1428] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:41.734308 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7376f56883dc4032b120cc4494fa8936
I20260928 14:50:41.734683 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 7376f56883dc4032b120cc4494fa8936 deleted and replaced by tablet a8f6de1135234f58aa2e534efead2880
I20260928 14:50:41.735075 8956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de] alter complete (version 2)
I20260928 14:50:41.737306 11111 raft_consensus.cc:482] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.737455 11111 raft_consensus.cc:504] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.738089 11111 leader_election.cc:288] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.739661 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 7376f56883dc4032b120cc4494fa8936 with delete_type TABLET_DATA_DELETED (replaced by tablet a8f6de1135234f58aa2e534efead2880) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:41.740242 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7376f56883dc4032b120cc4494fa8936 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7376f56883dc4032b120cc4494fa8936 already in progress: creating tablet
I20260928 14:50:41.740377 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.741811 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f7fb96f92a4e35b8561832e1d812d8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:41.742110 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fd0f711d52f4d5ab7a8d3eae5441754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.742290 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d568c7a3ee674e738fdafa29fbefba40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.742494 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ec7763cd5e4578919ce5824eea1329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.742542 9360 leader_election.cc:302] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:41.742695 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58ae3fd1c4de40d193beb5738358cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.742779 11111 raft_consensus.cc:2726] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.742900 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfe81624ecb41889dd2eeeaa5d0e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.690066 9855 raft_consensus.cc:348] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.743062 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d0060df4264a80b623bce21f41a906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.743244 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e20e581a30e46889dd4c4d358d09c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.743425 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.685739 11153 raft_consensus.cc:482] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.743742 11153 raft_consensus.cc:504] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.744810 11153 leader_election.cc:288] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.745792 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5afbdeda4ddfb82124031135e6cb" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.746533 9498 leader_election.cc:341] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.747246 11086 raft_consensus.cc:686] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:41.750902 11086 consensus_queue.cc:237] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.747036 9855 raft_consensus.cc:374] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.754070 9855 raft_consensus.cc:729] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.754227 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff6fb6b48b54b4aa9befdc032a72766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.755074 10982 leader_election.cc:288] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.755434 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:41.755997 9220 leader_election.cc:341] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.756834 9848 tablet_bootstrap.cc:492] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.756969 9848 ts_tablet_manager.cc:1397] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.002s
I20260928 14:50:41.757038 11153 raft_consensus.cc:482] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.757411 11153 raft_consensus.cc:504] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.759840 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d197a8ba8848d98ba0f03b2e83d3f6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.760752 9498 leader_election.cc:341] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.761562 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d197a8ba8848d98ba0f03b2e83d3f6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.761569 9855 consensus_queue.cc:260] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.762001 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5afbdeda4ddfb82124031135e6cb" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:41.762984 9855 ts_tablet_manager.cc:1428] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.087s user 0.002s sys 0.000s
I20260928 14:50:41.764602 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1b22c3f9578a464a96be0bac6127e56d (table default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]) successfully deleted
I20260928 14:50:41.765965 11153 leader_election.cc:288] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:41.769855 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6fbbadaf0b4e4685f398496cf4e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.770810 10975 raft_consensus.cc:482] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.770919 10975 raft_consensus.cc:504] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.771416 10975 leader_election.cc:288] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.781216 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab71087d034c4bedb06df9e5ccefad45" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:41.781816 9220 leader_election.cc:341] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.784211 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5099fbd2303490da02af5047982afa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.757771 9848 raft_consensus.cc:348] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:41.784706 9497 leader_election.cc:341] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.785048 9848 raft_consensus.cc:374] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.785113 9848 raft_consensus.cc:729] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.785102 9497 leader_election.cc:302] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.785481 11152 raft_consensus.cc:2726] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:41.785950 9497 leader_election.cc:341] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:41.786128 9497 leader_election.cc:302] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.786409 11152 raft_consensus.cc:2726] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.788131 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 01dd30e15c31498299ca5f5a3b2770e9 (table default.Table_c7c519080c7b493ca8249b294e8d446e [id=b58aea2205304defa62befcee84dfa0f]). Expected version 2 got 0
I20260928 14:50:41.788373 8949 catalog_manager.cc:5495] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:41.791848 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_117b7ba8c223492983d6e8897272f345"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:41.793431 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
W20260928 14:50:41.794134 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_117b7ba8c223492983d6e8897272f345 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.794349 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_25bfa6420cde48e992b706d92a31d90e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.794945 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25bfa6420cde48e992b706d92a31d90e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.795167 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bfa126b466444d33ab6b35eb4b09680b" } new_table_name: "default.Table_13b124bd18a24bf2b993851245917a39" modify_external_catalogs: true
W20260928 14:50:41.796993 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d271c8012b634b2a816cc2360e5b2164 has no consensus state
I20260928 14:50:41.797465 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad01b16b05e54931a25a012cda7fd249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.797967 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad01b16b05e54931a25a012cda7fd249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.799265 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 00b953b19dd54aaabf4dbefcd33600e7
I20260928 14:50:41.799933 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_82a935228f4e4a8eb81bea67d9fb3cd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.800433 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82a935228f4e4a8eb81bea67d9fb3cd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.800911 9815 tablet_replica.cc:330] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:41.801093 9815 raft_consensus.cc:2229] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.801242 9815 raft_consensus.cc:2258] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.801821 9815 ts_tablet_manager.cc:1905] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.801839 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8dafd1175a9e47c0a409ab3fe102592f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.802297 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dafd1175a9e47c0a409ab3fe102592f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.803603 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5ec6b786d4384e2a9a9cc6e7acbe2381"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:41.804050 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ec6b786d4384e2a9a9cc6e7acbe2381 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:41.807998 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 88d6b4482e7b42fca17e5b917e1c1bed (table default.Table_6dacb88cb9c74873a8f69da29a43fed9 [id=27d3ad1dac4641e2b16e86da4d16ea0e]). Expected version 1 got 0
I20260928 14:50:41.808291 9814 tablet_replica.cc:330] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.808310 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5127a4bb7e114ec09235c9e29f614156 (table default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2]). Expected version 1 got 0
I20260928 14:50:41.808485 9814 raft_consensus.cc:2229] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:41.808774 9814 raft_consensus.cc:2258] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.808610 8949 catalog_manager.cc:5495] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:41.809285 9814 ts_tablet_manager.cc:1905] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.809124 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:41.809597 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_05205c49cc5d404d922ebef15030f7a6 [id=e00f618e9273435db59f9445f6485b89]). Expected version 1 got 0
I20260928 14:50:41.809770 8949 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:41.812022 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ec7763cd5e4578919ce5824eea1329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.812247 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e20e581a30e46889dd4c4d358d09c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.812427 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d568c7a3ee674e738fdafa29fbefba40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.812135 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:41.818120 9851 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:41.818264 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 00b953b19dd54aaabf4dbefcd33600e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b953b19dd54aaabf4dbefcd33600e7 already in progress: creating tablet
W20260928 14:50:41.818434 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0d6ff1371ac546718b42d2ebc78d5ea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6ff1371ac546718b42d2ebc78d5ea7 already in progress: creating tablet
W20260928 14:50:41.818545 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 53316.6us
W20260928 14:50:41.819015 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 873469257ed14808be231b92f3149642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 873469257ed14808be231b92f3149642 already in progress: creating tablet
I20260928 14:50:41.819435 9848 consensus_queue.cc:260] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.819653 9851 tablet_bootstrap.cc:654] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.819651 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 (DEFAULT_TABLE table=default.Table_b2d1d9d89eea4bfab15897c49448c30e [id=17938a3fd9c448518a54f786289343db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.820037 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6fbbadaf0b4e4685f398496cf4e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.825862 9855 tablet_bootstrap.cc:492] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.826128 9848 ts_tablet_manager.cc:1428] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260928 14:50:41.828500 9255 tablet_service.cc:1467] Processing CreateTablet for tablet f5099fbd2303490da02af5047982afa9 (DEFAULT_TABLE table=default.Table_1b977595c51449c3b3250ad32efcd0d3 [id=e3da5f3bb5fe441e9cb3ab20e18c9044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.829183 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5099fbd2303490da02af5047982afa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.832427 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 (DEFAULT_TABLE table=default.Table_b2d1d9d89eea4bfab15897c49448c30e [id=17938a3fd9c448518a54f786289343db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.832762 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6fbbadaf0b4e4685f398496cf4e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.834406 9851 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.834525 9851 ts_tablet_manager.cc:1397] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.006s
I20260928 14:50:41.835227 9851 raft_consensus.cc:348] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.835413 9851 raft_consensus.cc:374] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.835460 9851 raft_consensus.cc:729] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.835634 9851 consensus_queue.cc:260] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.836140 9851 ts_tablet_manager.cc:1428] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:41.836372 9851 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:41.837134 9219 leader_election.cc:341] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:41.837239 9219 leader_election.cc:302] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:41.837687 10982 raft_consensus.cc:2726] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.837805 9851 tablet_bootstrap.cc:654] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.837735 9530 tablet_service.cc:1467] Processing CreateTablet for tablet f5099fbd2303490da02af5047982afa9 (DEFAULT_TABLE table=default.Table_1b977595c51449c3b3250ad32efcd0d3 [id=e3da5f3bb5fe441e9cb3ab20e18c9044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.838110 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5099fbd2303490da02af5047982afa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.839515 9848 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.841751 9249 tablet_service.cc:1467] Processing CreateTablet for tablet a3d0060df4264a80b623bce21f41a906 (DEFAULT_TABLE table=default.Table_365a675e1c6e411f8e2e632d45a8d948 [id=04d7baf2c8494d82820ae8131dc61d48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.842131 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d0060df4264a80b623bce21f41a906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.842592 9814 ts_tablet_manager.cc:1918] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:41.842694 9814 log.cc:1196] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6bdb6a6cea334521b13b5ebd47fbab98
I20260928 14:50:41.843046 9814 ts_tablet_manager.cc:1939] T 6bdb6a6cea334521b13b5ebd47fbab98 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:41.845427 9851 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.845588 9851 ts_tablet_manager.cc:1397] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260928 14:50:41.845769 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.846024 9546 tablet_service.cc:1467] Processing CreateTablet for tablet a3d0060df4264a80b623bce21f41a906 (DEFAULT_TABLE table=default.Table_365a675e1c6e411f8e2e632d45a8d948 [id=04d7baf2c8494d82820ae8131dc61d48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.846128 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfe81624ecb41889dd2eeeaa5d0e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.846338 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d0060df4264a80b623bce21f41a906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.846297 9851 raft_consensus.cc:348] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.846539 9851 raft_consensus.cc:374] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.846609 9851 raft_consensus.cc:729] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.846800 9851 consensus_queue.cc:260] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.848762 9851 ts_tablet_manager.cc:1428] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:41.849009 9851 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.850616 9851 tablet_bootstrap.cc:654] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.851164 9248 tablet_service.cc:1467] Processing CreateTablet for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb (DEFAULT_TABLE table=default.Table_0f5bbd802e804ccd82f8c29e78c1b570 [id=fec6c245096d405d960ee143532b88bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.851450 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.859968 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 (DEFAULT_TABLE table=default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.860836 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 7376f56883dc4032b120cc4494fa8936 with delete_type TABLET_DATA_DELETED (replaced by tablet a8f6de1135234f58aa2e534efead2880) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.861640 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.862087 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.862600 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.864425 9814 tablet_replica.cc:330] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.864603 9814 raft_consensus.cc:2229] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.864861 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet eff9afcc868244aeb830fae2735da28d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e20e581a30e46889dd4c4d358d09c88) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:41.864907 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfe81624ecb41889dd2eeeaa5d0e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.865773 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:41.867441 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet bf94be2def6043cb8d0d39da62dd7c11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf94be2def6043cb8d0d39da62dd7c11 already in progress: creating tablet
I20260928 14:50:41.867561 9851 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:41.867686 9851 ts_tablet_manager.cc:1397] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
W20260928 14:50:41.867679 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8766eb621974471c9c8c5850088f4b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8766eb621974471c9c8c5850088f4b54 already in progress: creating tablet
I20260928 14:50:41.868286 9541 tablet_service.cc:1467] Processing CreateTablet for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb (DEFAULT_TABLE table=default.Table_0f5bbd802e804ccd82f8c29e78c1b570 [id=fec6c245096d405d960ee143532b88bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.868371 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 58ae3fd1c4de40d193beb5738358cfa0 (DEFAULT_TABLE table=default.Table_94ab14281290410b96e76fea40cce424 [id=aa9eb44808a543d49ce255588d9dc04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.868414 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]) successfully deleted
I20260928 14:50:41.868602 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51d95bea04e4b8b9d9d4b2d4fc332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.868638 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 7376f56883dc4032b120cc4494fa8936 with delete_type TABLET_DATA_DELETED (replaced by tablet a8f6de1135234f58aa2e534efead2880) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:41.868695 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7376f56883dc4032b120cc4494fa8936 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7376f56883dc4032b120cc4494fa8936 already in progress: creating tablet
I20260928 14:50:41.868716 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 58ae3fd1c4de40d193beb5738358cfa0 (DEFAULT_TABLE table=default.Table_94ab14281290410b96e76fea40cce424 [id=aa9eb44808a543d49ce255588d9dc04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:41.868814 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58ae3fd1c4de40d193beb5738358cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.868906 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.869061 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b953b19dd54aaabf4dbefcd33600e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:41.869706 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58ae3fd1c4de40d193beb5738358cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:41.872709 9851 raft_consensus.cc:348] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.872928 9851 raft_consensus.cc:374] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.873654 9851 raft_consensus.cc:729] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.874136 9851 consensus_queue.cc:260] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.875618 9851 ts_tablet_manager.cc:1428] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:41.875989 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_272ffcd346ae4b539727e6e5312c89ba" } modify_external_catalogs: true
I20260928 14:50:41.876187 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_272ffcd346ae4b539727e6e5312c89ba" } modify_external_catalogs: true
I20260928 14:50:41.876876 9851 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:41.880245 9851 tablet_bootstrap.cc:654] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.880597 9848 tablet_bootstrap.cc:654] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.887053 9855 tablet_bootstrap.cc:654] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.890388 9814 raft_consensus.cc:2258] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.890928 9814 ts_tablet_manager.cc:1905] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.901196 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 9b4cfb345e72457babc43037d8002d95 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:41.912438 9815 ts_tablet_manager.cc:1918] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.912755 9815 log.cc:1196] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/eff9afcc868244aeb830fae2735da28d
I20260928 14:50:41.913089 9815 ts_tablet_manager.cc:1939] T eff9afcc868244aeb830fae2735da28d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:41.914857 11111 raft_consensus.cc:482] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:41.914989 11111 raft_consensus.cc:504] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.915527 11111 leader_election.cc:288] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:41.917855 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet eff9afcc868244aeb830fae2735da28d (table default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]) successfully deleted
I20260928 14:50:41.919188 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_03083d6d919843cd89a110cd5acc31f1" } new_table_name: "default.Table_2a51869449d94759ae3ed0fece3ddf31" modify_external_catalogs: true
W20260928 14:50:41.919775 9360 leader_election.cc:341] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 73bbcf31960d478087a0a91337c34ec8
W20260928 14:50:41.919942 9360 leader_election.cc:341] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 73bbcf31960d478087a0a91337c34ec8
I20260928 14:50:41.920007 9360 leader_election.cc:302] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:41.920291 11111 raft_consensus.cc:2726] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:41.921504 9814 ts_tablet_manager.cc:1918] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.921633 9814 log.cc:1196] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:41.921931 9814 ts_tablet_manager.cc:1939] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:41.924224 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (table default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]) successfully deleted
I20260928 14:50:41.927441 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e30db7589ca148c489d5e75da88d4412" } modify_external_catalogs: true
I20260928 14:50:41.927649 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e30db7589ca148c489d5e75da88d4412" } modify_external_catalogs: true
I20260928 14:50:41.929843 9814 tablet_replica.cc:330] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.930052 9814 raft_consensus.cc:2229] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.930202 9814 raft_consensus.cc:2258] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.930464 9855 tablet_bootstrap.cc:492] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:41.930574 9855 ts_tablet_manager.cc:1397] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.001s
I20260928 14:50:41.930677 9814 ts_tablet_manager.cc:1905] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.931214 9855 raft_consensus.cc:348] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.931396 9855 raft_consensus.cc:374] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.931437 9855 raft_consensus.cc:729] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.931743 9855 consensus_queue.cc:260] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:41.932371 9855 ts_tablet_manager.cc:1428] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:41.932652 9855 tablet_bootstrap.cc:492] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:41.934312 9855 tablet_bootstrap.cc:654] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:41.934298 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet c510694f8a28461f9d7f3b420c112456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c510694f8a28461f9d7f3b420c112456 already in progress: creating tablet
I20260928 14:50:41.936102 9848 tablet_bootstrap.cc:492] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:41.936281 9848 ts_tablet_manager.cc:1397] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.097s user 0.003s sys 0.000s
I20260928 14:50:41.936658 9815 tablet_replica.cc:330] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:41.936887 9815 raft_consensus.cc:2229] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.937054 9815 raft_consensus.cc:2258] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.936972 9848 raft_consensus.cc:348] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.937183 9848 raft_consensus.cc:374] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:41.937237 9848 raft_consensus.cc:729] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:41.937693 9815 ts_tablet_manager.cc:1905] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.937446 9848 consensus_queue.cc:260] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:41.941592 9848 ts_tablet_manager.cc:1428] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:41.944943 9848 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:41.948004 9848 tablet_bootstrap.cc:654] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:41.951460 9814 ts_tablet_manager.cc:1918] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.951573 9814 log.cc:1196] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ea7b363d546c45ceb3efb9352cf184f4
I20260928 14:50:41.951864 9814 ts_tablet_manager.cc:1939] T ea7b363d546c45ceb3efb9352cf184f4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:41.952750 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 227e203bdf454f7289d2c8cccb9da63f consensus state has no leader
I20260928 14:50:41.952751 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ea7b363d546c45ceb3efb9352cf184f4 (table default.Table_38e8d8c399254d78ba45f973e9064285 [id=c7a56fd7639749f79590b127587f602e]) successfully deleted
I20260928 14:50:41.953059 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 09f92d1f0e69409a8ef355d550cfb52c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:41.956346 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_942304a4c0664627bf1669576e0dbb21" } new_table_name: "default.Table_2dca633ce1cb4d73be5555582d483a78" modify_external_catalogs: true
I20260928 14:50:41.957829 9814 tablet_replica.cc:330] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.958011 9814 raft_consensus.cc:2229] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.958170 9814 raft_consensus.cc:2258] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.959044 9814 ts_tablet_manager.cc:1905] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.960471 9815 ts_tablet_manager.cc:1918] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.961746 9815 log.cc:1196] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2b92039b9a484a768efa3714b58248ef
I20260928 14:50:41.962569 9815 ts_tablet_manager.cc:1939] T 2b92039b9a484a768efa3714b58248ef P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:41.963665 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2b92039b9a484a768efa3714b58248ef (table default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]) successfully deleted
I20260928 14:50:41.964645 9815 tablet_replica.cc:330] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:41.965016 9815 raft_consensus.cc:2229] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.965967 9815 raft_consensus.cc:2258] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.966984 9815 ts_tablet_manager.cc:1905] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:41.970113 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_64407deb9d1b496889a06e24ac68b9ce" } modify_external_catalogs: true
I20260928 14:50:41.970304 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_64407deb9d1b496889a06e24ac68b9ce" } modify_external_catalogs: true
I20260928 14:50:41.970513 9814 ts_tablet_manager.cc:1918] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.971443 9422 raft_consensus.cc:3037] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:41.982100 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f1cd1b3c22e4695985a10986a442034" } modify_external_catalogs: true
I20260928 14:50:41.982311 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f1cd1b3c22e4695985a10986a442034" } modify_external_catalogs: true
I20260928 14:50:41.989355 9815 ts_tablet_manager.cc:1918] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:41.970602 9814 log.cc:1196] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8234670cb2604ba7b405ad7f70e03a2f
I20260928 14:50:41.993295 9814 ts_tablet_manager.cc:1939] T 8234670cb2604ba7b405ad7f70e03a2f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:41.994241 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8234670cb2604ba7b405ad7f70e03a2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
I20260928 14:50:41.998895 9814 tablet_replica.cc:330] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:41.999105 9814 raft_consensus.cc:2229] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:41.999243 9814 raft_consensus.cc:2258] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:41.999732 9814 ts_tablet_manager.cc:1905] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.001312 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e2c5877a52264f0e9ebb070792e39e55
I20260928 14:50:41.995666 9855 tablet_bootstrap.cc:492] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.001847 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet d30d06c910fa4142a6248e8bfd00f4b2 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:42.001919 9855 ts_tablet_manager.cc:1397] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.069s user 0.000s sys 0.003s
I20260928 14:50:42.001904 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c5877a52264f0e9ebb070792e39e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.002107 9815 log.cc:1196] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/66772fac8b3747f0983562195abcc64e
I20260928 14:50:42.002127 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c5877a52264f0e9ebb070792e39e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.002390 9815 ts_tablet_manager.cc:1939] T 66772fac8b3747f0983562195abcc64e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.002385 10982 raft_consensus.cc:482] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.002488 10982 raft_consensus.cc:504] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.002745 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e2c5877a52264f0e9ebb070792e39e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c5877a52264f0e9ebb070792e39e55 already in progress: creating tablet
I20260928 14:50:42.003029 10982 leader_election.cc:288] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.003906 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d1100b862b4170807be02a39307359" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.004360 9220 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.004587 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 66772fac8b3747f0983562195abcc64e (table default.Table_cec79b345afa4c25bbd3c96ac88c6b11 [id=2e13625a246447c094acfbe1f0e6b106]) successfully deleted
I20260928 14:50:42.005304 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 599aa40a0fa54c13bcaf5450cdfed3a6 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:42.005798 9815 tablet_replica.cc:330] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.005963 9815 raft_consensus.cc:2229] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.006083 9815 raft_consensus.cc:2258] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.007272 9815 ts_tablet_manager.cc:1905] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.007905 9848 tablet_bootstrap.cc:492] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.008033 9848 ts_tablet_manager.cc:1397] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.000s
I20260928 14:50:42.008651 9848 raft_consensus.cc:348] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.008848 9848 raft_consensus.cc:374] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.008900 9848 raft_consensus.cc:729] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.009110 9814 ts_tablet_manager.cc:1918] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.009217 9814 log.cc:1196] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/eff9afcc868244aeb830fae2735da28d
I20260928 14:50:42.009541 9814 ts_tablet_manager.cc:1939] T eff9afcc868244aeb830fae2735da28d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.010373 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet eff9afcc868244aeb830fae2735da28d (table default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]) successfully deleted
I20260928 14:50:42.010442 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c5877a52264f0e9ebb070792e39e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:42.011883 9219 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 92d1100b862b4170807be02a39307359
I20260928 14:50:42.011978 9219 leader_election.cc:302] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.012280 11086 raft_consensus.cc:482] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.012383 11086 raft_consensus.cc:504] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.012936 11086 leader_election.cc:288] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.013254 10982 raft_consensus.cc:2726] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.013813 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4744deca899b4e6caa57f70ce1df8a8d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:42.014186 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4744deca899b4e6caa57f70ce1df8a8d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.014634 9498 leader_election.cc:341] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:42.014873 9497 leader_election.cc:341] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.014954 9497 leader_election.cc:302] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.016012 11086 raft_consensus.cc:2726] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.016454 9855 raft_consensus.cc:348] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.016760 9855 raft_consensus.cc:374] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.016839 9855 raft_consensus.cc:729] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.017057 9855 consensus_queue.cc:260] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.017683 9851 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.017809 9851 ts_tablet_manager.cc:1397] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.142s user 0.021s sys 0.045s
I20260928 14:50:42.018452 9851 raft_consensus.cc:348] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.018687 9851 raft_consensus.cc:374] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.018744 9851 raft_consensus.cc:729] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.019030 9851 consensus_queue.cc:260] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.020767 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 00b953b19dd54aaabf4dbefcd33600e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b953b19dd54aaabf4dbefcd33600e7 already in progress: creating tablet
I20260928 14:50:42.020999 9855 ts_tablet_manager.cc:1428] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.019s user 0.000s sys 0.001s
I20260928 14:50:42.021843 9855 tablet_bootstrap.cc:492] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.021451 9851 ts_tablet_manager.cc:1428] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:42.022001 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9b4cfb345e72457babc43037d8002d95
I20260928 14:50:42.022500 8955 catalog_manager.cc:6565] ReplaceTablet: tablet 9b4cfb345e72457babc43037d8002d95 deleted and replaced by tablet 1d0476e104034af9a75005a105c93fe1
I20260928 14:50:42.022673 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4cfb345e72457babc43037d8002d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d0476e104034af9a75005a105c93fe1) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.022765 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4cfb345e72457babc43037d8002d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d0476e104034af9a75005a105c93fe1) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.023654 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4cfb345e72457babc43037d8002d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d0476e104034af9a75005a105c93fe1) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:42.023682 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9b4cfb345e72457babc43037d8002d95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b4cfb345e72457babc43037d8002d95 already in progress: creating tablet
I20260928 14:50:42.022194 9851 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.025377 9851 tablet_bootstrap.cc:654] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.025758 9855 tablet_bootstrap.cc:654] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.028292 11106 tablet.cc:1722] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:42.033447 11111 raft_consensus.cc:482] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.033593 11111 raft_consensus.cc:504] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.034104 11111 leader_election.cc:288] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.034919 9360 leader_election.cc:341] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:42.035547 10906 raft_consensus.cc:482] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.035701 10906 raft_consensus.cc:504] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.036283 10906 leader_election.cc:288] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.037288 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ced67c921e43e48bcb5195da212582" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.037999 9360 leader_election.cc:341] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:42.038106 9360 leader_election.cc:302] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.038313 11111 raft_consensus.cc:2726] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:42.038391 9219 leader_election.cc:341] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 59ced67c921e43e48bcb5195da212582
W20260928 14:50:42.038717 9220 leader_election.cc:341] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.038827 9220 leader_election.cc:302] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.039150 10906 raft_consensus.cc:2726] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:42.040238 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e2c5877a52264f0e9ebb070792e39e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c5877a52264f0e9ebb070792e39e55 already in progress: creating tablet
I20260928 14:50:42.040150 9848 consensus_queue.cc:260] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.041659 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9b4cfb345e72457babc43037d8002d95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b4cfb345e72457babc43037d8002d95 already in progress: creating tablet
I20260928 14:50:42.046082 11192 tablet.cc:1722] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:42.050300 9855 tablet_bootstrap.cc:492] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.050489 9855 ts_tablet_manager.cc:1397] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260928 14:50:42.051265 9855 raft_consensus.cc:348] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.051543 9855 raft_consensus.cc:374] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.051693 9855 raft_consensus.cc:729] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.051955 9855 consensus_queue.cc:260] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.052250 9848 ts_tablet_manager.cc:1428] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260928 14:50:42.054047 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6cfe81624ecb41889dd2eeeaa5d0e771
W20260928 14:50:42.054284 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d263a96b792346b6af2a6eb29737afb6 consensus state has no leader
I20260928 14:50:42.055164 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.054064 10982 raft_consensus.cc:482] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.055348 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.055498 10982 raft_consensus.cc:504] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.055962 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.056325 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cfe81624ecb41889dd2eeeaa5d0e771 already in progress: creating tablet
I20260928 14:50:42.057597 10982 leader_election.cc:288] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.058808 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.058879 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.059108 9568 raft_consensus.cc:2454] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
W20260928 14:50:42.059340 9220 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:42.059544 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cfe81624ecb41889dd2eeeaa5d0e771 already in progress: creating tablet
I20260928 14:50:42.060287 9855 ts_tablet_manager.cc:1428] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 14:50:42.060447 9851 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.060411 9219 leader_election.cc:302] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.060557 9851 ts_tablet_manager.cc:1397] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.009s
I20260928 14:50:42.061587 9855 tablet_bootstrap.cc:492] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.061683 9848 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.062291 9851 raft_consensus.cc:348] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.062474 9851 raft_consensus.cc:374] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.062520 9851 raft_consensus.cc:729] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.062697 9851 consensus_queue.cc:260] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.063149 9851 ts_tablet_manager.cc:1428] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:42.063179 9848 tablet_bootstrap.cc:654] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.063393 9851 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.064880 9851 tablet_bootstrap.cc:654] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.065769 10906 raft_consensus.cc:2781] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.065848 10906 raft_consensus.cc:482] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.068532 9855 tablet_bootstrap.cc:654] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.069260 9815 ts_tablet_manager.cc:1918] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.069360 9815 log.cc:1196] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/76ad7685ece44665896f687697bddccf
I20260928 14:50:42.069929 9815 ts_tablet_manager.cc:1939] T 76ad7685ece44665896f687697bddccf P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:42.070688 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb2feb8adf57477ab915eea1d980d3e6 has no consensus state
I20260928 14:50:42.071931 9851 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.072052 9851 ts_tablet_manager.cc:1397] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:42.072602 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 76ad7685ece44665896f687697bddccf (table default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]) successfully deleted
I20260928 14:50:42.072909 9815 tablet_replica.cc:330] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:42.073066 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 514630efd793439fb757ab7f48c93198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514630efd793439fb757ab7f48c93198 already in progress: creating tablet
I20260928 14:50:42.073112 9815 raft_consensus.cc:2229] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.073272 9815 raft_consensus.cc:2258] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:42.073320 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ca2f614f5c964581ba64d31f0564f0f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca2f614f5c964581ba64d31f0564f0f9 already in progress: creating tablet
I20260928 14:50:42.073760 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_59caae98d16342cc8ea4b5b3e2f8fb76" } modify_external_catalogs: true
I20260928 14:50:42.073805 9815 ts_tablet_manager.cc:1905] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.073941 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_59caae98d16342cc8ea4b5b3e2f8fb76" } modify_external_catalogs: true
I20260928 14:50:42.074976 9851 raft_consensus.cc:348] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.075168 9851 raft_consensus.cc:374] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.075222 9851 raft_consensus.cc:729] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.075186 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d5ddea2bf7a347278afc8c7e3cf9510c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.075721 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5ddea2bf7a347278afc8c7e3cf9510c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.075383 9851 consensus_queue.cc:260] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.076795 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5b331f1608b64602b1a450728d95f2a7" } new_table_name: "default.Table_84f6b5fa7a6b4c37a06698b08c8f8e09" modify_external_catalogs: true
I20260928 14:50:42.076571 9851 ts_tablet_manager.cc:1428] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:42.077848 9851 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.073422 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_63d0876c753e4babab324808f06e208f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.078178 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63d0876c753e4babab324808f06e208f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.080876 9851 tablet_bootstrap.cc:654] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.093350 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f9806789400a4e15bd9e06860c9fd4df
I20260928 14:50:42.093959 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet f9806789400a4e15bd9e06860c9fd4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:42.094880 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f9806789400a4e15bd9e06860c9fd4df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9806789400a4e15bd9e06860c9fd4df already in progress: creating tablet
I20260928 14:50:42.094938 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet f9806789400a4e15bd9e06860c9fd4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.096568 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet f9806789400a4e15bd9e06860c9fd4df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.097466 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f9806789400a4e15bd9e06860c9fd4df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9806789400a4e15bd9e06860c9fd4df already in progress: creating tablet
I20260928 14:50:42.098505 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8d7b2061ae08444497fb94e097d5bf84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.099128 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d7b2061ae08444497fb94e097d5bf84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.102267 10982 raft_consensus.cc:482] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.102444 10982 raft_consensus.cc:504] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.103463 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82a58b7387564863a2141a722003c5d1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.103986 9220 leader_election.cc:341] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.104598 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3e1bbf59243f4cf6bfc0f770cd01934d
I20260928 14:50:42.105136 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:42.105213 9219 leader_election.cc:341] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 82a58b7387564863a2141a722003c5d1
I20260928 14:50:42.105314 9219 leader_election.cc:302] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.105644 10975 raft_consensus.cc:2726] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:42.106138 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3e1bbf59243f4cf6bfc0f770cd01934d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e1bbf59243f4cf6bfc0f770cd01934d already in progress: creating tablet
I20260928 14:50:42.106146 10982 leader_election.cc:288] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.106349 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.108268 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_12d8f6b419c946f48ae9f7c461999575" } new_table_name: "default.Table_267edcd5ab6549d8a3204bcc745fab2e" modify_external_catalogs: true
I20260928 14:50:42.111464 10906 raft_consensus.cc:3037] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.114105 11197 tablet.cc:1722] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:42.115473 9855 tablet_bootstrap.cc:492] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.115696 9855 ts_tablet_manager.cc:1397] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.001s
I20260928 14:50:42.116487 9855 raft_consensus.cc:348] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.116783 9855 raft_consensus.cc:374] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.116876 9855 raft_consensus.cc:729] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.117156 9855 consensus_queue.cc:260] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.119897 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 599aa40a0fa54c13bcaf5450cdfed3a6
I20260928 14:50:42.120348 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 599aa40a0fa54c13bcaf5450cdfed3a6 deleted and replaced by tablet 467804599a804a999c15b1fa44f5a9f6
I20260928 14:50:42.120229 10906 raft_consensus.cc:504] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.120790 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 467804599a804a999c15b1fa44f5a9f6) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:42.121556 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 599aa40a0fa54c13bcaf5450cdfed3a6 already in progress: creating tablet
I20260928 14:50:42.123042 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 467804599a804a999c15b1fa44f5a9f6) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.124006 9855 ts_tablet_manager.cc:1428] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 14:50:42.124086 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:42.124181 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f54c1b1f9054e1c9adfda720784e5a8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.124346 9567 raft_consensus.cc:3037] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:42.124555 9220 leader_election.cc:341] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.127434 9567 raft_consensus.cc:2454] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.127794 9219 leader_election.cc:302] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.127692 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3d233586a3884d9e823e355e84e58c36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.128047 10982 raft_consensus.cc:2781] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.128166 10982 raft_consensus.cc:686] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
W20260928 14:50:42.128278 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d233586a3884d9e823e355e84e58c36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.128382 10982 consensus_queue.cc:237] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.131002 9855 tablet_bootstrap.cc:492] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.116699 9815 ts_tablet_manager.cc:1918] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:42.134997 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 43f761337edf4a0f9e5dcda0ae28cffd
I20260928 14:50:42.135582 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:42.136436 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 43f761337edf4a0f9e5dcda0ae28cffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f761337edf4a0f9e5dcda0ae28cffd already in progress: creating tablet
I20260928 14:50:42.136466 10906 leader_election.cc:288] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.137961 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.139263 9851 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.139394 9851 ts_tablet_manager.cc:1397] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.015s
I20260928 14:50:42.139338 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6cf0e1af7830470ca8ba8b0906771406"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.139891 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cf0e1af7830470ca8ba8b0906771406 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.140013 9851 raft_consensus.cc:348] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.140193 9851 raft_consensus.cc:374] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.140240 9851 raft_consensus.cc:729] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.140465 9851 consensus_queue.cc:260] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.140969 9851 ts_tablet_manager.cc:1428] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:42.141583 9851 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.142311 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 467804599a804a999c15b1fa44f5a9f6) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.142395 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1bbf59243f4cf6bfc0f770cd01934d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.142859 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.143559 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 599aa40a0fa54c13bcaf5450cdfed3a6 already in progress: creating tablet
W20260928 14:50:42.143798 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3e1bbf59243f4cf6bfc0f770cd01934d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e1bbf59243f4cf6bfc0f770cd01934d already in progress: creating tablet
W20260928 14:50:42.144037 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 43f761337edf4a0f9e5dcda0ae28cffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f761337edf4a0f9e5dcda0ae28cffd already in progress: creating tablet
I20260928 14:50:42.145025 9851 tablet_bootstrap.cc:654] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.146473 9815 log.cc:1196] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6bdb6a6cea334521b13b5ebd47fbab98
I20260928 14:50:42.147159 9815 ts_tablet_manager.cc:1939] T 6bdb6a6cea334521b13b5ebd47fbab98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.148097 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6bdb6a6cea334521b13b5ebd47fbab98 (table default.Table_7d607b7787a24d45ab4b4132688daf5f [id=a8a5b906c0934e02abaf935134c22c8b]) successfully deleted
I20260928 14:50:42.146848 9855 tablet_bootstrap.cc:654] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.151863 9815 tablet_replica.cc:330] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.152096 9815 raft_consensus.cc:2229] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.152931 9815 raft_consensus.cc:2258] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.153188 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d97981f6266a4d3a903d343ca77cf898"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.153762 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d97981f6266a4d3a903d343ca77cf898 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.154273 9815 ts_tablet_manager.cc:1905] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:42.159576 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3cb1ec9ee0d42d795abc962b093d0dc consensus state has no leader
I20260928 14:50:42.162912 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dcba372056cd4a11b78766e934ccf0cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.163498 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcba372056cd4a11b78766e934ccf0cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.165171 9851 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.165318 9851 ts_tablet_manager.cc:1397] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.002s
I20260928 14:50:42.166149 9848 tablet_bootstrap.cc:492] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.166334 9848 ts_tablet_manager.cc:1397] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.114s user 0.003s sys 0.000s
I20260928 14:50:42.167346 9848 raft_consensus.cc:348] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.167567 9848 raft_consensus.cc:374] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.167646 9848 raft_consensus.cc:729] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.167876 9848 consensus_queue.cc:260] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.171254 9422 raft_consensus.cc:3037] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.177742 9848 ts_tablet_manager.cc:1428] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260928 14:50:42.179978 9848 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.180200 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c585bc08e1c54dbe8d038be704d4ecf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.180807 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c585bc08e1c54dbe8d038be704d4ecf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.184073 9848 tablet_bootstrap.cc:654] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.166744 9851 raft_consensus.cc:348] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.190376 9851 raft_consensus.cc:374] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.190450 9851 raft_consensus.cc:729] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.192175 9851 consensus_queue.cc:260] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.192958 9855 tablet_bootstrap.cc:492] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.193079 9855 ts_tablet_manager.cc:1397] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.001s
I20260928 14:50:42.194510 9851 ts_tablet_manager.cc:1428] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260928 14:50:42.193418 11111 raft_consensus.cc:482] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.194958 11111 raft_consensus.cc:504] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.195467 11111 leader_election.cc:288] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.193377 9848 tablet_bootstrap.cc:492] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.196033 9848 ts_tablet_manager.cc:1397] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260928 14:50:42.196693 9848 raft_consensus.cc:348] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.196877 9848 raft_consensus.cc:374] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.196921 9848 raft_consensus.cc:729] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:42.197358 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7341dac419f2443594ea9ef9c65f2daa consensus state has no leader
I20260928 14:50:42.198907 11106 tablet.cc:1722] T 42f7fb96f92a4e35b8561832e1d812d8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:42.199529 9851 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.201144 9851 tablet_bootstrap.cc:654] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:42.201195 9360 leader_election.cc:341] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:42.201472 11086 raft_consensus.cc:482] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.201637 11086 raft_consensus.cc:504] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.202154 11086 leader_election.cc:288] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.202765 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06859c8dcc41d99d29365aae350afa" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:42.203333 9497 leader_election.cc:341] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.206982 9848 consensus_queue.cc:260] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.208141 9848 ts_tablet_manager.cc:1428] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260928 14:50:42.208976 9848 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.209304 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d6ee0411db8d422bb5a9b900321e6e1d" } new_table_name: "default.Table_8d848dd0c09048fdac3651fd2c16f1e9" modify_external_catalogs: true
I20260928 14:50:42.209841 10982 raft_consensus.cc:482] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.209863 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_353dfdf4c71244adbe9a2d5216999d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.209959 10982 raft_consensus.cc:504] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:42.210395 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_353dfdf4c71244adbe9a2d5216999d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.210469 10982 leader_election.cc:288] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.210951 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.211377 9220 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.213045 9848 tablet_bootstrap.cc:654] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.213385 10982 raft_consensus.cc:482] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.213495 10982 raft_consensus.cc:504] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.214000 10982 leader_election.cc:288] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.214692 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.215149 9220 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.226501 10982 raft_consensus.cc:482] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.226629 10982 raft_consensus.cc:504] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.227100 10982 leader_election.cc:288] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.227607 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.228540 9220 leader_election.cc:341] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.230594 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_59c1bfec007c491f9db9f98c7ba8c58b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.231154 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59c1bfec007c491f9db9f98c7ba8c58b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:42.235402 9360 leader_election.cc:341] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:42.235514 9360 leader_election.cc:302] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.235469 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06859c8dcc41d99d29365aae350afa" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.235704 11111 raft_consensus.cc:2726] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:42.235946 9498 leader_election.cc:341] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.236069 9498 leader_election.cc:302] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.236406 11086 raft_consensus.cc:2726] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.237183 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.237673 9567 raft_consensus.cc:2454] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.238224 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.238391 9567 raft_consensus.cc:2454] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.239203 9855 raft_consensus.cc:348] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.239399 9855 raft_consensus.cc:374] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.239454 9855 raft_consensus.cc:729] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.239614 9855 consensus_queue.cc:260] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.240073 9855 ts_tablet_manager.cc:1428] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260928 14:50:42.240360 9855 tablet_bootstrap.cc:492] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.241895 9219 leader_election.cc:302] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.242264 9219 leader_election.cc:302] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.242587 10982 raft_consensus.cc:2781] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.242660 10982 raft_consensus.cc:482] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.242720 10982 raft_consensus.cc:3037] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.243503 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.243652 9567 raft_consensus.cc:2454] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.245261 9815 ts_tablet_manager.cc:1918] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.245165 10982 raft_consensus.cc:504] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.245357 9815 log.cc:1196] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/30d197a8ba8848d98ba0f03b2e83d3f6
I20260928 14:50:42.245636 9815 ts_tablet_manager.cc:1939] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.245849 10975 raft_consensus.cc:2781] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.245916 10975 raft_consensus.cc:482] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.245970 10975 raft_consensus.cc:3037] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.246958 9815 tablet_replica.cc:330] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.246922 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (table default.Table_2378f0131076405ab6f9ad2247f22c2b [id=74dcef243b8f4685bef322f403a2ebd2]) successfully deleted
I20260928 14:50:42.247139 9815 raft_consensus.cc:2229] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:42.247193 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8766eb621974471c9c8c5850088f4b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8766eb621974471c9c8c5850088f4b54 already in progress: creating tablet
I20260928 14:50:42.247270 9815 raft_consensus.cc:2258] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:42.247599 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bf94be2def6043cb8d0d39da62dd7c11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf94be2def6043cb8d0d39da62dd7c11 already in progress: creating tablet
I20260928 14:50:42.247727 9815 ts_tablet_manager.cc:1905] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.248330 10975 raft_consensus.cc:504] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.248848 10975 leader_election.cc:288] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.250818 9855 tablet_bootstrap.cc:654] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.250999 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:42.252024 9220 leader_election.cc:341] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.252944 9219 leader_election.cc:302] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.253289 10906 raft_consensus.cc:2781] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.253357 10906 raft_consensus.cc:482] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.253413 10906 raft_consensus.cc:3037] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.255548 10906 raft_consensus.cc:504] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.256034 10906 leader_election.cc:288] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.257727 9815 ts_tablet_manager.cc:1918] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.257972 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:42.258345 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:42.259261 9220 leader_election.cc:341] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:42.259447 9220 leader_election.cc:341] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.262033 10982 leader_election.cc:288] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.265170 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_658d0d60d5d542cca24520229c3b736e" } modify_external_catalogs: true
I20260928 14:50:42.265373 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_658d0d60d5d542cca24520229c3b736e" } modify_external_catalogs: true
I20260928 14:50:42.275992 9848 tablet_bootstrap.cc:492] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.276134 9848 ts_tablet_manager.cc:1397] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.017s
I20260928 14:50:42.278131 9848 raft_consensus.cc:348] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.278342 9848 raft_consensus.cc:374] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.278399 9848 raft_consensus.cc:729] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.278580 9848 consensus_queue.cc:260] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.282058 9848 ts_tablet_manager.cc:1428] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:42.282685 9848 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.284487 9848 tablet_bootstrap.cc:654] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.260114 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78379bd4cfce46fa812374f046d9d329" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.289996 9568 raft_consensus.cc:3037] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.292593 9568 raft_consensus.cc:2454] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.260298 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d6b4482e7b42fca17e5b917e1c1bed" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.292873 9567 raft_consensus.cc:3037] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.295274 9567 raft_consensus.cc:2454] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.262542 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36613153c867446f9255d2290cfd9d06" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.265394 9855 tablet_bootstrap.cc:492] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.295722 9569 raft_consensus.cc:3037] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.295783 9855 ts_tablet_manager.cc:1397] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.001s
I20260928 14:50:42.296502 9855 raft_consensus.cc:348] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.296715 9855 raft_consensus.cc:374] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.296782 9855 raft_consensus.cc:729] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.296972 9855 consensus_queue.cc:260] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.274487 11086 raft_consensus.cc:482] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.297328 11086 raft_consensus.cc:504] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.297911 11086 leader_election.cc:288] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.298056 9219 leader_election.cc:302] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.298342 11207 raft_consensus.cc:2781] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.298470 11207 raft_consensus.cc:686] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:42.298496 9219 leader_election.cc:302] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.298741 10906 raft_consensus.cc:2781] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.298832 10906 raft_consensus.cc:686] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:42.298696 11207 consensus_queue.cc:237] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.299028 10906 consensus_queue.cc:237] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.299191 9815 log.cc:1196] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7376f56883dc4032b120cc4494fa8936
I20260928 14:50:42.299501 9815 ts_tablet_manager.cc:1939] T 7376f56883dc4032b120cc4494fa8936 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.300143 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af22f23ff3864620bfefb31b9e899036" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:42.300297 9815 tablet_replica.cc:330] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.300506 9815 raft_consensus.cc:2229] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.300649 9815 raft_consensus.cc:2258] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.301515 9815 ts_tablet_manager.cc:1905] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:42.301658 9497 leader_election.cc:341] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.302040 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7376f56883dc4032b120cc4494fa8936 (table default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]) successfully deleted
I20260928 14:50:42.303089 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af22f23ff3864620bfefb31b9e899036" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.297912 9569 raft_consensus.cc:2454] T 36613153c867446f9255d2290cfd9d06 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.303637 9219 leader_election.cc:302] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
W20260928 14:50:42.303755 9498 leader_election.cc:341] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.303872 9498 leader_election.cc:302] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.303966 10982 raft_consensus.cc:2781] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.304060 10982 raft_consensus.cc:686] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:42.304239 10982 consensus_queue.cc:237] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.304805 11086 raft_consensus.cc:2726] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.310222 11086 raft_consensus.cc:482] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.310425 11086 raft_consensus.cc:504] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.311002 11086 leader_election.cc:288] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.311512 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.312094 9498 leader_election.cc:341] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.312743 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:42.312999 9284 raft_consensus.cc:2454] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:42.313534 9497 leader_election.cc:302] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.313983 11086 raft_consensus.cc:2781] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.314129 11086 raft_consensus.cc:482] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.314239 11086 raft_consensus.cc:3037] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.316772 11086 raft_consensus.cc:504] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.318022 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:42.318133 11086 leader_election.cc:288] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:42.318604 9498 leader_election.cc:341] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.318614 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae5af64cea44e7f86358edae40caa99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
I20260928 14:50:42.318773 9284 raft_consensus.cc:3037] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.326927 9284 raft_consensus.cc:2454] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:42.327313 9497 leader_election.cc:302] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.327728 11086 raft_consensus.cc:2781] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.327847 11086 raft_consensus.cc:686] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:42.328291 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 4a14c0b50cad4954b5dc5666689810ba from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:42.328848 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 86d21f615343473a95cd1f5040aebc79 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:42.330019 11111 raft_consensus.cc:482] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.330149 11111 raft_consensus.cc:504] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.330614 11111 leader_election.cc:288] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.331808 9360 leader_election.cc:341] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 01c1e945f1c54281856bfabe08fba42e
W20260928 14:50:42.332408 9360 leader_election.cc:341] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 01c1e945f1c54281856bfabe08fba42e
I20260928 14:50:42.332500 9360 leader_election.cc:302] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.332949 11111 raft_consensus.cc:2726] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.341710 9851 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.341836 9851 ts_tablet_manager.cc:1397] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.142s user 0.005s sys 0.023s
I20260928 14:50:42.342397 9851 raft_consensus.cc:348] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.342592 9851 raft_consensus.cc:374] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.342676 9851 raft_consensus.cc:729] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.342860 9851 consensus_queue.cc:260] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.346704 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 058da1b82b214b168ce2218ebada623d consensus state has no leader
I20260928 14:50:42.348722 8951 catalog_manager.cc:5495] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } }
I20260928 14:50:42.349221 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 01dd30e15c31498299ca5f5a3b2770e9 (table default.Table_c7c519080c7b493ca8249b294e8d446e [id=b58aea2205304defa62befcee84dfa0f]). Expected version 2 got 0
I20260928 14:50:42.350653 8949 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_f9d1f83d4b0d4777b9d3b3755b556817 [id=37f211d75f004ca08ff659cd19d592e9] alter complete (version 2)
I20260928 14:50:42.355531 9388 tablet_service.cc:1467] Processing CreateTablet for tablet d271c8012b634b2a816cc2360e5b2164 (DEFAULT_TABLE table=default.Table_08d5149e88d34336b608256fcc4d3224 [id=2806831ebca349409b25ac467229b59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.355904 9531 tablet_service.cc:1467] Processing CreateTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 (DEFAULT_TABLE table=default.Table_2dca633ce1cb4d73be5555582d483a78 [id=97a9a2ac5ea84e2f990ed6bd6e1b6708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.356002 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be6013a04c4222ab34a19e77e48a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.356309 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2feb8adf57477ab915eea1d980d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.356490 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d271c8012b634b2a816cc2360e5b2164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.356726 9408 tablet_service.cc:1467] Processing CreateTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 (DEFAULT_TABLE table=default.Table_2dca633ce1cb4d73be5555582d483a78 [id=97a9a2ac5ea84e2f990ed6bd6e1b6708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.357074 9390 tablet_service.cc:1467] Processing CreateTablet for tablet cc3037dc970f4546b1b929cdce0533c6 (DEFAULT_TABLE table=default.Table_901e0bed8c684dc280db304a5b7ff2e6 [id=8c39ad269fbc4e9aa5124e32844a6e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.357208 9851 ts_tablet_manager.cc:1428] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260928 14:50:42.357465 9851 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.357425 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 (DEFAULT_TABLE table=default.Table_3913883ec5c147228a2fd6f88cd71bbe [id=c5ff42da3db4479f8175c8f7cdb7af24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.357771 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5edc96bfc442b2949bbdcae2114ba1 (DEFAULT_TABLE table=default.Table_614ce0085880408f95148c5cd1d4bdf1 [id=e9a10b4e4d79463f9723d791ce2c1b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.358086 9402 tablet_service.cc:1467] Processing CreateTablet for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b (DEFAULT_TABLE table=default.Table_6762e5eabfad4539af773bee85caf7af [id=822729e399be445bb64548e05ee06c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.358471 9393 tablet_service.cc:1467] Processing CreateTablet for tablet e4a316ced72343439385d2147a97a418 (DEFAULT_TABLE table=default.Table_a1a4a02d7dc24b6c98671ec33ea09688 [id=917b5924b58c4fc69db17a73ecc3fcae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.358780 9403 tablet_service.cc:1467] Processing CreateTablet for tablet f7833450ddf24a3295b2e4e3d6389ddf (DEFAULT_TABLE table=default.Table_4153f81ed6014b388a2fa418d74e21a2 [id=74108d8d0b4748509a340dba2f6daa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.358989 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 73bbcf31960d478087a0a91337c34ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.359335 9855 ts_tablet_manager.cc:1428] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.063s user 0.004s sys 0.008s
I20260928 14:50:42.360594 9401 tablet_service.cc:1467] Processing CreateTablet for tablet 467f52f421e84ef5b588d3d613d440f3 (DEFAULT_TABLE table=default.Table_6d551c06d8bf4d97a6a09ba38546de30 [id=e56ad6dc1de34da3854b47f36ecd4c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.360720 9855 tablet_bootstrap.cc:492] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.360762 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c (DEFAULT_TABLE table=default.Table_e18a59d02d3441e1bc6f6704a4f9d67b [id=b53f98753afe4904817ce0669319d801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.361095 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 7a538edaf07a4fa2833fc32645803e73 (DEFAULT_TABLE table=default.Table_d57b7d81e0b6433189e5a27563cb7f4a [id=649f8268c5f24cfb86707eacf852e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.361191 9389 tablet_service.cc:1467] Processing CreateTablet for tablet a8f6de1135234f58aa2e534efead2880 (DEFAULT_TABLE table=default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.362519 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b2d1d9d89eea4bfab15897c49448c30e" } modify_external_catalogs: true
I20260928 14:50:42.362759 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b2d1d9d89eea4bfab15897c49448c30e" } modify_external_catalogs: true
I20260928 14:50:42.363365 9813 tablet_replica.cc:330] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.363535 9813 raft_consensus.cc:2229] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.363680 9813 raft_consensus.cc:2258] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.363901 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_179a0cdc7fb945369cf32b7380fb39fe" } new_table_name: "default.Table_fc40bc4e324e44b79c283937cc1639f8" modify_external_catalogs: true
I20260928 14:50:42.364188 9813 ts_tablet_manager.cc:1905] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.364981 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2feb8adf57477ab915eea1d980d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.366097 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_431c77ade78b48c5bf9d05d1f976d3a1" } modify_external_catalogs: true
I20260928 14:50:42.366274 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_431c77ade78b48c5bf9d05d1f976d3a1" } modify_external_catalogs: true
I20260928 14:50:42.367519 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3037dc970f4546b1b929cdce0533c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.369442 9813 ts_tablet_manager.cc:1918] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.369565 9813 log.cc:1196] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/a7be6013a04c4222ab34a19e77e48a37
I20260928 14:50:42.369912 9813 ts_tablet_manager.cc:1939] T a7be6013a04c4222ab34a19e77e48a37 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:42.370833 9813 tablet_replica.cc:330] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.371050 9813 raft_consensus.cc:2229] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.371066 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_36cf8fd2a6414734ab97181860917d4f" } modify_external_catalogs: true
I20260928 14:50:42.371203 9813 raft_consensus.cc:2258] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.371256 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_36cf8fd2a6414734ab97181860917d4f" } modify_external_catalogs: true
I20260928 14:50:42.371704 9813 ts_tablet_manager.cc:1905] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.372730 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet a7be6013a04c4222ab34a19e77e48a37 (table default.Table_f98414a2078e42889dfadeb64bfb5506 [id=53bac70795e248a2b3b7b3237ad27a18]) successfully deleted
I20260928 14:50:42.373064 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a668806adc4975bebb4ebb1a9d3c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.379792 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_49fa394c7baf4558b7413994dc2fc2ed" } new_table_name: "default.Table_f986b2cfaa8e432e920f72ed1f4f10e4" modify_external_catalogs: true
I20260928 14:50:42.380859 9541 tablet_service.cc:1467] Processing CreateTablet for tablet e4a316ced72343439385d2147a97a418 (DEFAULT_TABLE table=default.Table_a1a4a02d7dc24b6c98671ec33ea09688 [id=917b5924b58c4fc69db17a73ecc3fcae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.381212 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a316ced72343439385d2147a97a418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.381234 9535 tablet_service.cc:1467] Processing CreateTablet for tablet cc3037dc970f4546b1b929cdce0533c6 (DEFAULT_TABLE table=default.Table_901e0bed8c684dc280db304a5b7ff2e6 [id=8c39ad269fbc4e9aa5124e32844a6e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.381611 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3037dc970f4546b1b929cdce0533c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.385763 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5edc96bfc442b2949bbdcae2114ba1 (DEFAULT_TABLE table=default.Table_614ce0085880408f95148c5cd1d4bdf1 [id=e9a10b4e4d79463f9723d791ce2c1b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.385967 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5edc96bfc442b2949bbdcae2114ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.385990 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c (DEFAULT_TABLE table=default.Table_e18a59d02d3441e1bc6f6704a4f9d67b [id=b53f98753afe4904817ce0669319d801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.386081 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5edc96bfc442b2949bbdcae2114ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.386312 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.386502 9537 tablet_service.cc:1467] Processing CreateTablet for tablet d271c8012b634b2a816cc2360e5b2164 (DEFAULT_TABLE table=default.Table_08d5149e88d34336b608256fcc4d3224 [id=2806831ebca349409b25ac467229b59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.386778 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d271c8012b634b2a816cc2360e5b2164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.389739 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.389732 9533 tablet_service.cc:1467] Processing CreateTablet for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b (DEFAULT_TABLE table=default.Table_6762e5eabfad4539af773bee85caf7af [id=822729e399be445bb64548e05ee06c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.390029 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.393792 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a316ced72343439385d2147a97a418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.393786 9530 tablet_service.cc:1467] Processing CreateTablet for tablet f7833450ddf24a3295b2e4e3d6389ddf (DEFAULT_TABLE table=default.Table_4153f81ed6014b388a2fa418d74e21a2 [id=74108d8d0b4748509a340dba2f6daa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.394074 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7833450ddf24a3295b2e4e3d6389ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.397742 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7833450ddf24a3295b2e4e3d6389ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.397745 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 7a538edaf07a4fa2833fc32645803e73 (DEFAULT_TABLE table=default.Table_d57b7d81e0b6433189e5a27563cb7f4a [id=649f8268c5f24cfb86707eacf852e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.397926 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467f52f421e84ef5b588d3d613d440f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.398020 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a538edaf07a4fa2833fc32645803e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.398178 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.399822 11210 raft_consensus.cc:482] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.399947 11210 raft_consensus.cc:504] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.401031 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846a96509f32416087ee4667458c367e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.401657 9498 leader_election.cc:341] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.401780 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a538edaf07a4fa2833fc32645803e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.401741 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 467f52f421e84ef5b588d3d613d440f3 (DEFAULT_TABLE table=default.Table_6d551c06d8bf4d97a6a09ba38546de30 [id=e56ad6dc1de34da3854b47f36ecd4c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.402024 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467f52f421e84ef5b588d3d613d440f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.402084 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f6de1135234f58aa2e534efead2880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.404292 11210 leader_election.cc:288] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.406419 9855 tablet_bootstrap.cc:654] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.406356 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_147ccdd8fd7b46d6a1795605ede946e1" } modify_external_catalogs: true
I20260928 14:50:42.406556 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_147ccdd8fd7b46d6a1795605ede946e1" } modify_external_catalogs: true
I20260928 14:50:42.408241 9851 tablet_bootstrap.cc:654] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.385769 9536 tablet_service.cc:1467] Processing CreateTablet for tablet a8f6de1135234f58aa2e534efead2880 (DEFAULT_TABLE table=default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.409806 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f6de1135234f58aa2e534efead2880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.385769 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 (DEFAULT_TABLE table=default.Table_3913883ec5c147228a2fd6f88cd71bbe [id=c5ff42da3db4479f8175c8f7cdb7af24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.410256 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a668806adc4975bebb4ebb1a9d3c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.410400 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846a96509f32416087ee4667458c367e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:42.410952 9497 leader_election.cc:341] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.411046 9497 leader_election.cc:302] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.415045 11210 raft_consensus.cc:482] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.415261 11210 raft_consensus.cc:504] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.416266 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af72ac7bedb4cd7aed28cffda867c96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.416829 9498 leader_election.cc:341] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.417021 11210 leader_election.cc:288] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.417197 11210 raft_consensus.cc:2726] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.424896 9813 ts_tablet_manager.cc:1918] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.425084 9813 log.cc:1196] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/73bbcf31960d478087a0a91337c34ec8
I20260928 14:50:42.425462 9813 ts_tablet_manager.cc:1939] T 73bbcf31960d478087a0a91337c34ec8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:42.426604 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 73bbcf31960d478087a0a91337c34ec8 (table default.Table_7cbe9b800b63472f9c3edbe98510060c [id=40cbb3838eac45129f8df57636ce48dc]) successfully deleted
I20260928 14:50:42.429512 9851 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.431958 11207 raft_consensus.cc:482] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.429679 9851 ts_tablet_manager.cc:1397] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.000s
I20260928 14:50:42.432250 11207 raft_consensus.cc:504] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.432891 11207 leader_election.cc:288] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.433287 11207 raft_consensus.cc:482] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.433495 11207 raft_consensus.cc:504] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.434338 9851 raft_consensus.cc:348] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.434545 9851 raft_consensus.cc:374] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.434603 9851 raft_consensus.cc:729] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.434775 9851 consensus_queue.cc:260] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.435184 9851 ts_tablet_manager.cc:1428] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260928 14:50:42.435436 9851 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.445415 11111 raft_consensus.cc:482] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.445569 11111 raft_consensus.cc:504] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.446128 11111 leader_election.cc:288] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.447283 9360 leader_election.cc:341] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8520b28899bc42b08e239502adb8fece
I20260928 14:50:42.450626 9851 tablet_bootstrap.cc:654] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.452569 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.452768 9569 raft_consensus.cc:2454] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.453457 9219 leader_election.cc:302] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:42.430958 11217 raft_consensus.cc:482] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.454391 11217 raft_consensus.cc:504] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.454975 11217 leader_election.cc:288] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.455484 10982 raft_consensus.cc:2781] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.455607 10982 raft_consensus.cc:482] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.455729 10982 raft_consensus.cc:3037] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:42.459837 9219 leader_election.cc:341] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:42.465948 11207 leader_election.cc:288] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:42.466912 9219 leader_election.cc:341] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:42.468251 9851 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.468371 9851 ts_tablet_manager.cc:1397] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.002s
I20260928 14:50:42.468374 9855 tablet_bootstrap.cc:492] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.468555 9855 ts_tablet_manager.cc:1397] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.108s user 0.007s sys 0.004s
I20260928 14:50:42.468987 9851 raft_consensus.cc:348] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.469187 9851 raft_consensus.cc:374] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.469234 9851 raft_consensus.cc:729] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.469362 9855 raft_consensus.cc:348] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.469684 9855 raft_consensus.cc:374] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.469782 9855 raft_consensus.cc:729] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.470026 9855 consensus_queue.cc:260] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.470018 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af72ac7bedb4cd7aed28cffda867c96" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:42.470129 9249 tablet_service.cc:1467] Processing CreateTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 (DEFAULT_TABLE table=default.Table_2dca633ce1cb4d73be5555582d483a78 [id=97a9a2ac5ea84e2f990ed6bd6e1b6708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.470477 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2feb8adf57477ab915eea1d980d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:42.470530 9497 leader_election.cc:341] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.470623 9497 leader_election.cc:302] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.470688 9855 ts_tablet_manager.cc:1428] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:42.470907 9855 tablet_bootstrap.cc:492] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.474094 11210 raft_consensus.cc:2726] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.476176 10982 raft_consensus.cc:504] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.476703 10982 leader_election.cc:288] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.477185 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.477355 9569 raft_consensus.cc:3037] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.479732 9569 raft_consensus.cc:2454] T 55c81b682dea493fac8665d8ccff7199 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.482120 9219 leader_election.cc:302] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:42.483224 9249 tablet_service.cc:1467] Processing CreateTablet for tablet cc3037dc970f4546b1b929cdce0533c6 (DEFAULT_TABLE table=default.Table_901e0bed8c684dc280db304a5b7ff2e6 [id=8c39ad269fbc4e9aa5124e32844a6e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.483603 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3037dc970f4546b1b929cdce0533c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.484032 9855 tablet_bootstrap.cc:654] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.485536 11223 raft_consensus.cc:2781] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.485653 11223 raft_consensus.cc:686] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:42.485849 11223 consensus_queue.cc:237] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.488144 11218 consensus_queue.cc:1035] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:42.495324 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a5b3b4611c6c4e96a7ac8df34eaab11c
I20260928 14:50:42.496130 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 9d6fbbadaf0b4e4685f398496cf4e434
I20260928 14:50:42.497597 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.497443 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.498227 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a5b3b4611c6c4e96a7ac8df34eaab11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b3b4611c6c4e96a7ac8df34eaab11c already in progress: creating tablet
I20260928 14:50:42.498585 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 (DEFAULT_TABLE table=default.Table_3913883ec5c147228a2fd6f88cd71bbe [id=c5ff42da3db4479f8175c8f7cdb7af24]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:42.498647 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9d6fbbadaf0b4e4685f398496cf4e434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6fbbadaf0b4e4685f398496cf4e434 already in progress: creating tablet
I20260928 14:50:42.498901 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a668806adc4975bebb4ebb1a9d3c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.499929 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5edc96bfc442b2949bbdcae2114ba1 (DEFAULT_TABLE table=default.Table_614ce0085880408f95148c5cd1d4bdf1 [id=e9a10b4e4d79463f9723d791ce2c1b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.500150 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcc42af91c247b1b80059e95e3659cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.500280 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5edc96bfc442b2949bbdcae2114ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.500437 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.500437 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.500454 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.500648 9814 tablet_replica.cc:330] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.500924 9814 raft_consensus.cc:2229] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.501127 9814 raft_consensus.cc:2258] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.501863 9814 ts_tablet_manager.cc:1905] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:42.504335 9360 leader_election.cc:341] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 8520b28899bc42b08e239502adb8fece
I20260928 14:50:42.504437 9360 leader_election.cc:302] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.504738 11111 raft_consensus.cc:2726] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.505709 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.506032 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet af22f23ff3864620bfefb31b9e899036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.506707 11228 raft_consensus.cc:482] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.506879 11228 raft_consensus.cc:504] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.507344 9815 ts_tablet_manager.cc:1918] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.507452 11228 leader_election.cc:288] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.511842 9814 ts_tablet_manager.cc:1918] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.511994 9814 log.cc:1196] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:42.512348 9814 ts_tablet_manager.cc:1939] T ab71087d034c4bedb06df9e5ccefad45 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.507982 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.512987 9568 raft_consensus.cc:2454] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.513365 9219 leader_election.cc:302] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:42.513672 9815 log.cc:1196] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9f2c5afbdeda4ddfb82124031135e6cb
I20260928 14:50:42.514086 9815 ts_tablet_manager.cc:1939] T 9f2c5afbdeda4ddfb82124031135e6cb P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.514329 11228 raft_consensus.cc:2781] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.514555 11228 raft_consensus.cc:482] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.514616 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.514832 11228 raft_consensus.cc:3037] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.515009 9814 tablet_replica.cc:330] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.515228 9814 raft_consensus.cc:2229] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.515393 9814 raft_consensus.cc:2258] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.515857 9814 ts_tablet_manager.cc:1905] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.517055 9855 tablet_bootstrap.cc:492] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.519518 11228 raft_consensus.cc:504] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.520570 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9f2c5afbdeda4ddfb82124031135e6cb (table default.Table_fc1ba1d4357b4f88865fb323d86d0bc4 [id=b9da8f3786084226ae396c4c3a19b20b]) successfully deleted
I20260928 14:50:42.521245 11192 tablet.cc:1722] T 5127a4bb7e114ec09235c9e29f614156 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:42.521389 9814 ts_tablet_manager.cc:1918] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.522053 9855 ts_tablet_manager.cc:1397] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.003s
I20260928 14:50:42.522974 9855 raft_consensus.cc:348] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.523221 9855 raft_consensus.cc:374] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.523311 9855 raft_consensus.cc:729] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.525616 11227 raft_consensus.cc:482] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.525946 11227 raft_consensus.cc:504] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.526031 9855 consensus_queue.cc:260] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.526455 11227 leader_election.cc:288] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.526755 9855 ts_tablet_manager.cc:1428] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:42.519373 11086 consensus_queue.cc:237] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.528451 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fcc42af91c247b1b80059e95e3659cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.528649 11197 tablet.cc:1722] T 5127a4bb7e114ec09235c9e29f614156 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 14:50:42.529012 9498 leader_election.cc:341] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.534420 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.534461 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc5ee93708ea4f3fabdf93aa9c33c1c8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.534763 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f04c05cdad04261a1e2ae7e044ddbfb" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.535907 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ca013d1c5b44730b7163e71dc408b04 consensus state has no leader
I20260928 14:50:42.536715 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 30b0e3b18c724493a44c99d990013f34
I20260928 14:50:42.536859 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ab71087d034c4bedb06df9e5ccefad45 (table default.Table_6e50a29433014e98b687ee424debf6d5 [id=c21ae162198d4e5393efc4d962fd68b1]) successfully deleted
I20260928 14:50:42.537514 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 17cd74cf48ce42c3beda4556213f416a
I20260928 14:50:42.540910 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5127a4bb7e114ec09235c9e29f614156 (table default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2]). Expected version 1 got 0
I20260928 14:50:42.542341 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e3416f0cbb8a417b9a8a1a1d36e4b7f7" } new_table_name: "default.Table_ff3b7b23759746ae9c50bc0d820e068d" modify_external_catalogs: true
I20260928 14:50:42.542579 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b0e3b18c724493a44c99d990013f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.542773 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 17cd74cf48ce42c3beda4556213f416a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.543687 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d7b2061ae08444497fb94e097d5bf84" } new_table_name: "default.Table_2d301fe970e5485298f6c45e414c5d81" modify_external_catalogs: true
I20260928 14:50:42.544654 11210 consensus_queue.cc:1035] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:42.544912 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eef0b655cea940fe9168838d4c3bcaf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.545536 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eef0b655cea940fe9168838d4c3bcaf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.545882 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.546051 9567 raft_consensus.cc:3037] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.546875 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_fa618acba76146c38ef92d78d5d33ac7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.547075 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:42.547372 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa618acba76146c38ef92d78d5d33ac7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.548377 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.549057 9567 raft_consensus.cc:2454] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.549012 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6f501e4753ad4e16be7238bc969b0a7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.549506 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f501e4753ad4e16be7238bc969b0a7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.550642 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b0e3b18c724493a44c99d990013f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.550863 9813 tablet_replica.cc:330] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.551038 9813 raft_consensus.cc:2229] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.551204 9813 raft_consensus.cc:2258] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.551695 9813 ts_tablet_manager.cc:1905] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.552570 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:42.521842 9252 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.522464 9256 tablet_service.cc:1467] Processing CreateTablet for tablet d271c8012b634b2a816cc2360e5b2164 (DEFAULT_TABLE table=default.Table_08d5149e88d34336b608256fcc4d3224 [id=2806831ebca349409b25ac467229b59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.523116 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.523663 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.526389 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.526918 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fcc42af91c247b1b80059e95e3659cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:42.527081 9262 tablet_service.cc:1467] Processing CreateTablet for tablet e4a316ced72343439385d2147a97a418 (DEFAULT_TABLE table=default.Table_a1a4a02d7dc24b6c98671ec33ea09688 [id=917b5924b58c4fc69db17a73ecc3fcae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.527211 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 7a538edaf07a4fa2833fc32645803e73 (DEFAULT_TABLE table=default.Table_d57b7d81e0b6433189e5a27563cb7f4a [id=649f8268c5f24cfb86707eacf852e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.553962 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d271c8012b634b2a816cc2360e5b2164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.554153 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a538edaf07a4fa2833fc32645803e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.469400 9851 consensus_queue.cc:260] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.527349 9257 tablet_service.cc:1467] Processing CreateTablet for tablet f7833450ddf24a3295b2e4e3d6389ddf (DEFAULT_TABLE table=default.Table_4153f81ed6014b388a2fa418d74e21a2 [id=74108d8d0b4748509a340dba2f6daa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.554348 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a316ced72343439385d2147a97a418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.527462 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 467f52f421e84ef5b588d3d613d440f3 (DEFAULT_TABLE table=default.Table_6d551c06d8bf4d97a6a09ba38546de30 [id=e56ad6dc1de34da3854b47f36ecd4c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.554507 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7833450ddf24a3295b2e4e3d6389ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.532716 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c (DEFAULT_TABLE table=default.Table_e18a59d02d3441e1bc6f6704a4f9d67b [id=b53f98753afe4904817ce0669319d801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.554739 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467f52f421e84ef5b588d3d613d440f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.554914 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:42.555052 9497 leader_election.cc:341] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.555155 9497 leader_election.cc:302] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.533097 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet a5b3b4611c6c4e96a7ac8df34eaab11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.533171 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6fbbadaf0b4e4685f398496cf4e434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.539674 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b0e3b18c724493a44c99d990013f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.539829 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 17cd74cf48ce42c3beda4556213f416a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:42.559350 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f977693e429d4345b1156f879c4dd471 consensus state has no leader
I20260928 14:50:42.560645 11227 raft_consensus.cc:2726] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.561302 9851 ts_tablet_manager.cc:1428] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.093s user 0.002s sys 0.000s
I20260928 14:50:42.561291 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 17cd74cf48ce42c3beda4556213f416a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.561571 9851 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.544654 9249 tablet_service.cc:1467] Processing CreateTablet for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b (DEFAULT_TABLE table=default.Table_6762e5eabfad4539af773bee85caf7af [id=822729e399be445bb64548e05ee06c26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.561807 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ddfff45616b34ccbae6690c77ff66c2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.561996 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c6dc60700f41f09b8bbbd8dff2fa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.545089 11228 leader_election.cc:288] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.549629 9219 leader_election.cc:302] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
W20260928 14:50:42.562281 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddfff45616b34ccbae6690c77ff66c2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.562453 11228 raft_consensus.cc:2781] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.562556 11228 raft_consensus.cc:686] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
W20260928 14:50:42.553017 9220 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.529232 9265 tablet_service.cc:1467] Processing CreateTablet for tablet a8f6de1135234f58aa2e534efead2880 (DEFAULT_TABLE table=default.Table_a0f0a244b6ba408d913cec35fdead9db [id=fee7478c31d54663aa41d4e1ce00a6ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:42.563277 9220 leader_election.cc:341] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.563460 9220 leader_election.cc:302] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.563712 11218 raft_consensus.cc:2726] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.563941 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8f6de1135234f58aa2e534efead2880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.564323 9814 log.cc:1196] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:42.568794 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 59e5efe8275844c28200369135695e07
I20260928 14:50:42.570438 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e5efe8275844c28200369135695e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.572490 9220 leader_election.cc:341] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.573057 8956 catalog_manager.cc:5495] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:42.573728 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:42.574016 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:42.574179 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:42.575137 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e5efe8275844c28200369135695e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.572584 9220 leader_election.cc:302] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:42.575701 9220 raft_consensus.cc:2670] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:42.579362 9814 ts_tablet_manager.cc:1939] T 9f04c05cdad04261a1e2ae7e044ddbfb P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.580361 9814 tablet_replica.cc:330] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:42.582172 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 00b953b19dd54aaabf4dbefcd33600e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b953b19dd54aaabf4dbefcd33600e7 already in progress: creating tablet
W20260928 14:50:42.582409 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e2c5877a52264f0e9ebb070792e39e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c5877a52264f0e9ebb070792e39e55 already in progress: creating tablet
W20260928 14:50:42.582599 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9b4cfb345e72457babc43037d8002d95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b4cfb345e72457babc43037d8002d95 already in progress: creating tablet
W20260928 14:50:42.582758 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6cfe81624ecb41889dd2eeeaa5d0e771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cfe81624ecb41889dd2eeeaa5d0e771 already in progress: creating tablet
W20260928 14:50:42.583014 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f9806789400a4e15bd9e06860c9fd4df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9806789400a4e15bd9e06860c9fd4df already in progress: creating tablet
I20260928 14:50:42.583036 9814 raft_consensus.cc:2229] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:42.583218 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3e1bbf59243f4cf6bfc0f770cd01934d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e1bbf59243f4cf6bfc0f770cd01934d already in progress: creating tablet
I20260928 14:50:42.583374 9855 tablet_bootstrap.cc:492] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:42.583801 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 599aa40a0fa54c13bcaf5450cdfed3a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 599aa40a0fa54c13bcaf5450cdfed3a6 already in progress: creating tablet
I20260928 14:50:42.583178 9814 raft_consensus.cc:2258] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.584519 9814 ts_tablet_manager.cc:1905] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.584616 9855 tablet_bootstrap.cc:654] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:42.584831 9220 consensus_peers.cc:487] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:42.585798 9220 leader_election.cc:341] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:42.586637 9220 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.589617 10975 raft_consensus.cc:482] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.589732 10975 raft_consensus.cc:504] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.590210 10975 leader_election.cc:288] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.589651 9220 leader_election.cc:341] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.590901 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:42.591089 9567 raft_consensus.cc:2454] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:42.591451 9219 leader_election.cc:302] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:42.591681 10975 raft_consensus.cc:2781] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:42.591744 10975 raft_consensus.cc:482] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:42.591806 10975 raft_consensus.cc:3037] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.594105 11106 tablet.cc:1722] T 5127a4bb7e114ec09235c9e29f614156 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:42.594172 10975 raft_consensus.cc:504] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.594662 10975 leader_election.cc:288] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:42.594777 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.594916 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e5efe8275844c28200369135695e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.595398 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:42.595548 9567 raft_consensus.cc:3037] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:42.597937 9567 raft_consensus.cc:2454] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:42.562772 11228 consensus_queue.cc:237] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.600061 9219 leader_election.cc:302] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:42.600358 10975 raft_consensus.cc:2781] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:42.600512 10975 raft_consensus.cc:686] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:42.600749 10975 consensus_queue.cc:237] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:42.602751 8939 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f977693e429d4345b1156f879c4dd471 (table default.Table_f986b2cfaa8e432e920f72ed1f4f10e4 [id=d016a71b141b4ad2860c445b98ef9a4c], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f977693e429d4345b1156f879c4dd471 consensus state has no leader
I20260928 14:50:42.603273 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9f04c05cdad04261a1e2ae7e044ddbfb (table default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]) successfully deleted
I20260928 14:50:42.604135 9851 tablet_bootstrap.cc:654] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.598012 9813 ts_tablet_manager.cc:1918] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:42.598718 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d94bf844904306b84695e452d62ebd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:42.606469 9813 log.cc:1196] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/30b0e3b18c724493a44c99d990013f34
I20260928 14:50:42.606789 9813 ts_tablet_manager.cc:1939] T 30b0e3b18c724493a44c99d990013f34 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:42.607329 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 30b0e3b18c724493a44c99d990013f34 (table default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]) successfully deleted
I20260928 14:50:42.607625 11086 raft_consensus.cc:482] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:42.607846 9220 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.607798 11086 raft_consensus.cc:504] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.608114 9220 leader_election.cc:341] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.608763 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:42.609310 9497 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.610212 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.610675 9498 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.610772 9498 leader_election.cc:302] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.611027 11227 raft_consensus.cc:2726] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.611235 11086 leader_election.cc:288] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:42.612476 9220 consensus_peers.cc:487] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:42.613013 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 17cd74cf48ce42c3beda4556213f416a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17cd74cf48ce42c3beda4556213f416a already in progress: creating tablet
I20260928 14:50:42.613108 9855 tablet_bootstrap.cc:492] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.613212 9855 ts_tablet_manager.cc:1397] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.001s
I20260928 14:50:42.613948 9855 raft_consensus.cc:348] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.614143 9855 raft_consensus.cc:374] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.614192 9855 raft_consensus.cc:729] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.614360 9855 consensus_queue.cc:260] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.614610 9815 tablet_replica.cc:330] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:42.614713 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 59e5efe8275844c28200369135695e07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59e5efe8275844c28200369135695e07 already in progress: creating tablet
I20260928 14:50:42.614876 9855 ts_tablet_manager.cc:1428] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:42.615121 9855 tablet_bootstrap.cc:492] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:42.615721 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 43f761337edf4a0f9e5dcda0ae28cffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f761337edf4a0f9e5dcda0ae28cffd already in progress: creating tablet
I20260928 14:50:42.616523 9855 tablet_bootstrap.cc:654] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.616582 9814 ts_tablet_manager.cc:1918] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.617430 9814 log.cc:1196] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:42.617481 9815 raft_consensus.cc:2229] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.617702 9815 raft_consensus.cc:2258] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.618232 9815 ts_tablet_manager.cc:1905] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.620584 9814 ts_tablet_manager.cc:1939] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.621060 9814 tablet_replica.cc:330] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.621272 9814 raft_consensus.cc:2229] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.621474 9814 raft_consensus.cc:2258] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.621750 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 86d21f615343473a95cd1f5040aebc79
I20260928 14:50:42.622009 9814 ts_tablet_manager.cc:1905] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.622153 8946 catalog_manager.cc:6565] ReplaceTablet: tablet 86d21f615343473a95cd1f5040aebc79 deleted and replaced by tablet b17faf5198e048b2824aea3308070fa8
W20260928 14:50:42.623446 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77c9ac6b283e4711bcf46a68f7de37a5 consensus state has no leader
I20260928 14:50:42.623663 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 66772fac8b3747f0983562195abcc64e from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:42.624018 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d1d0fb55d38407d8b94938745a06c85 has no consensus state
I20260928 14:50:42.624791 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 86d21f615343473a95cd1f5040aebc79 with delete_type TABLET_DATA_DELETED (replaced by tablet b17faf5198e048b2824aea3308070fa8) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.625239 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 86d21f615343473a95cd1f5040aebc79 with delete_type TABLET_DATA_DELETED (replaced by tablet b17faf5198e048b2824aea3308070fa8) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.625928 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 86d21f615343473a95cd1f5040aebc79 with delete_type TABLET_DATA_DELETED (replaced by tablet b17faf5198e048b2824aea3308070fa8) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.626855 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (table default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]) successfully deleted
I20260928 14:50:42.628165 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e18a59d02d3441e1bc6f6704a4f9d67b" } new_table_name: "default.Table_14ce1e2c279449f99310a50520454758" modify_external_catalogs: true
I20260928 14:50:42.629428 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_951b956bd54e4638ab60ffd1774fda07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.629871 9813 tablet_replica.cc:330] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.630043 9813 raft_consensus.cc:2229] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.630178 9855 tablet_bootstrap.cc:492] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.630272 9855 ts_tablet_manager.cc:1397] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20260928 14:50:42.630167 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_eaa64bfb59d24da6a26c2aa26935864b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.630306 9813 raft_consensus.cc:2258] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:42.630667 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaa64bfb59d24da6a26c2aa26935864b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.630777 9813 ts_tablet_manager.cc:1905] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.630884 9855 raft_consensus.cc:348] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.631064 9855 raft_consensus.cc:374] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.631108 9855 raft_consensus.cc:729] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.631430 9851 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.631536 9851 ts_tablet_manager.cc:1397] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.070s user 0.001s sys 0.003s
I20260928 14:50:42.631801 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e6a5804ccfed48b2ba911013b6a4b1ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.632285 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6a5804ccfed48b2ba911013b6a4b1ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.633381 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b1e0f6176c744afc8e6250bfbdc9ba66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.633832 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1e0f6176c744afc8e6250bfbdc9ba66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.634209 9855 consensus_queue.cc:260] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.632177 9851 raft_consensus.cc:348] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.634794 9851 raft_consensus.cc:374] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.634855 9851 raft_consensus.cc:729] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.634878 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_92dcab49752f419c829f062d4491450f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.635027 9851 consensus_queue.cc:260] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.635277 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92dcab49752f419c829f062d4491450f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.637030 9815 ts_tablet_manager.cc:1918] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:42.637353 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_951b956bd54e4638ab60ffd1774fda07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.637742 9851 ts_tablet_manager.cc:1428] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:42.637984 9851 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.638833 10975 raft_consensus.cc:482] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.639269 9815 log.cc:1196] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8fcc42af91c247b1b80059e95e3659cf
I20260928 14:50:42.639544 9815 ts_tablet_manager.cc:1939] T 8fcc42af91c247b1b80059e95e3659cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.637300 9855 ts_tablet_manager.cc:1428] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:42.641566 9855 tablet_bootstrap.cc:492] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.643036 9855 tablet_bootstrap.cc:654] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.643226 9814 ts_tablet_manager.cc:1918] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.644131 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8fcc42af91c247b1b80059e95e3659cf (table default.Table_cb52782bde064ae2b1ea4ca8d30db871 [id=d941acc245774ff4b5d6f5f73a866e3f]) successfully deleted
I20260928 14:50:42.644476 9814 log.cc:1196] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/92d1100b862b4170807be02a39307359
I20260928 14:50:42.644917 9814 ts_tablet_manager.cc:1939] T 92d1100b862b4170807be02a39307359 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.644716 9815 tablet_replica.cc:330] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:42.645483 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 9d6fbbadaf0b4e4685f398496cf4e434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6fbbadaf0b4e4685f398496cf4e434 already in progress: creating tablet
I20260928 14:50:42.645754 9815 raft_consensus.cc:2229] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:42.645833 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 because the tablet was not found. No further retry: Not found: Tablet not found: 30d197a8ba8848d98ba0f03b2e83d3f6
I20260928 14:50:42.645910 9815 raft_consensus.cc:2258] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:42.646310 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a5b3b4611c6c4e96a7ac8df34eaab11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b3b4611c6c4e96a7ac8df34eaab11c already in progress: creating tablet
I20260928 14:50:42.646767 9815 ts_tablet_manager.cc:1905] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.646822 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 92d1100b862b4170807be02a39307359 (table default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]) successfully deleted
I20260928 14:50:42.646998 9814 tablet_replica.cc:330] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.647362 9814 raft_consensus.cc:2229] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.647743 9814 raft_consensus.cc:2258] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.648377 9814 ts_tablet_manager.cc:1905] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.654223 9815 ts_tablet_manager.cc:1918] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.654327 9815 log.cc:1196] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/af22f23ff3864620bfefb31b9e899036
I20260928 14:50:42.654589 9815 ts_tablet_manager.cc:1939] T af22f23ff3864620bfefb31b9e899036 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.655329 9815 tablet_replica.cc:330] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.655504 9815 raft_consensus.cc:2229] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:42.655786 9815 raft_consensus.cc:2258] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.656577 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet af22f23ff3864620bfefb31b9e899036 (table default.Table_21a4bfb6f8964ad5937b0106fa65cc82 [id=811f5b04b17349319d6f50e6d01edafd]) successfully deleted
I20260928 14:50:42.638960 10975 raft_consensus.cc:504] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.658018 10975 leader_election.cc:288] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.658192 9855 tablet_bootstrap.cc:492] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.658306 9855 ts_tablet_manager.cc:1397] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260928 14:50:42.658631 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e3a9f292618469c8d84da18059419b0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.658849 9219 leader_election.cc:341] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1e3a9f292618469c8d84da18059419b0
W20260928 14:50:42.659229 9220 leader_election.cc:341] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.659273 9855 raft_consensus.cc:348] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.659376 9220 leader_election.cc:302] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.659530 9855 raft_consensus.cc:374] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.659574 10975 raft_consensus.cc:2726] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.659673 9855 raft_consensus.cc:729] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.659912 9855 consensus_queue.cc:260] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.663736 9851 tablet_bootstrap.cc:654] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.664089 9855 ts_tablet_manager.cc:1428] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:42.664426 9855 tablet_bootstrap.cc:492] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:42.664749 9220 consensus_peers.cc:487] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:42.666929 9855 tablet_bootstrap.cc:654] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.656239 9815 ts_tablet_manager.cc:1905] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.673305 10975 raft_consensus.cc:482] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.673430 10975 raft_consensus.cc:504] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.674034 10975 leader_election.cc:288] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.674417 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b8584ba1914c3390aee99baaee289e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.674937 9220 leader_election.cc:341] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:42.675076 9219 leader_election.cc:341] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 41b8584ba1914c3390aee99baaee289e
I20260928 14:50:42.675186 9219 leader_election.cc:302] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.675572 10975 raft_consensus.cc:2726] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.676832 9815 ts_tablet_manager.cc:1918] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:42.679648 9815 log.cc:1196] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/30b0e3b18c724493a44c99d990013f34
I20260928 14:50:42.680198 9815 ts_tablet_manager.cc:1939] T 30b0e3b18c724493a44c99d990013f34 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.681675 9848 tablet_bootstrap.cc:492] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.681815 9848 ts_tablet_manager.cc:1397] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.399s user 0.007s sys 0.039s
I20260928 14:50:42.682354 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 30b0e3b18c724493a44c99d990013f34 (table default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]) successfully deleted
W20260928 14:50:42.685763 9498 consensus_peers.cc:487] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:42.689215 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 17cd74cf48ce42c3beda4556213f416a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17cd74cf48ce42c3beda4556213f416a already in progress: creating tablet
I20260928 14:50:42.689365 9814 ts_tablet_manager.cc:1918] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.689569 9814 log.cc:1196] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/59ced67c921e43e48bcb5195da212582
I20260928 14:50:42.689947 9814 ts_tablet_manager.cc:1939] T 59ced67c921e43e48bcb5195da212582 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:42.690148 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 59e5efe8275844c28200369135695e07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59e5efe8275844c28200369135695e07 already in progress: creating tablet
I20260928 14:50:42.690672 9815 tablet_replica.cc:330] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.691162 9814 tablet_replica.cc:330] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.691380 9814 raft_consensus.cc:2229] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.691570 9814 raft_consensus.cc:2258] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.692149 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 59ced67c921e43e48bcb5195da212582 (table default.Table_91fba5be108742dfadfae0e7c4aa61f6 [id=ca5392bf870e48a5bfd32b024c85a0b9]) successfully deleted
I20260928 14:50:42.692301 9815 raft_consensus.cc:2229] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.692668 9814 ts_tablet_manager.cc:1905] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.692821 9815 raft_consensus.cc:2258] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.693607 9815 ts_tablet_manager.cc:1905] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.696048 11111 raft_consensus.cc:482] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.696183 11111 raft_consensus.cc:504] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.696743 11111 leader_election.cc:288] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.702328 9360 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 0489aea8bb0a45daaaec6a48db756c51
W20260928 14:50:42.702761 9360 leader_election.cc:341] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:42.702878 9360 leader_election.cc:302] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.703295 11111 raft_consensus.cc:2726] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.707190 9815 ts_tablet_manager.cc:1918] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:42.707494 9815 log.cc:1196] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/86d21f615343473a95cd1f5040aebc79
I20260928 14:50:42.707960 9815 ts_tablet_manager.cc:1939] T 86d21f615343473a95cd1f5040aebc79 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.709326 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 86d21f615343473a95cd1f5040aebc79 (table default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]) successfully deleted
I20260928 14:50:42.710880 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_73e6450166d64b5f8858464b12b02440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.711448 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73e6450166d64b5f8858464b12b02440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:42.716253 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c53c8bd0e124a2798d2a7f1e9595f1c consensus state has no leader
I20260928 14:50:42.693449 9848 raft_consensus.cc:348] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.717491 9848 raft_consensus.cc:374] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.718132 9848 raft_consensus.cc:729] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.718695 9848 consensus_queue.cc:260] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.719390 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e2aecd527654497da271e99118373258" } modify_external_catalogs: true
I20260928 14:50:42.719573 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e2aecd527654497da271e99118373258" } modify_external_catalogs: true
I20260928 14:50:42.723374 9848 ts_tablet_manager.cc:1428] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20260928 14:50:42.726847 9813 ts_tablet_manager.cc:1918] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:42.726967 9813 log.cc:1196] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/86d21f615343473a95cd1f5040aebc79
I20260928 14:50:42.727341 9813 ts_tablet_manager.cc:1939] T 86d21f615343473a95cd1f5040aebc79 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:42.728011 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 86d21f615343473a95cd1f5040aebc79 (table default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]) successfully deleted
I20260928 14:50:42.729422 10975 raft_consensus.cc:482] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.729602 10975 raft_consensus.cc:504] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.730235 10975 leader_election.cc:288] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.730741 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f17eb03f5ed4cb581c29fc0d8619ff2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.731216 9220 leader_election.cc:341] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.731712 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a3c68a2575cf4150a70fedf55d507235" } modify_external_catalogs: true
I20260928 14:50:42.731913 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a3c68a2575cf4150a70fedf55d507235" } modify_external_catalogs: true
W20260928 14:50:42.734408 9219 leader_election.cc:341] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 3f17eb03f5ed4cb581c29fc0d8619ff2
I20260928 14:50:42.734534 9219 leader_election.cc:302] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.735001 10975 raft_consensus.cc:2726] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.739404 9848 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.742379 9848 tablet_bootstrap.cc:654] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.744213 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_34ef5f5fa21143379cd2ba4997e77c8b" } new_table_name: "default.Table_a665b753ebbe4c27a98f42c35e6c2b99" modify_external_catalogs: true
I20260928 14:50:42.745698 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_af4830aab30c4fccb57822e100e21564" } modify_external_catalogs: true
I20260928 14:50:42.745899 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_af4830aab30c4fccb57822e100e21564" } modify_external_catalogs: true
I20260928 14:50:42.745424 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6dacb88cb9c74873a8f69da29a43fed9" } modify_external_catalogs: true
I20260928 14:50:42.746469 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6dacb88cb9c74873a8f69da29a43fed9" } modify_external_catalogs: true
W20260928 14:50:42.747318 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 49743.7us
I20260928 14:50:42.747876 9855 tablet_bootstrap.cc:492] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.748126 9855 ts_tablet_manager.cc:1397] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.084s user 0.029s sys 0.020s
I20260928 14:50:42.748927 9855 raft_consensus.cc:348] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.749226 9855 raft_consensus.cc:374] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.749338 9855 raft_consensus.cc:729] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.749655 9855 consensus_queue.cc:260] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.751660 9848 tablet_bootstrap.cc:492] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.751765 9848 ts_tablet_manager.cc:1397] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260928 14:50:42.752389 9848 raft_consensus.cc:348] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.752568 9848 raft_consensus.cc:374] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.752606 9848 raft_consensus.cc:729] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.754725 9855 ts_tablet_manager.cc:1428] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:42.755713 9855 tablet_bootstrap.cc:492] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.757323 9855 tablet_bootstrap.cc:654] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.758646 11197 tablet.cc:1722] T 01dd30e15c31498299ca5f5a3b2770e9 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:42.759374 11192 tablet.cc:1722] T 01dd30e15c31498299ca5f5a3b2770e9 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 14:50:42.760162 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b230e43173849e1903a2871fa4b0f91 consensus state has no leader
I20260928 14:50:42.762203 9814 ts_tablet_manager.cc:1918] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.762298 9814 log.cc:1196] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/82a58b7387564863a2141a722003c5d1
I20260928 14:50:42.762588 9814 ts_tablet_manager.cc:1939] T 82a58b7387564863a2141a722003c5d1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.764364 9848 consensus_queue.cc:260] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.764879 9851 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.764993 9851 ts_tablet_manager.cc:1397] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.127s user 0.008s sys 0.008s
I20260928 14:50:42.765662 9851 raft_consensus.cc:348] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.765872 9851 raft_consensus.cc:374] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.765926 9851 raft_consensus.cc:729] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.766120 9851 consensus_queue.cc:260] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.767297 9851 ts_tablet_manager.cc:1428] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:42.769026 9848 ts_tablet_manager.cc:1428] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 14:50:42.771541 9855 tablet_bootstrap.cc:492] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.771745 9814 tablet_replica.cc:330] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.771879 9855 ts_tablet_manager.cc:1397] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.008s
I20260928 14:50:42.771908 9814 raft_consensus.cc:2229] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.772051 9814 raft_consensus.cc:2258] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.772534 9814 ts_tablet_manager.cc:1905] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.772886 9848 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.773324 9855 raft_consensus.cc:348] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.773665 9855 raft_consensus.cc:374] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.773769 9855 raft_consensus.cc:729] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.774005 9855 consensus_queue.cc:260] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.775352 9855 ts_tablet_manager.cc:1428] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:42.776289 9855 tablet_bootstrap.cc:492] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.777285 9848 tablet_bootstrap.cc:654] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.777918 9855 tablet_bootstrap.cc:654] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.781424 9848 tablet_bootstrap.cc:492] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.781567 9848 ts_tablet_manager.cc:1397] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260928 14:50:42.781678 9851 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.782256 9848 raft_consensus.cc:348] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.782457 9848 raft_consensus.cc:374] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.782507 9848 raft_consensus.cc:729] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.783150 9851 tablet_bootstrap.cc:654] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.784909 9848 consensus_queue.cc:260] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.790211 9848 ts_tablet_manager.cc:1428] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260928 14:50:42.792547 9848 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.794400 9855 tablet_bootstrap.cc:492] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:42.769188 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 82a58b7387564863a2141a722003c5d1 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:42.794569 9855 ts_tablet_manager.cc:1397] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
I20260928 14:50:42.795164 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5adea8b633fd4e14815af00798dfed4b" } new_table_name: "default.Table_138182a300f842748369001ad026d511" modify_external_catalogs: true
I20260928 14:50:42.795334 9855 raft_consensus.cc:348] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:42.795447 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a5b3b4611c6c4e96a7ac8df34eaab11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b3b4611c6c4e96a7ac8df34eaab11c already in progress: creating tablet
I20260928 14:50:42.795526 9855 raft_consensus.cc:374] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.795572 9855 raft_consensus.cc:729] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:42.795683 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 9d6fbbadaf0b4e4685f398496cf4e434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d6fbbadaf0b4e4685f398496cf4e434 already in progress: creating tablet
I20260928 14:50:42.795785 9855 consensus_queue.cc:260] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.796521 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c585bc08e1c54dbe8d038be704d4ecf9" } modify_external_catalogs: true
I20260928 14:50:42.796695 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c585bc08e1c54dbe8d038be704d4ecf9" } modify_external_catalogs: true
I20260928 14:50:42.797101 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet 2c88ccde6f7540d4aa7cf9b29aa3718d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:42.797379 10975 raft_consensus.cc:482] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.797494 10975 raft_consensus.cc:504] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.798066 10975 leader_election.cc:288] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.798473 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df12117111548beb5d570436e2d6de2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.798893 9219 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2df12117111548beb5d570436e2d6de2
W20260928 14:50:42.799187 9220 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.799293 9220 leader_election.cc:302] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.799547 10975 raft_consensus.cc:2726] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.800694 9855 ts_tablet_manager.cc:1428] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260928 14:50:42.803726 9848 tablet_bootstrap.cc:654] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.805439 9855 tablet_bootstrap.cc:492] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:42.808188 9848 tablet_bootstrap.cc:492] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:42.808225 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 820a60a83d2a4c32bdb23e600cf60b0d consensus state has no leader
I20260928 14:50:42.808326 9848 ts_tablet_manager.cc:1397] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260928 14:50:42.809070 9848 raft_consensus.cc:348] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.809280 9848 raft_consensus.cc:374] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.809338 9848 raft_consensus.cc:729] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.809546 9848 consensus_queue.cc:260] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.810353 10975 raft_consensus.cc:482] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.810474 10975 raft_consensus.cc:504] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.811051 10975 leader_election.cc:288] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.811574 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb232c73f014351b796a86180ffb660" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.811946 9219 leader_election.cc:341] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: cbb232c73f014351b796a86180ffb660
W20260928 14:50:42.812202 9220 leader_election.cc:341] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.812318 9220 leader_election.cc:302] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.812525 10975 raft_consensus.cc:2726] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.814998 11210 raft_consensus.cc:482] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.815117 11210 raft_consensus.cc:504] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.815615 11210 leader_election.cc:288] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.816107 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c51f5944c6534e9492594c39ae9796b2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:42.816630 9497 leader_election.cc:341] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.816701 11268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.181.61:41417 every 8 connection(s)
I20260928 14:50:42.817499 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c51f5944c6534e9492594c39ae9796b2" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.817993 9498 leader_election.cc:341] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.818092 9498 leader_election.cc:302] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.818437 11210 raft_consensus.cc:2726] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.819685 9814 ts_tablet_manager.cc:1918] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:42.819778 9814 log.cc:1196] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/30b0e3b18c724493a44c99d990013f34
I20260928 14:50:42.820102 9814 ts_tablet_manager.cc:1939] T 30b0e3b18c724493a44c99d990013f34 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:42.820194 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2c88ccde6f7540d4aa7cf9b29aa3718d
I20260928 14:50:42.820616 8953 catalog_manager.cc:6565] ReplaceTablet: tablet 2c88ccde6f7540d4aa7cf9b29aa3718d deleted and replaced by tablet 34a037a1976e4b5395ab5b5a95e343f0
I20260928 14:50:42.820884 9403 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d with delete_type TABLET_DATA_DELETED (replaced by tablet 34a037a1976e4b5395ab5b5a95e343f0) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.821138 9813 tablet_replica.cc:330] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.821323 9813 raft_consensus.cc:2229] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:42.821599 9813 raft_consensus.cc:2258] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.821985 9813 ts_tablet_manager.cc:1905] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.823721 10816 rpc_server.cc:307] RPC server started. Bound to: 127.8.181.61:41417
I20260928 14:50:42.825779 10816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/master-1/data/info.pb
I20260928 14:50:42.826031 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d with delete_type TABLET_DATA_DELETED (replaced by tablet 34a037a1976e4b5395ab5b5a95e343f0) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.826036 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c88ccde6f7540d4aa7cf9b29aa3718d with delete_type TABLET_DATA_DELETED (replaced by tablet 34a037a1976e4b5395ab5b5a95e343f0) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.826244 9815 tablet_replica.cc:330] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.826421 9815 raft_consensus.cc:2229] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.826584 9815 raft_consensus.cc:2258] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.827099 9815 ts_tablet_manager.cc:1905] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.828603 9813 ts_tablet_manager.cc:1918] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:42.832532 9815 ts_tablet_manager.cc:1918] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:42.832628 9815 log.cc:1196] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2c88ccde6f7540d4aa7cf9b29aa3718d
I20260928 14:50:42.832927 9815 ts_tablet_manager.cc:1939] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.833649 11210 raft_consensus.cc:482] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.833760 11210 raft_consensus.cc:504] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.834272 11210 leader_election.cc:288] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.835835 8916 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfQx8Sg/build/asan/bin/kudu as pid 10816
I20260928 14:50:42.836026 9851 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.836534 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
I20260928 14:50:42.837076 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b2d22944e23f419c973b10049b217b0f" } new_table_name: "default.Table_017b6b7a57314fbf9d1cf208963e0f12" modify_external_catalogs: true
I20260928 14:50:42.837150 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3a9c2739592a40cbaad31dd1fab6cdcd" } new_table_name: "default.Table_6407403ecfe34c9daca8aec14ef08500" modify_external_catalogs: true
I20260928 14:50:42.834896 9848 ts_tablet_manager.cc:1428] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260928 14:50:42.835094 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:42.838970 9813 log.cc:1196] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2c88ccde6f7540d4aa7cf9b29aa3718d
I20260928 14:50:42.839357 9813 ts_tablet_manager.cc:1939] T 2c88ccde6f7540d4aa7cf9b29aa3718d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:42.839396 9498 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.839864 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
W20260928 14:50:42.843395 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 732d57c3584148f080e76dffb6b3b146 consensus state has no leader
I20260928 14:50:42.843874 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a91574affcef4ab393d67b3607364005"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.844070 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:42.844377 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a91574affcef4ab393d67b3607364005 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:42.844594 9497 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.844681 9497 leader_election.cc:302] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.844985 11210 raft_consensus.cc:2726] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.846848 9848 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:42.847515 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72099e766c574246b38acb34ee369d2e consensus state has no leader
I20260928 14:50:42.847901 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_56ac8188c64e44709eff9cb4c866c346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.848340 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56ac8188c64e44709eff9cb4c866c346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.853839 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 70952c6421154da6837d089b6443695f (DEFAULT_TABLE table=default.Table_353dfdf4c71244adbe9a2d5216999d10 [id=f5d7802dd98940fcb9f5607c070a3e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.854229 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70952c6421154da6837d089b6443695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.854159 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 70952c6421154da6837d089b6443695f (DEFAULT_TABLE table=default.Table_353dfdf4c71244adbe9a2d5216999d10 [id=f5d7802dd98940fcb9f5607c070a3e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.854462 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70952c6421154da6837d089b6443695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.856282 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_be46200ec11c4f5a9a2f47854bed77a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.856806 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be46200ec11c4f5a9a2f47854bed77a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.858474 10975 consensus_queue.cc:1035] T 91262a2cf39e4e5bb4854998332ca1f1 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:42.860725 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 30b0e3b18c724493a44c99d990013f34 (table default.Table_36cf8fd2a6414734ab97181860917d4f [id=4de26081d96f467db3709b0185d53c6f]) successfully deleted
I20260928 14:50:42.862905 9851 ts_tablet_manager.cc:1397] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.001s
I20260928 14:50:42.863804 9851 raft_consensus.cc:348] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.864022 9851 raft_consensus.cc:374] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.864076 9851 raft_consensus.cc:729] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:42.864179 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 17cd74cf48ce42c3beda4556213f416a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17cd74cf48ce42c3beda4556213f416a already in progress: creating tablet
I20260928 14:50:42.864270 9851 consensus_queue.cc:260] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:42.864795 9851 ts_tablet_manager.cc:1428] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:42.865885 9848 tablet_bootstrap.cc:654] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.868971 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 70952c6421154da6837d089b6443695f (DEFAULT_TABLE table=default.Table_353dfdf4c71244adbe9a2d5216999d10 [id=f5d7802dd98940fcb9f5607c070a3e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.869388 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70952c6421154da6837d089b6443695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.873370 9851 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:42.874877 9851 tablet_bootstrap.cc:654] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:42.876374 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 59e5efe8275844c28200369135695e07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59e5efe8275844c28200369135695e07 already in progress: creating tablet
I20260928 14:50:42.876667 9814 tablet_replica.cc:330] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:42.876848 9814 raft_consensus.cc:2229] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:42.877475 9814 raft_consensus.cc:2258] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.877987 9814 ts_tablet_manager.cc:1905] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.883337 9403 tablet_service.cc:1467] Processing CreateTablet for tablet bd317286c9f54f0d917123d924f02058 (DEFAULT_TABLE table=default.Table_c585bc08e1c54dbe8d038be704d4ecf9 [id=2d97d64730df49baab6495006ce73c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.883778 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd317286c9f54f0d917123d924f02058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.885512 10975 consensus_queue.cc:1035] T d5b08f7c9a1e4fcab0951eb5d4cd059a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:42.888468 11270 sys_catalog.cc:263] Verifying existing consensus state
I20260928 14:50:42.889135 11111 raft_consensus.cc:482] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.889253 11111 raft_consensus.cc:504] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.889796 11111 leader_election.cc:288] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:42.890643 9360 leader_election.cc:341] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 46fe647c6d80431bbb76899126d01c3b
W20260928 14:50:42.890846 9360 leader_election.cc:341] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 46fe647c6d80431bbb76899126d01c3b
I20260928 14:50:42.890908 9360 leader_election.cc:302] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:42.891081 11111 raft_consensus.cc:2726] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.899183 9256 tablet_service.cc:1467] Processing CreateTablet for tablet bd317286c9f54f0d917123d924f02058 (DEFAULT_TABLE table=default.Table_c585bc08e1c54dbe8d038be704d4ecf9 [id=2d97d64730df49baab6495006ce73c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.899228 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 39401d775e5946578e93467454623ce9 (DEFAULT_TABLE table=default.Table_6cf0e1af7830470ca8ba8b0906771406 [id=4df3f99fda9d468099d6001f9c910fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.899586 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39401d775e5946578e93467454623ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.899583 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd317286c9f54f0d917123d924f02058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.901829 9546 tablet_service.cc:1467] Processing CreateTablet for tablet bd317286c9f54f0d917123d924f02058 (DEFAULT_TABLE table=default.Table_c585bc08e1c54dbe8d038be704d4ecf9 [id=2d97d64730df49baab6495006ce73c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.902206 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd317286c9f54f0d917123d924f02058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.906335 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e0293fd4baf946579b82c73a35b06fcc
I20260928 14:50:42.906797 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bd317286c9f54f0d917123d924f02058
I20260928 14:50:42.906876 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet e0293fd4baf946579b82c73a35b06fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.907021 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fc0a83bcaa0647c9bfe9b4635d391b0e
I20260928 14:50:42.907956 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet bd317286c9f54f0d917123d924f02058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.907974 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.908243 8951 catalog_manager.cc:5495] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:42.908567 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet bd317286c9f54f0d917123d924f02058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.908666 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet e0293fd4baf946579b82c73a35b06fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.908833 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:42.909106 8951 catalog_manager.cc:5495] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:42.909485 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
W20260928 14:50:42.909674 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bd317286c9f54f0d917123d924f02058 because the tablet was not found. No further retry: Not found: Tablet not found: bd317286c9f54f0d917123d924f02058
W20260928 14:50:42.909888 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e0293fd4baf946579b82c73a35b06fcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0293fd4baf946579b82c73a35b06fcc already in progress: creating tablet
I20260928 14:50:42.909898 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.910136 11218 raft_consensus.cc:482] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:42.910156 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 78379bd4cfce46fa812374f046d9d329
I20260928 14:50:42.910247 11218 raft_consensus.cc:504] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:42.910423 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fc0a83bcaa0647c9bfe9b4635d391b0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0a83bcaa0647c9bfe9b4635d391b0e already in progress: creating tablet
I20260928 14:50:42.910622 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_33d213a97ea349d6ab97a84fd1571e6d [id=e00f618e9273435db59f9445f6485b89] alter complete (version 2)
I20260928 14:50:42.910799 11218 leader_election.cc:288] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:42.911062 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 78379bd4cfce46fa812374f046d9d329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.911283 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24b256211679481eb0e0309c56ff60c6" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:42.911664 9219 leader_election.cc:341] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 24b256211679481eb0e0309c56ff60c6
W20260928 14:50:42.911912 9220 leader_election.cc:341] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:42.911999 9220 leader_election.cc:302] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:42.912173 11218 raft_consensus.cc:2726] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:42.913621 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 78379bd4cfce46fa812374f046d9d329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.914382 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 88d6b4482e7b42fca17e5b917e1c1bed
I20260928 14:50:42.915014 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_51ff7a6d884645c1974704ec54c878c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.915545 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51ff7a6d884645c1974704ec54c878c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.916772 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 6feba01e78004e50a71c610c9a63aeb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.916982 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917146 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet bd317286c9f54f0d917123d924f02058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917348 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0a83bcaa0647c9bfe9b4635d391b0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917474 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 78379bd4cfce46fa812374f046d9d329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917580 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 8520b28899bc42b08e239502adb8fece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917675 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet c6b4b4c775fe4eacaaa557d4daa2a600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917757 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 01c1e945f1c54281856bfabe08fba42e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917866 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 0489aea8bb0a45daaaec6a48db756c51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:24 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.917949 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet d30d06c910fa4142a6248e8bfd00f4b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.921343 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet c51f5944c6534e9492594c39ae9796b2 with delete_type TABLET_DATA_DELETED (replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.921597 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.921865 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 846a96509f32416087ee4667458c367e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.921888 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a14c0b50cad4954b5dc5666689810ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.921991 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.922153 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06859c8dcc41d99d29365aae350afa with delete_type TABLET_DATA_DELETED (replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.923487 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.923671 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:42.923744 9815 tablet_replica.cc:330] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.923924 9815 raft_consensus.cc:2229] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.924060 9815 raft_consensus.cc:2258] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.924540 9815 ts_tablet_manager.cc:1905] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.925402 11270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Bootstrap starting.
I20260928 14:50:42.926952 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.927181 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.927430 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.927634 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.928411 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet e0293fd4baf946579b82c73a35b06fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.928603 9813 tablet_replica.cc:330] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:42.928772 9813 raft_consensus.cc:2229] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.928916 9813 raft_consensus.cc:2258] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.929039 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.929399 9813 ts_tablet_manager.cc:1905] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:42.930088 9851 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:42.931735 8948 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:42.933038 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_57e0f72948c241daa7c51ddedecbc5e3" } new_table_name: "default.Table_171fc5df910d4df584d3fa8d9ba2c734" modify_external_catalogs: true
I20260928 14:50:42.934099 9815 ts_tablet_manager.cc:1918] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.934911 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e59b8e736b6d4644a78a6d7570746e18 (table default.Table_9aa2a15124ab40d682b1da19d1713074 [id=db3c037ac7784283bb5dc67c99a4b73c]). Expected version 1 got 0
I20260928 14:50:42.935075 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:42.935225 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b14339044619424c9be020fa99ad681e (table default.Table_3f7ee04cf1f44625a52bf577f216c98b [id=921a3c5cf74b41b6bde6987563b81319]). Expected version 2 got 0
I20260928 14:50:42.935338 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:42.935545 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b6fed86d9eda45cab2083fca73825383 (table default.Table_ec53a95de3d2420e8fb0c19d712a61aa [id=008ad045c52b4c9693af55fd79f5f22f]). Expected version 1 got 0
I20260928 14:50:42.935672 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:42.942543 9401 tablet_service.cc:1467] Processing CreateTablet for tablet e2d455aacada41b7a7315b5aff797a76 (DEFAULT_TABLE table=default.Table_d5ddea2bf7a347278afc8c7e3cf9510c [id=f90691b87c7c4700bd467364c7d78c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.942925 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d455aacada41b7a7315b5aff797a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.943424 9848 tablet_bootstrap.cc:492] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:42.943552 9848 ts_tablet_manager.cc:1397] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.097s user 0.003s sys 0.000s
I20260928 14:50:42.943888 9402 tablet_service.cc:1467] Processing CreateTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c (DEFAULT_TABLE table=default.Table_63d0876c753e4babab324808f06e208f [id=2c2b388bfe4745d7868f7fa73eeaf6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.944263 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be0ef95fd8b54b2ab140a77a74c75c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.944386 9848 raft_consensus.cc:348] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.944572 9848 raft_consensus.cc:374] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:42.944631 9848 raft_consensus.cc:729] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:42.945287 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a1338e4028414b40a26489ec124db927"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.945799 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1338e4028414b40a26489ec124db927 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.946798 9848 consensus_queue.cc:260] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:42.949793 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f6a090218ff7459585093b6e8757a300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.950317 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6a090218ff7459585093b6e8757a300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.942147 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 39401d775e5946578e93467454623ce9 (DEFAULT_TABLE table=default.Table_6cf0e1af7830470ca8ba8b0906771406 [id=4df3f99fda9d468099d6001f9c910fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.952387 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39401d775e5946578e93467454623ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.954800 8948 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_78c57b0e4e8048cb8a9eb35792ecddcf [id=3f884201d03c4681a15f1fa2be74ecf2] alter complete (version 1)
I20260928 14:50:42.943450 9533 tablet_service.cc:1467] Processing CreateTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c (DEFAULT_TABLE table=default.Table_63d0876c753e4babab324808f06e208f [id=2c2b388bfe4745d7868f7fa73eeaf6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.956367 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be0ef95fd8b54b2ab140a77a74c75c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.960566 9848 ts_tablet_manager.cc:1428] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 14:50:42.963274 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b7e412c4541447338570286096857459"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.963729 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7e412c4541447338570286096857459 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.964769 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_46225f43edd2436bbf9ed9816eec9298"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.965222 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46225f43edd2436bbf9ed9816eec9298 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.965395 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3df105fd8cd24039977b94b28b424121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:42.965843 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df105fd8cd24039977b94b28b424121 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:42.966758 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afab196535584fc0a953c28bb56bf511 consensus state has no leader
I20260928 14:50:42.969888 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9768e25a844d43468d95f5abd6fe5cce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:42.970578 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ed6b85c8224a4ba08354e6e04b50cb31" } new_table_name: "default.Table_5cfd8af428894642a8b1c7397f9048e6" modify_external_catalogs: true
I20260928 14:50:42.960816 9848 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:42.962224 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f9359df0ac466c912cd20fc6b94390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.972509 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet e760d7e556a54fda9dc91300b9968c68 with delete_type TABLET_DATA_DELETED (replaced by tablet a56b4c06e18e4d13adc5c1cfed6c2007) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.962267 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5f68b570e4fff8f8748e4c762ad78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:42.962054 9401 tablet_service.cc:1514] Processing DeleteTablet for tablet 46fe647c6d80431bbb76899126d01c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:42.974027 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9768e25a844d43468d95f5abd6fe5cce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:42.974728 9848 tablet_bootstrap.cc:654] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:42.977706 9815 log.cc:1196] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/78379bd4cfce46fa812374f046d9d329
I20260928 14:50:42.978101 9815 ts_tablet_manager.cc:1939] T 78379bd4cfce46fa812374f046d9d329 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:42.979809 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 78379bd4cfce46fa812374f046d9d329 (table default.Table_af4830aab30c4fccb57822e100e21564 [id=4808092de350419bba3b7bffa8967276]) successfully deleted
I20260928 14:50:42.981144 9813 ts_tablet_manager.cc:1918] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:42.981385 9815 tablet_replica.cc:330] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:42.981654 9815 raft_consensus.cc:2229] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:42.981842 9815 raft_consensus.cc:2258] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:42.939759 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:42.941643 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 39401d775e5946578e93467454623ce9 (DEFAULT_TABLE table=default.Table_6cf0e1af7830470ca8ba8b0906771406 [id=4df3f99fda9d468099d6001f9c910fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.942737 9249 tablet_service.cc:1467] Processing CreateTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c (DEFAULT_TABLE table=default.Table_63d0876c753e4babab324808f06e208f [id=2c2b388bfe4745d7868f7fa73eeaf6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.955681 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:42.982829 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39401d775e5946578e93467454623ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.978493 9253 tablet_service.cc:1467] Processing CreateTablet for tablet e2d455aacada41b7a7315b5aff797a76 (DEFAULT_TABLE table=default.Table_d5ddea2bf7a347278afc8c7e3cf9510c [id=f90691b87c7c4700bd467364c7d78c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.983795 9851 ts_tablet_manager.cc:1397] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.000s
I20260928 14:50:42.985869 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d455aacada41b7a7315b5aff797a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.989686 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be0ef95fd8b54b2ab140a77a74c75c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.993023 9265 tablet_service.cc:1467] Processing CreateTablet for tablet be38aab2776b4091afe369da62a86b81 (DEFAULT_TABLE table=default.Table_117b7ba8c223492983d6e8897272f345 [id=656dd3db16104f28bea9e7d2e65b45ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.993351 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38aab2776b4091afe369da62a86b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.993932 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 (DEFAULT_TABLE table=default.Table_25bfa6420cde48e992b706d92a31d90e [id=2c2842efaae7452bba2365a3eacc0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.994179 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 (DEFAULT_TABLE table=default.Table_25bfa6420cde48e992b706d92a31d90e [id=2c2842efaae7452bba2365a3eacc0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.994308 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e642af72ff4f5285f8bc4e6ed36401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.994542 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e642af72ff4f5285f8bc4e6ed36401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.998283 9251 tablet_service.cc:1467] Processing CreateTablet for tablet c665d5bc5b2149bbbfc29b6687474e40 (DEFAULT_TABLE table=default.Table_8dafd1175a9e47c0a409ab3fe102592f [id=b096742442b7428992ee54a1945185ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.998595 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665d5bc5b2149bbbfc29b6687474e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.005400 9533 tablet_service.cc:1467] Processing CreateTablet for tablet be38aab2776b4091afe369da62a86b81 (DEFAULT_TABLE table=default.Table_117b7ba8c223492983d6e8897272f345 [id=656dd3db16104f28bea9e7d2e65b45ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.005815 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38aab2776b4091afe369da62a86b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:42.985896 9851 raft_consensus.cc:348] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.008780 9851 raft_consensus.cc:374] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.008844 9851 raft_consensus.cc:729] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.009066 9851 consensus_queue.cc:260] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.009728 9851 ts_tablet_manager.cc:1428] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260928 14:50:43.010969 9535 tablet_service.cc:1467] Processing CreateTablet for tablet e2d455aacada41b7a7315b5aff797a76 (DEFAULT_TABLE table=default.Table_d5ddea2bf7a347278afc8c7e3cf9510c [id=f90691b87c7c4700bd467364c7d78c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.011344 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d455aacada41b7a7315b5aff797a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.018906 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 75d8f90aac9f42ebbca4cdc87a78a340 (DEFAULT_TABLE table=default.Table_a6e4e218f153439fb376d1de25c66fb1 [id=5800282e23814eafba5e739113a61ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.019063 9529 tablet_service.cc:1467] Processing CreateTablet for tablet eadfd22dc3cc463e818690f34e59fc7c (DEFAULT_TABLE table=default.Table_66b6cbc54205480b9265a3f67d94916e [id=95a858e9189947c6ad043883fd170a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.019213 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d8f90aac9f42ebbca4cdc87a78a340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.019253 9531 tablet_service.cc:1467] Processing CreateTablet for tablet f5f30a4a4fca48818a7a89ad91e71393 (DEFAULT_TABLE table=default.Table_ad01b16b05e54931a25a012cda7fd249 [id=88985557f5d34bf387faac59a85060cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.019366 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eadfd22dc3cc463e818690f34e59fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.019512 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5f30a4a4fca48818a7a89ad91e71393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.019786 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 467804599a804a999c15b1fa44f5a9f6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.020056 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467804599a804a999c15b1fa44f5a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.024679 11218 raft_consensus.cc:482] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.024798 11218 raft_consensus.cc:504] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.024899 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 860ea08eb03d4d5a8234d03db33ea899 (DEFAULT_TABLE table=default.Table_82a935228f4e4a8eb81bea67d9fb3cd6 [id=db0946fd72af45d5aecfbe26bebc0142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.025354 11218 leader_election.cc:288] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.025399 9257 tablet_service.cc:1467] Processing CreateTablet for tablet eadfd22dc3cc463e818690f34e59fc7c (DEFAULT_TABLE table=default.Table_66b6cbc54205480b9265a3f67d94916e [id=95a858e9189947c6ad043883fd170a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.025779 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 467804599a804a999c15b1fa44f5a9f6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.025827 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 860ea08eb03d4d5a8234d03db33ea899 (DEFAULT_TABLE table=default.Table_82a935228f4e4a8eb81bea67d9fb3cd6 [id=db0946fd72af45d5aecfbe26bebc0142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.026095 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860ea08eb03d4d5a8234d03db33ea899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.026110 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 75d8f90aac9f42ebbca4cdc87a78a340 (DEFAULT_TABLE table=default.Table_a6e4e218f153439fb376d1de25c66fb1 [id=5800282e23814eafba5e739113a61ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:42.998871 9401 tablet_service.cc:1467] Processing CreateTablet for tablet c665d5bc5b2149bbbfc29b6687474e40 (DEFAULT_TABLE table=default.Table_8dafd1175a9e47c0a409ab3fe102592f [id=b096742442b7428992ee54a1945185ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.014467 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 860ea08eb03d4d5a8234d03db33ea899 (DEFAULT_TABLE table=default.Table_82a935228f4e4a8eb81bea67d9fb3cd6 [id=db0946fd72af45d5aecfbe26bebc0142]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.027087 11210 raft_consensus.cc:482] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.027189 11210 raft_consensus.cc:504] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.027390 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665d5bc5b2149bbbfc29b6687474e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.027372 9813 log.cc:1196] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6feba01e78004e50a71c610c9a63aeb5
I20260928 14:50:43.027709 11210 leader_election.cc:288] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.014914 11111 raft_consensus.cc:482] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.028342 11111 raft_consensus.cc:504] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.028910 9815 ts_tablet_manager.cc:1905] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.029102 11111 leader_election.cc:288] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:43.015057 9390 tablet_service.cc:1467] Processing CreateTablet for tablet f5f30a4a4fca48818a7a89ad91e71393 (DEFAULT_TABLE table=default.Table_ad01b16b05e54931a25a012cda7fd249 [id=88985557f5d34bf387faac59a85060cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.015625 9389 tablet_service.cc:1467] Processing CreateTablet for tablet eadfd22dc3cc463e818690f34e59fc7c (DEFAULT_TABLE table=default.Table_66b6cbc54205480b9265a3f67d94916e [id=95a858e9189947c6ad043883fd170a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.016390 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 467804599a804a999c15b1fa44f5a9f6 (DEFAULT_TABLE table=default.Table_490e1f7324f14b858efd98a2937f0bb3 [id=fe65dd03b34042ed93076247b0817ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.017320 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 75d8f90aac9f42ebbca4cdc87a78a340 (DEFAULT_TABLE table=default.Table_a6e4e218f153439fb376d1de25c66fb1 [id=5800282e23814eafba5e739113a61ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.018904 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 2197ea1acde444f8ad84579b9b47ea51 (DEFAULT_TABLE table=default.Table_3d233586a3884d9e823e355e84e58c36 [id=549f10a9c74a4b10badd3dc55ebaf226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.030629 9813 ts_tablet_manager.cc:1939] T 6feba01e78004e50a71c610c9a63aeb5 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:43.032040 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.032348 11218 raft_consensus.cc:482] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.032456 11218 raft_consensus.cc:504] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:43.032558 9498 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:43.033638 9219 leader_election.cc:341] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:43.033785 11218 leader_election.cc:288] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:43.034163 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6feba01e78004e50a71c610c9a63aeb5 (table default.Table_55ee447211854085bcb9b589d08b9f0a [id=eaf88a1ec3074f0ab6053bf5bf5a9e2c]) successfully deleted
W20260928 14:50:43.035427 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 88d6b4482e7b42fca17e5b917e1c1bed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88d6b4482e7b42fca17e5b917e1c1bed already in progress: creating tablet
W20260928 14:50:43.036803 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bd317286c9f54f0d917123d924f02058 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd317286c9f54f0d917123d924f02058 already in progress: creating tablet
I20260928 14:50:43.038654 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f28a74dc0afe4f20b47139a703550ef6" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.038672 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22d5fe7cbf4348e88fb6a6eaa70ba87b" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.039736 9220 leader_election.cc:341] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.039834 9220 leader_election.cc:302] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:43.040161 9220 leader_election.cc:341] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.040207 11223 raft_consensus.cc:2726] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:43.041121 9360 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c6b4b4c775fe4eacaaa557d4daa2a600
W20260928 14:50:43.042096 9219 leader_election.cc:341] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:43.042196 9219 leader_election.cc:302] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.042537 11223 raft_consensus.cc:2726] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.045802 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0442e8587ed34e64ab67fbc8a2030827" } new_table_name: "default.Table_ee8040bfa9154310a3560a4f24ec0b2c" modify_external_catalogs: true
I20260928 14:50:43.021744 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 (DEFAULT_TABLE table=default.Table_25bfa6420cde48e992b706d92a31d90e [id=2c2842efaae7452bba2365a3eacc0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.047175 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_aac83c42b32f4807a59c6fd187ee04ac" } new_table_name: "default.Table_b9d5bf65c9184d2ca7a06283dcca4c96" modify_external_catalogs: true
I20260928 14:50:43.026273 9403 tablet_service.cc:1467] Processing CreateTablet for tablet be38aab2776b4091afe369da62a86b81 (DEFAULT_TABLE table=default.Table_117b7ba8c223492983d6e8897272f345 [id=656dd3db16104f28bea9e7d2e65b45ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:43.048228 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fc0a83bcaa0647c9bfe9b4635d391b0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0a83bcaa0647c9bfe9b4635d391b0e already in progress: creating tablet
I20260928 14:50:43.047947 9546 tablet_service.cc:1467] Processing CreateTablet for tablet c665d5bc5b2149bbbfc29b6687474e40 (DEFAULT_TABLE table=default.Table_8dafd1175a9e47c0a409ab3fe102592f [id=b096742442b7428992ee54a1945185ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.049177 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665d5bc5b2149bbbfc29b6687474e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.050911 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_5cc1e6eebfc24e5d9a8fca3d7fae39e8" } new_table_name: "default.Table_3864190d95d0498e805c821398064c56" modify_external_catalogs: true
W20260928 14:50:43.051797 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 78379bd4cfce46fa812374f046d9d329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78379bd4cfce46fa812374f046d9d329 already in progress: creating tablet
I20260928 14:50:43.052951 9813 tablet_replica.cc:330] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:43.054642 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:43.054998 9813 raft_consensus.cc:2229] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.057991 9851 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:43.058017 9360 leader_election.cc:341] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:43.058111 9360 leader_election.cc:302] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.058949 11111 raft_consensus.cc:2726] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.059700 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.060173 9497 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.060280 9497 leader_election.cc:302] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.061080 11210 raft_consensus.cc:2726] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.062254 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d8f90aac9f42ebbca4cdc87a78a340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.062362 9851 tablet_bootstrap.cc:654] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.056636 9813 raft_consensus.cc:2258] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.070899 9814 ts_tablet_manager.cc:1918] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:43.070473 9813 ts_tablet_manager.cc:1905] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:43.074136 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 92771.3us
I20260928 14:50:43.076128 11210 raft_consensus.cc:482] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.076248 11210 raft_consensus.cc:504] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.076798 11210 leader_election.cc:288] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.077482 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebd54cdc07549e5b7cb179f4ab3aa9f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.077965 9498 leader_election.cc:341] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.078531 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebd54cdc07549e5b7cb179f4ab3aa9f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.079048 9497 leader_election.cc:341] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.079139 9497 leader_election.cc:302] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.079797 11210 raft_consensus.cc:2726] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.099308 9855 tablet_bootstrap.cc:654] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.103358 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_c7c519080c7b493ca8249b294e8d446e [id=b58aea2205304defa62befcee84dfa0f] alter complete (version 2)
W20260928 14:50:43.106516 9219 consensus_peers.cc:487] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78379bd4cfce46fa812374f046d9d329. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.107355 9855 tablet_bootstrap.cc:492] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.107475 9855 ts_tablet_manager.cc:1397] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.302s user 0.006s sys 0.001s
I20260928 14:50:43.108259 9855 raft_consensus.cc:348] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.108472 9855 raft_consensus.cc:374] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.108536 9855 raft_consensus.cc:729] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.108698 9855 consensus_queue.cc:260] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.108806 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 8d97efa3a3d94ef7b6d9a5cd16772297 (DEFAULT_TABLE table=default.Table_5ec6b786d4384e2a9a9cc6e7acbe2381 [id=591b0710332c4030b02758f56b37c7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.108911 8952 catalog_manager.cc:5495] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:43.110306 9395 tablet_service.cc:1467] Processing CreateTablet for tablet f6278495a7e44ff38e76093dbe18e00a (DEFAULT_TABLE table=default.Table_d97981f6266a4d3a903d343ca77cf898 [id=61fd9e5d248b47b0ba2f0045a35401c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.110155 8952 catalog_manager.cc:5495] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:43.110519 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:43.110797 8952 catalog_manager.cc:5495] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:43.111122 9855 ts_tablet_manager.cc:1428] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:43.111200 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:43.111372 9855 tablet_bootstrap.cc:492] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.111756 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dd796afb3f1c4d0e954db5c51225c5fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.112253 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd796afb3f1c4d0e954db5c51225c5fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.112795 9855 tablet_bootstrap.cc:654] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:43.113891 9220 consensus_peers.cc:487] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.118024 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:43.118811 9256 tablet_service.cc:1467] Processing CreateTablet for tablet f5f30a4a4fca48818a7a89ad91e71393 (DEFAULT_TABLE table=default.Table_ad01b16b05e54931a25a012cda7fd249 [id=88985557f5d34bf387faac59a85060cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.119751 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5f30a4a4fca48818a7a89ad91e71393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.123750 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:43.111466 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:43.125399 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:43.125995 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:43.126593 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:43.129974 9855 tablet_bootstrap.cc:492] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.130090 9855 ts_tablet_manager.cc:1397] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260928 14:50:43.130874 9855 raft_consensus.cc:348] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.131261 9855 raft_consensus.cc:374] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.131326 9855 raft_consensus.cc:729] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.131526 9855 consensus_queue.cc:260] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.132073 9855 ts_tablet_manager.cc:1428] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:43.132297 9855 tablet_bootstrap.cc:492] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.133865 9855 tablet_bootstrap.cc:654] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.139031 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 167abd4bc50d43cb98d667be90ea278a) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.139325 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.139607 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.143042 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 2197ea1acde444f8ad84579b9b47ea51 (DEFAULT_TABLE table=default.Table_3d233586a3884d9e823e355e84e58c36 [id=549f10a9c74a4b10badd3dc55ebaf226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.144379 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 2197ea1acde444f8ad84579b9b47ea51 (DEFAULT_TABLE table=default.Table_3d233586a3884d9e823e355e84e58c36 [id=549f10a9c74a4b10badd3dc55ebaf226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.145345 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2197ea1acde444f8ad84579b9b47ea51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.146759 9855 tablet_bootstrap.cc:492] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.146870 9855 ts_tablet_manager.cc:1397] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260928 14:50:43.147528 9855 raft_consensus.cc:348] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.147707 9855 raft_consensus.cc:374] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.147778 9855 raft_consensus.cc:729] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.147970 9855 consensus_queue.cc:260] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.148190 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 1016ad6219294ccd829fca9b264ab06f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.148377 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 8d97efa3a3d94ef7b6d9a5cd16772297 (DEFAULT_TABLE table=default.Table_5ec6b786d4384e2a9a9cc6e7acbe2381 [id=591b0710332c4030b02758f56b37c7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.148979 9855 ts_tablet_manager.cc:1428] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:43.149782 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d97efa3a3d94ef7b6d9a5cd16772297. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:43.155653 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86242ca6e920486781f3aec9125f70da consensus state has no leader
I20260928 14:50:43.157073 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b5f2ef84e1d5493197263d4c75351a01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.157624 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5f2ef84e1d5493197263d4c75351a01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.159335 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1c52977bce7f4827a0f457d17e965e7b" } modify_external_catalogs: true
I20260928 14:50:43.159495 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1c52977bce7f4827a0f457d17e965e7b" } modify_external_catalogs: true
I20260928 14:50:43.159576 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3913883ec5c147228a2fd6f88cd71bbe" } modify_external_catalogs: true
I20260928 14:50:43.159705 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3913883ec5c147228a2fd6f88cd71bbe" } modify_external_catalogs: true
I20260928 14:50:43.165637 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2197ea1acde444f8ad84579b9b47ea51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.165695 9855 tablet_bootstrap.cc:492] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.167284 9855 tablet_bootstrap.cc:654] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.169495 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 8d97efa3a3d94ef7b6d9a5cd16772297 (DEFAULT_TABLE table=default.Table_5ec6b786d4384e2a9a9cc6e7acbe2381 [id=591b0710332c4030b02758f56b37c7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.170557 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d97efa3a3d94ef7b6d9a5cd16772297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.177992 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e2e25c29ddcb4a07961f270778752d31 (DEFAULT_TABLE table=default.Table_dcba372056cd4a11b78766e934ccf0cf [id=54e11b6beddc499380194eef8f4d0152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.183472 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0476e104034af9a75005a105c93fe1 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.187726 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467804599a804a999c15b1fa44f5a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.188105 9855 tablet_bootstrap.cc:492] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.188275 9855 ts_tablet_manager.cc:1397] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.007s
I20260928 14:50:43.189055 9855 raft_consensus.cc:348] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.189317 9855 raft_consensus.cc:374] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.189406 9855 raft_consensus.cc:729] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.189654 9855 consensus_queue.cc:260] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.190275 9855 ts_tablet_manager.cc:1428] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:43.190553 9855 tablet_bootstrap.cc:492] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.191804 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eadfd22dc3cc463e818690f34e59fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.197609 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860ea08eb03d4d5a8234d03db33ea899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.198925 9851 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.199162 9851 ts_tablet_manager.cc:1397] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.141s user 0.005s sys 0.000s
I20260928 14:50:43.201833 9851 raft_consensus.cc:348] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.202814 9851 raft_consensus.cc:374] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.203060 9851 raft_consensus.cc:729] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.204654 11210 raft_consensus.cc:482] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.204780 11210 raft_consensus.cc:504] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.204452 9851 consensus_queue.cc:260] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.205297 11210 leader_election.cc:288] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.206245 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.206615 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.207154 9253 tablet_service.cc:1467] Processing CreateTablet for tablet f6278495a7e44ff38e76093dbe18e00a (DEFAULT_TABLE table=default.Table_d97981f6266a4d3a903d343ca77cf898 [id=61fd9e5d248b47b0ba2f0045a35401c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.207844 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6278495a7e44ff38e76093dbe18e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.207935 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0476e104034af9a75005a105c93fe1 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.208240 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0476e104034af9a75005a105c93fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.216161 9265 tablet_service.cc:1467] Processing CreateTablet for tablet e2e25c29ddcb4a07961f270778752d31 (DEFAULT_TABLE table=default.Table_dcba372056cd4a11b78766e934ccf0cf [id=54e11b6beddc499380194eef8f4d0152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.216500 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2e25c29ddcb4a07961f270778752d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.218107 11270 log.cc:824] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Log is configured to *not* fsync() on all Append() calls
I20260928 14:50:43.222935 9848 tablet_bootstrap.cc:492] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:43.225306 9848 ts_tablet_manager.cc:1397] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.264s user 0.009s sys 0.003s
I20260928 14:50:43.253579 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 6aa393b1fc2b40ebb87df86180717db8 (table default.Table_0b822e5685d1472b8e5cb2ef43cd0f4d [id=a325eabc142d47b88dae65aaba6082c1]). Expected version 1 got 0
I20260928 14:50:43.253774 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bda4f5da7a6b4a4e867d4e260a274d2a (table default.Table_35bed516887d44ccb8b35dae4b50f062 [id=0fe8de98dfb54d84912d74fec349c41b]). Expected version 1 got 0
I20260928 14:50:43.254603 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_501091711363421190e5322913ccb3c8" } modify_external_catalogs: true
I20260928 14:50:43.254783 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_501091711363421190e5322913ccb3c8" } modify_external_catalogs: true
I20260928 14:50:43.259709 9855 tablet_bootstrap.cc:654] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:43.260842 9497 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:43.261232 9498 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.261322 9498 leader_election.cc:302] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.261637 11210 raft_consensus.cc:482] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.261744 11227 raft_consensus.cc:2726] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.261750 11210 raft_consensus.cc:504] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.262431 11210 leader_election.cc:288] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.263172 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.263659 9498 leader_election.cc:341] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.267529 11210 raft_consensus.cc:482] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.267657 11210 raft_consensus.cc:504] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.268200 11210 leader_election.cc:288] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.268837 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a14c0b50cad4954b5dc5666689810ba" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.270875 9498 leader_election.cc:341] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.276655 9529 tablet_service.cc:1467] Processing CreateTablet for tablet f6278495a7e44ff38e76093dbe18e00a (DEFAULT_TABLE table=default.Table_d97981f6266a4d3a903d343ca77cf898 [id=61fd9e5d248b47b0ba2f0045a35401c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.278091 9535 tablet_service.cc:1467] Processing CreateTablet for tablet e2e25c29ddcb4a07961f270778752d31 (DEFAULT_TABLE table=default.Table_dcba372056cd4a11b78766e934ccf0cf [id=54e11b6beddc499380194eef8f4d0152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.278152 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.278350 9284 raft_consensus.cc:2454] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:43.278604 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a14c0b50cad4954b5dc5666689810ba" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.278703 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2e25c29ddcb4a07961f270778752d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.279193 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6278495a7e44ff38e76093dbe18e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.282449 9497 leader_election.cc:302] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.282689 11210 raft_consensus.cc:2781] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:43.282759 11210 raft_consensus.cc:482] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:43.282816 11210 raft_consensus.cc:3037] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:43.282781 9497 leader_election.cc:341] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.284348 9497 leader_election.cc:302] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.284672 11227 raft_consensus.cc:2726] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.282440 9848 raft_consensus.cc:348] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.292204 9848 raft_consensus.cc:374] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.292352 9848 raft_consensus.cc:729] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.292618 9848 consensus_queue.cc:260] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:43.295491 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5eadeeeaa9384684b41b1abbafc4724d consensus state has no leader
W20260928 14:50:43.297739 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a1a6f397cee4b54ac2a39d19b132b23 consensus state has no leader
I20260928 14:50:43.298029 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fd8492b512fc4972890e5b661b979542" } modify_external_catalogs: true
I20260928 14:50:43.298182 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fd8492b512fc4972890e5b661b979542" } modify_external_catalogs: true
I20260928 14:50:43.297474 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 9ca013d1c5b44730b7163e71dc408b04 (table default.Table_fc40bc4e324e44b79c283937cc1639f8 [id=406fbbcbe232457bbe03bfe66ec127f3]). Expected version 4 got 0
I20260928 14:50:43.301263 9815 ts_tablet_manager.cc:1918] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.302191 9848 ts_tablet_manager.cc:1428] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.075s user 0.004s sys 0.001s
I20260928 14:50:43.302245 9815 log.cc:1196] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c51f5944c6534e9492594c39ae9796b2
I20260928 14:50:43.305867 9534 tablet_service.cc:1514] Processing DeleteTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.307610 9848 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:43.313771 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5855715375140f5b54b0d53ed1ea915 consensus state has no leader
I20260928 14:50:43.314129 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f573f1430fb34a24978cb467dd065e73" } modify_external_catalogs: true
I20260928 14:50:43.314291 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f573f1430fb34a24978cb467dd065e73" } modify_external_catalogs: true
I20260928 14:50:43.303124 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0476e104034af9a75005a105c93fe1 (DEFAULT_TABLE table=default.Table_299e54db07bd4d3ca9187dea43609f6e [id=467bf30576a345d2b5649ceae44b8136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.319265 11227 raft_consensus.cc:482] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.319509 11227 raft_consensus.cc:504] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.320071 11227 leader_election.cc:288] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.320478 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a2f051a09e143b8bb0ba3be81406b98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.320684 9220 consensus_peers.cc:487] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.320901 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a2f051a09e143b8bb0ba3be81406b98" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.321028 9497 leader_election.cc:341] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.308624 11210 raft_consensus.cc:504] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:43.322083 9498 leader_election.cc:341] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.322178 9498 leader_election.cc:302] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.322337 11210 leader_election.cc:288] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.322472 11210 raft_consensus.cc:2726] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.322824 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:43.323930 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13976317a32495ab377654b738667ca" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b"
W20260928 14:50:43.323990 9498 leader_election.cc:341] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.324115 9285 raft_consensus.cc:3037] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:43.326637 9285 raft_consensus.cc:2454] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 1.
I20260928 14:50:43.327041 9497 leader_election.cc:302] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.327273 11227 raft_consensus.cc:2781] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:43.327391 11227 raft_consensus.cc:686] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [term 1 LEADER]: Becoming Leader. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Running, Role: LEADER
I20260928 14:50:43.327591 11227 consensus_queue.cc:237] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.327986 9855 tablet_bootstrap.cc:492] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.328104 9855 ts_tablet_manager.cc:1397] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.138s user 0.015s sys 0.012s
I20260928 14:50:43.328960 9855 raft_consensus.cc:348] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.329227 9855 raft_consensus.cc:374] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.329341 9855 raft_consensus.cc:729] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.329612 9855 consensus_queue.cc:260] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.330380 9855 ts_tablet_manager.cc:1428] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:43.331377 9815 ts_tablet_manager.cc:1939] T c51f5944c6534e9492594c39ae9796b2 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:43.332227 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c51f5944c6534e9492594c39ae9796b2 (table default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]) successfully deleted
I20260928 14:50:43.335003 9815 tablet_replica.cc:330] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:43.335211 9855 tablet_bootstrap.cc:492] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.335373 9815 raft_consensus.cc:2229] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.335505 9815 raft_consensus.cc:2258] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.335951 9815 ts_tablet_manager.cc:1905] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.337376 9855 tablet_bootstrap.cc:654] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.345572 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1d0fb55d38407d8b94938745a06c85 (DEFAULT_TABLE table=default.Table_2d301fe970e5485298f6c45e414c5d81 [id=ffc6ed40ba5049619467f6c3eb2b0d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.346421 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1d0fb55d38407d8b94938745a06c85 (DEFAULT_TABLE table=default.Table_2d301fe970e5485298f6c45e414c5d81 [id=ffc6ed40ba5049619467f6c3eb2b0d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.346814 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1d0fb55d38407d8b94938745a06c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.348402 11228 consensus_queue.cc:1035] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.349190 11228 raft_consensus.cc:482] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.349320 11228 raft_consensus.cc:504] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.349855 11228 leader_election.cc:288] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.350612 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc47ae6fbfca4fc0b0b053d0134a49d0" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.351140 9220 leader_election.cc:341] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:43.351531 9219 leader_election.cc:341] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:43.351635 9219 leader_election.cc:302] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.353359 9851 ts_tablet_manager.cc:1428] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.154s user 0.004s sys 0.000s
I20260928 14:50:43.352531 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0476e104034af9a75005a105c93fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.357913 11218 raft_consensus.cc:2726] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.358206 11218 consensus_queue.cc:1035] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:43.359302 9220 consensus_peers.cc:487] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:43.361599 9220 consensus_peers.cc:487] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.363631 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8 (DEFAULT_TABLE table=default.Table_972da0796cdf4773bd29790b1ac8a479 [id=fd58a2009d2a41b69b00c973d175843c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.363792 9851 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.364666 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1d0fb55d38407d8b94938745a06c85 (DEFAULT_TABLE table=default.Table_2d301fe970e5485298f6c45e414c5d81 [id=ffc6ed40ba5049619467f6c3eb2b0d6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.365650 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1d0fb55d38407d8b94938745a06c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.370666 11228 consensus_queue.cc:1035] T 36613153c867446f9255d2290cfd9d06 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.375932 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8 (DEFAULT_TABLE table=default.Table_972da0796cdf4773bd29790b1ac8a479 [id=fd58a2009d2a41b69b00c973d175843c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.376288 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.380868 11228 consensus_queue.cc:1035] T 55c81b682dea493fac8665d8ccff7199 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.382189 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8 (DEFAULT_TABLE table=default.Table_972da0796cdf4773bd29790b1ac8a479 [id=fd58a2009d2a41b69b00c973d175843c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:43.384976 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:43.387300 9220 consensus_peers.cc:487] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.398324 9851 tablet_bootstrap.cc:654] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.413717 11210 raft_consensus.cc:482] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.413837 11210 raft_consensus.cc:504] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.414443 11210 leader_election.cc:288] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.414958 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.415444 9497 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.416074 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.416636 9498 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.416733 9498 leader_election.cc:302] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.416844 11228 consensus_queue.cc:1035] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.417124 11210 raft_consensus.cc:2726] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.446424 11210 raft_consensus.cc:482] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.446542 11210 raft_consensus.cc:504] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.447052 11210 leader_election.cc:288] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.447830 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f4b20a5e784d909f7297cc7f1b05e6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.448745 9497 leader_election.cc:341] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.449041 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f4b20a5e784d909f7297cc7f1b05e6" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.449594 9498 leader_election.cc:341] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.449687 9498 leader_election.cc:302] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.450341 11210 raft_consensus.cc:2726] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.460882 11111 raft_consensus.cc:482] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.461025 11111 raft_consensus.cc:504] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.461570 11111 leader_election.cc:288] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:43.462167 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.464654 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91262a2cf39e4e5bb4854998332ca1f1" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:43.465178 9360 leader_election.cc:302] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.465517 11111 raft_consensus.cc:2726] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.478580 9422 raft_consensus.cc:3037] T d5b08f7c9a1e4fcab0951eb5d4cd059a P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:43.497742 8949 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:43.505643 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.505869 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.506033 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.506162 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.506462 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:43.513754 9220 consensus_peers.cc:487] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.516397 9855 tablet_bootstrap.cc:492] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.516534 9855 ts_tablet_manager.cc:1397] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.181s user 0.017s sys 0.027s
I20260928 14:50:43.517159 9855 raft_consensus.cc:348] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.517357 9855 raft_consensus.cc:374] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.517410 9855 raft_consensus.cc:729] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.517590 9855 consensus_queue.cc:260] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.518103 9855 ts_tablet_manager.cc:1428] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:43.518349 9855 tablet_bootstrap.cc:492] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.519711 9855 tablet_bootstrap.cc:654] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.527041 11111 raft_consensus.cc:482] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.527174 11111 raft_consensus.cc:504] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.527727 11111 leader_election.cc:288] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:43.528640 9360 leader_election.cc:341] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 75f9359df0ac466c912cd20fc6b94390
W20260928 14:50:43.529498 9360 leader_election.cc:341] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 75f9359df0ac466c912cd20fc6b94390
I20260928 14:50:43.529619 9360 leader_election.cc:302] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.529989 11111 raft_consensus.cc:2726] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:43.531564 9498 consensus_peers.cc:487] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.533648 9815 ts_tablet_manager.cc:1918] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.534014 9815 log.cc:1196] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4744deca899b4e6caa57f70ce1df8a8d
I20260928 14:50:43.534703 9815 ts_tablet_manager.cc:1939] T 4744deca899b4e6caa57f70ce1df8a8d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:43.536399 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4744deca899b4e6caa57f70ce1df8a8d (table default.Table_ab677e004fee49e4882b664fb17465d4 [id=0a4962670d0a43b2aac92a73a5fb69cf]) successfully deleted
I20260928 14:50:43.539572 9851 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.539845 9851 ts_tablet_manager.cc:1397] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.176s user 0.004s sys 0.000s
I20260928 14:50:43.542955 9855 tablet_bootstrap.cc:492] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.543191 9855 ts_tablet_manager.cc:1397] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.005s
I20260928 14:50:43.544739 9855 raft_consensus.cc:348] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.545293 9855 raft_consensus.cc:374] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.545446 9855 raft_consensus.cc:729] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.545954 9855 consensus_queue.cc:260] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.549643 9855 ts_tablet_manager.cc:1428] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260928 14:50:43.550793 9855 tablet_bootstrap.cc:492] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.554203 11227 raft_consensus.cc:482] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.554417 11227 raft_consensus.cc:504] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.555413 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.555754 11111 raft_consensus.cc:482] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.555855 11111 raft_consensus.cc:504] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.556335 11111 leader_election.cc:288] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:43.557133 9360 leader_election.cc:341] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 71b5f68b570e4fff8f8748e4c762ad78
I20260928 14:50:43.556599 9851 raft_consensus.cc:348] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.557340 9851 raft_consensus.cc:374] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.557627 9851 raft_consensus.cc:729] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.557654 9855 tablet_bootstrap.cc:654] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:43.557824 9498 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.558049 11227 leader_election.cc:288] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.558521 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.558383 9851 consensus_queue.cc:260] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:43.559267 9497 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.560043 9497 leader_election.cc:302] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.560289 11227 raft_consensus.cc:2726] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.560679 9851 ts_tablet_manager.cc:1428] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.021s user 0.001s sys 0.003s
W20260928 14:50:43.560850 9360 leader_election.cc:341] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 71b5f68b570e4fff8f8748e4c762ad78
I20260928 14:50:43.560940 9360 leader_election.cc:302] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.561327 11111 raft_consensus.cc:2726] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.562592 9424 raft_consensus.cc:3037] T 91262a2cf39e4e5bb4854998332ca1f1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:43.568722 11227 raft_consensus.cc:482] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.568884 11227 raft_consensus.cc:504] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.569881 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.570416 9498 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.570585 11227 leader_election.cc:288] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.571046 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.571633 9497 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.571772 9497 leader_election.cc:302] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.572208 11227 raft_consensus.cc:2726] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:43.575160 9220 consensus_peers.cc:487] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:43.581151 8949 catalog_manager.cc:5495] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3). New cstate: current_term: 1 leader_uuid: "658e483a10314e8d93c2f6e9084f2a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:43.581638 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 2 got 0
I20260928 14:50:43.582521 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_365a675e1c6e411f8e2e632d45a8d948" } new_table_name: "default.Table_3ea8db61274e41a08148c87cf11173ec" modify_external_catalogs: true
I20260928 14:50:43.583789 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_13e05569d38a40b081e20e2d67cb1f12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.584286 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13e05569d38a40b081e20e2d67cb1f12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.591557 9815 tablet_replica.cc:330] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:43.591841 9815 raft_consensus.cc:2229] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.594262 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c9bfad9c3b884d388ca4743438a34c0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.594743 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9bfad9c3b884d388ca4743438a34c0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.595732 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a5eb8907be064167a3739715d24c94e9
I20260928 14:50:43.596359 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_272ae048ec1e43cd95fdc4772c5a38a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.596772 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_272ae048ec1e43cd95fdc4772c5a38a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.597762 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 19a668806adc4975bebb4ebb1a9d3c82
I20260928 14:50:43.597967 9855 tablet_bootstrap.cc:492] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.598078 9855 ts_tablet_manager.cc:1397] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.000s
I20260928 14:50:43.598186 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 71ec7763cd5e4578919ce5824eea1329 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:43.598299 11227 raft_consensus.cc:482] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.598416 11227 raft_consensus.cc:504] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.598747 9855 raft_consensus.cc:348] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.598935 9855 raft_consensus.cc:374] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.598987 9855 raft_consensus.cc:729] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.599140 9855 consensus_queue.cc:260] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.599354 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6fed86d9eda45cab2083fca73825383" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.599593 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet a5eb8907be064167a3739715d24c94e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.599650 9855 ts_tablet_manager.cc:1428] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:43.599665 9404 tablet_service.cc:1514] Processing DeleteTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.599872 9855 tablet_bootstrap.cc:492] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:43.599993 9498 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.600123 11227 leader_election.cc:288] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.600818 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6fed86d9eda45cab2083fca73825383" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.601109 9855 tablet_bootstrap.cc:654] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.601220 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.601951 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 19a668806adc4975bebb4ebb1a9d3c82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:43.602226 9497 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.602366 9497 leader_election.cc:302] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.602731 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet a5eb8907be064167a3739715d24c94e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.602926 11227 raft_consensus.cc:2726] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.604898 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet a5eb8907be064167a3739715d24c94e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:43.611873 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 9f04c05cdad04261a1e2ae7e044ddbfb (table default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9f04c05cdad04261a1e2ae7e044ddbfb consensus state has no leader
I20260928 14:50:43.618857 11303 consensus_queue.cc:1035] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.619498 9851 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.627485 9851 tablet_bootstrap.cc:654] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.629240 11303 raft_consensus.cc:482] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.629410 11303 raft_consensus.cc:504] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.630333 11303 leader_election.cc:288] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.630511 11303 raft_consensus.cc:482] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.630640 11303 raft_consensus.cc:504] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.631672 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.632212 9498 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.632400 11303 leader_election.cc:288] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.632673 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "666de9dd64734708b35738605204ed7d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.632982 9814 log.cc:1196] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/86d21f615343473a95cd1f5040aebc79
W20260928 14:50:43.633126 9498 leader_election.cc:341] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.633906 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "666de9dd64734708b35738605204ed7d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.634136 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.634648 9497 leader_election.cc:341] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.634792 9497 leader_election.cc:302] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.635022 11227 raft_consensus.cc:2726] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.634137 9814 ts_tablet_manager.cc:1939] T 86d21f615343473a95cd1f5040aebc79 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:43.636750 9497 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.637188 9497 leader_election.cc:302] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.637809 11227 raft_consensus.cc:2726] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.638566 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1d0fb55d38407d8b94938745a06c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.638816 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d8f90aac9f42ebbca4cdc87a78a340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.641570 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6278495a7e44ff38e76093dbe18e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.641762 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0476e104034af9a75005a105c93fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.641981 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7d6e6917a48a8a56b3ac2039e8fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.642131 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5f30a4a4fca48818a7a89ad91e71393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.643206 9848 tablet_bootstrap.cc:654] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.645010 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 860ea08eb03d4d5a8234d03db33ea899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.645620 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2e25c29ddcb4a07961f270778752d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.648198 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be38aab2776b4091afe369da62a86b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.649078 9813 ts_tablet_manager.cc:1918] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.649164 9813 log.cc:1196] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8520b28899bc42b08e239502adb8fece
I20260928 14:50:43.649348 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eadfd22dc3cc463e818690f34e59fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.649411 9813 ts_tablet_manager.cc:1939] T 8520b28899bc42b08e239502adb8fece P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:43.649554 9815 raft_consensus.cc:2258] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.651813 9848 tablet_bootstrap.cc:492] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:43.651918 9848 ts_tablet_manager.cc:1397] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.345s user 0.003s sys 0.007s
I20260928 14:50:43.652158 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467804599a804a999c15b1fa44f5a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.653685 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e642af72ff4f5285f8bc4e6ed36401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.661811 9851 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.662010 9851 ts_tablet_manager.cc:1397] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.003s
I20260928 14:50:43.663095 9851 raft_consensus.cc:348] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.663419 9851 raft_consensus.cc:374] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.663497 9851 raft_consensus.cc:729] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.663836 9851 consensus_queue.cc:260] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.650043 9815 ts_tablet_manager.cc:1905] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.664711 9851 ts_tablet_manager.cc:1428] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260928 14:50:43.666145 10975 consensus_queue.cc:1035] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:43.667826 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2197ea1acde444f8ad84579b9b47ea51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.675169 9855 tablet_bootstrap.cc:492] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.675288 9855 ts_tablet_manager.cc:1397] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.075s user 0.007s sys 0.000s
I20260928 14:50:43.675932 9855 raft_consensus.cc:348] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.676136 9855 raft_consensus.cc:374] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.676182 9855 raft_consensus.cc:729] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.676503 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d97efa3a3d94ef7b6d9a5cd16772297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:43.676384 9855 consensus_queue.cc:260] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.676903 9855 ts_tablet_manager.cc:1428] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:43.677145 9855 tablet_bootstrap.cc:492] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.678504 9855 tablet_bootstrap.cc:654] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.679623 9851 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.680860 9851 tablet_bootstrap.cc:654] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.681110 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1081) took 1055 ms. Trace:
I20260928 14:50:43.681200 9814 rpcz_store.cc:276] 0928 14:50:42.625838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.625886 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:42.876626 (+250740us) ts_tablet_manager.cc:1145] Deleting tablet 86d21f615343473a95cd1f5040aebc79
0928 14:50:42.876637 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:42.895164 (+ 18527us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.070705 (+175541us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.681082 (+610377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":250581}
I20260928 14:50:43.681567 9814 tablet_replica.cc:330] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:43.681767 9814 raft_consensus.cc:2229] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.681931 9814 raft_consensus.cc:2258] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.682703 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 86d21f615343473a95cd1f5040aebc79 (table default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]) successfully deleted
I20260928 14:50:43.692704 9814 ts_tablet_manager.cc:1905] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.693393 11111 raft_consensus.cc:482] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.693509 11111 raft_consensus.cc:504] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.694064 11111 leader_election.cc:288] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:43.694983 9851 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:43.694988 9360 leader_election.cc:341] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:43.695155 9851 ts_tablet_manager.cc:1397] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.009s
W20260928 14:50:43.695652 9360 leader_election.cc:341] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:43.695748 9360 leader_election.cc:302] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.696055 11111 raft_consensus.cc:2726] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.696321 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:43.696172 9851 raft_consensus.cc:348] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.696460 9851 raft_consensus.cc:374] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.696570 9851 raft_consensus.cc:729] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.696879 9851 consensus_queue.cc:260] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.697739 9851 ts_tablet_manager.cc:1428] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:43.698135 9851 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.702246 9851 tablet_bootstrap.cc:654] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.704445 9855 tablet_bootstrap.cc:492] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.704612 9855 ts_tablet_manager.cc:1397] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20260928 14:50:43.705365 9855 raft_consensus.cc:348] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.705626 9855 raft_consensus.cc:374] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.705722 9855 raft_consensus.cc:729] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.705945 9855 consensus_queue.cc:260] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.706502 9855 ts_tablet_manager.cc:1428] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:43.706769 9855 tablet_bootstrap.cc:492] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.708047 9855 tablet_bootstrap.cc:654] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.708648 9848 raft_consensus.cc:348] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.708833 9848 raft_consensus.cc:374] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.708878 9848 raft_consensus.cc:729] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.709036 9848 consensus_queue.cc:260] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.720970 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d604978c5289471a854c9b286d137f61
I20260928 14:50:43.721668 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet d604978c5289471a854c9b286d137f61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.722142 9851 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.722301 9851 ts_tablet_manager.cc:1397] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20260928 14:50:43.722642 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6f73568a67cb401388beaa266a0324fc
I20260928 14:50:43.723253 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f73568a67cb401388beaa266a0324fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.723261 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4cb83b9d56df409dbed6569e1a6ac95d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:43.723448 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f73568a67cb401388beaa266a0324fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.723284 9851 raft_consensus.cc:348] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.723579 9851 raft_consensus.cc:374] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.723708 9851 raft_consensus.cc:729] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:43.723759 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cb83b9d56df409dbed6569e1a6ac95d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.724002 9851 consensus_queue.cc:260] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.724836 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5d8e4357c3d5487fa76e1e49c6cb7547
I20260928 14:50:43.724911 9851 ts_tablet_manager.cc:1428] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:43.725324 9851 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.725430 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_984254761e7344bbbde3d73a0ca783ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:43.725569 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.725682 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f73568a67cb401388beaa266a0324fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.725705 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:43.725880 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_984254761e7344bbbde3d73a0ca783ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.727348 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet d604978c5289471a854c9b286d137f61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.728048 11227 raft_consensus.cc:482] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.728155 11227 raft_consensus.cc:504] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.728977 11227 leader_election.cc:288] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.729175 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1016ad6219294ccd829fca9b264ab06f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.729636 9498 leader_election.cc:341] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.730230 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.730719 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1016ad6219294ccd829fca9b264ab06f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.731410 9497 leader_election.cc:341] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.731678 9851 tablet_bootstrap.cc:654] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.731932 9497 leader_election.cc:302] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.732321 11227 raft_consensus.cc:2726] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.733513 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6a14097e0acf40e6a81b13806b67983d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.735039 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a14097e0acf40e6a81b13806b67983d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:43.733744 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3d0060df4264a80b623bce21f41a906 consensus state has no leader
I20260928 14:50:43.736239 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0ccb3313b7104b4c8d0d1c59915df4a6" } new_table_name: "default.Table_342afda0d3be4679a419bdb3bf6b4810" modify_external_catalogs: true
I20260928 14:50:43.734189 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:43.737584 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:43.737736 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:43.737867 8946 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 2 got 0
I20260928 14:50:43.741622 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.743789 9848 ts_tablet_manager.cc:1428] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.092s user 0.001s sys 0.001s
I20260928 14:50:43.750684 8948 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:43.751091 9851 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.751286 9851 ts_tablet_manager.cc:1397] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260928 14:50:43.751149 9848 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:43.752374 9851 raft_consensus.cc:348] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.752708 9851 raft_consensus.cc:374] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.752866 9848 tablet_bootstrap.cc:654] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.752823 9851 raft_consensus.cc:729] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.753157 9851 consensus_queue.cc:260] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.754030 9851 ts_tablet_manager.cc:1428] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:43.758086 9813 tablet_replica.cc:330] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:43.758224 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8520b28899bc42b08e239502adb8fece (table default.Table_f97651e18ff042809ba35856d05b379b [id=04dc1268aa0946eab455f92c61cc8540]) successfully deleted
I20260928 14:50:43.758270 9813 raft_consensus.cc:2229] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.764621 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 71ec7763cd5e4578919ce5824eea1329
I20260928 14:50:43.764989 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 71ec7763cd5e4578919ce5824eea1329 deleted and replaced by tablet 4cccb5b9c17644cf91971919bd66a82a
I20260928 14:50:43.765503 9851 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.765743 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 71ec7763cd5e4578919ce5824eea1329 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cccb5b9c17644cf91971919bd66a82a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.767096 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:43.767271 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_a295eec0df314d1daf27bb41be119c4c [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 1 got 0
I20260928 14:50:43.768755 9851 tablet_bootstrap.cc:654] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.768970 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.769330 9813 raft_consensus.cc:2258] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.771035 9813 ts_tablet_manager.cc:1905] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.772279 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet d604978c5289471a854c9b286d137f61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.772423 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.774246 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:43.774523 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:43.774806 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet ab6ccac2580049a5a615d8d36a44f373 (table default.Table_80bae2129fb24491b999a368ecb99d3f [id=9793280eca254a92865bde9e52fe4588]). Expected version 1 got 0
I20260928 14:50:43.776887 9848 tablet_bootstrap.cc:492] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:43.782797 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 71ec7763cd5e4578919ce5824eea1329 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cccb5b9c17644cf91971919bd66a82a) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.783252 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.783334 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a70f70162c2433aab5136514bd5fc03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.783614 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 71ec7763cd5e4578919ce5824eea1329 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cccb5b9c17644cf91971919bd66a82a) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.783627 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.784427 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.784747 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 666de9dd64734708b35738605204ed7d with delete_type TABLET_DATA_DELETED (replaced by tablet f421b29c12cb4b5989de6bebcf04639f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.788532 9855 tablet_bootstrap.cc:492] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.788650 9855 ts_tablet_manager.cc:1397] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.000s
I20260928 14:50:43.789285 9855 raft_consensus.cc:348] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.789480 9855 raft_consensus.cc:374] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.789547 9855 raft_consensus.cc:729] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.789750 9855 consensus_queue.cc:260] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.790200 9855 ts_tablet_manager.cc:1428] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260928 14:50:43.790437 9855 tablet_bootstrap.cc:492] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.791316 9814 ts_tablet_manager.cc:1918] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:43.791720 9855 tablet_bootstrap.cc:654] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:43.807722 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4569747ca024b828b06041e0a4f713d consensus state has no leader
I20260928 14:50:43.809741 8951 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:43.811466 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:43.811632 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 2 got 0
I20260928 14:50:43.811753 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:43.812541 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 080159d2e65a4550861f4c63fb22d02e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:43.813301 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3499650ce231436095c708ac28e8970d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:43.813747 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_68635365d02e43d7865b30d3eaf7ac6b" } new_table_name: "default.Table_cde6c7c6b29445ecb29c9a8a784f9396" modify_external_catalogs: true
I20260928 14:50:43.815650 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f117618475d94504bff9ad1fccf76bf9" } new_table_name: "default.Table_9c0cf19be132450eb3c9264d1a2857a9" modify_external_catalogs: true
I20260928 14:50:43.816890 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_24223101f6054757a0e18eaec7b32802"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.817349 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24223101f6054757a0e18eaec7b32802 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:43.817837 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3499650ce231436095c708ac28e8970d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.822089 9848 ts_tablet_manager.cc:1397] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.071s user 0.001s sys 0.002s
I20260928 14:50:43.822743 9848 raft_consensus.cc:348] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.822935 9848 raft_consensus.cc:374] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.822988 9848 raft_consensus.cc:729] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.823122 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04" } modify_external_catalogs: true
I20260928 14:50:43.823186 9848 consensus_queue.cc:260] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.823292 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04" } modify_external_catalogs: true
I20260928 14:50:43.827950 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3df105fd8cd24039977b94b28b424121" } modify_external_catalogs: true
I20260928 14:50:43.828105 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet ea7b363d546c45ceb3efb9352cf184f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.828097 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3df105fd8cd24039977b94b28b424121" } modify_external_catalogs: true
I20260928 14:50:43.820962 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e8af7c0d4df34461a4185b78977b526f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.831290 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8af7c0d4df34461a4185b78977b526f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.832885 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.834599 9815 ts_tablet_manager.cc:1918] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.834714 9815 log.cc:1196] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/846a96509f32416087ee4667458c367e
I20260928 14:50:43.835078 9815 ts_tablet_manager.cc:1939] T 846a96509f32416087ee4667458c367e P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:43.835884 9815 tablet_replica.cc:330] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:43.836066 9815 raft_consensus.cc:2229] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.836128 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 846a96509f32416087ee4667458c367e (table default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]) successfully deleted
I20260928 14:50:43.836187 9815 raft_consensus.cc:2258] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.836669 9815 ts_tablet_manager.cc:1905] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.840119 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f3715b90ca484321bbe766fa27007209" } new_table_name: "default.Table_03c992ad6cc3449fa1220a63d4cfd681" modify_external_catalogs: true
I20260928 14:50:43.841051 9848 ts_tablet_manager.cc:1428] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260928 14:50:43.845671 9848 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:43.847636 9848 tablet_bootstrap.cc:654] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.850050 9855 tablet_bootstrap.cc:492] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.850235 9855 ts_tablet_manager.cc:1397] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.001s
I20260928 14:50:43.850879 9855 raft_consensus.cc:348] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.851080 9855 raft_consensus.cc:374] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.851143 9855 raft_consensus.cc:729] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.851411 9855 consensus_queue.cc:260] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.852632 9855 ts_tablet_manager.cc:1428] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:43.852875 9855 tablet_bootstrap.cc:492] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.854331 9855 tablet_bootstrap.cc:654] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.855018 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:43.857193 9813 ts_tablet_manager.cc:1918] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.857303 9813 log.cc:1196] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/c6b4b4c775fe4eacaaa557d4daa2a600
I20260928 14:50:43.858538 9814 log.cc:1196] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2c88ccde6f7540d4aa7cf9b29aa3718d
I20260928 14:50:43.859428 9814 ts_tablet_manager.cc:1939] T 2c88ccde6f7540d4aa7cf9b29aa3718d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:43.839726 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.850867 11223 raft_consensus.cc:482] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.801568 9851 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.874346 9851 ts_tablet_manager.cc:1397] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.000s
I20260928 14:50:43.874291 11223 raft_consensus.cc:504] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.874944 11223 leader_election.cc:288] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.875308 9851 raft_consensus.cc:348] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.875496 9851 raft_consensus.cc:374] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.875550 9851 raft_consensus.cc:729] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.875737 9851 consensus_queue.cc:260] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.875838 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:43.876011 9569 raft_consensus.cc:2454] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:43.876240 9851 ts_tablet_manager.cc:1428] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:43.876482 9851 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.876703 9219 leader_election.cc:302] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:43.877095 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.877655 9220 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.877897 9851 tablet_bootstrap.cc:654] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.878211 10975 raft_consensus.cc:2781] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:43.878298 10975 raft_consensus.cc:482] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:43.878362 10975 raft_consensus.cc:3037] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:43.881094 10975 raft_consensus.cc:504] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.888864 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:43.889070 9569 raft_consensus.cc:3037] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:43.891839 9569 raft_consensus.cc:2454] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:43.892884 9219 leader_election.cc:302] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:43.893293 11223 raft_consensus.cc:2781] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:43.893420 11223 raft_consensus.cc:686] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:43.893702 11223 consensus_queue.cc:237] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.895771 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba0d51f1c2664e0b8c6acb7847eff7cc" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:43.896378 9220 leader_election.cc:341] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.896574 10975 leader_election.cc:288] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.898342 9813 ts_tablet_manager.cc:1939] T c6b4b4c775fe4eacaaa557d4daa2a600 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:43.899721 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet c6b4b4c775fe4eacaaa557d4daa2a600 (table default.Table_1ee21c77ab98461184377947a7f2e3de [id=1d03e7a395e14ff89199ff28281feb04]) successfully deleted
I20260928 14:50:43.900012 9813 tablet_replica.cc:330] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:43.900197 9813 raft_consensus.cc:2229] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.900328 9813 raft_consensus.cc:2258] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.900586 9848 tablet_bootstrap.cc:492] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
W20260928 14:50:43.900669 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58316263538c4bd9bc21ff704421160a consensus state has no leader
I20260928 14:50:43.900694 9848 ts_tablet_manager.cc:1397] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260928 14:50:43.900907 9813 ts_tablet_manager.cc:1905] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.901932 9848 raft_consensus.cc:348] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.902186 9848 raft_consensus.cc:374] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.902259 9848 raft_consensus.cc:729] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.902455 9848 consensus_queue.cc:260] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.902989 9848 ts_tablet_manager.cc:1428] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:43.903432 9848 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:43.903568 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:43.903775 9851 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.903959 9851 ts_tablet_manager.cc:1397] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.005s
W20260928 14:50:43.904239 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9903241fd3b463094fff7bf9c76ed9b consensus state has no leader
I20260928 14:50:43.904476 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a08d91a06ca4effbc8fc4e83d88fe93 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:43.905261 9851 raft_consensus.cc:348] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.905582 9851 raft_consensus.cc:374] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.905711 9851 raft_consensus.cc:729] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.906015 9851 consensus_queue.cc:260] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.907074 9848 tablet_bootstrap.cc:654] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.907310 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 60ede1d7f93047b08e043aa32213cd05 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:43.907202 9851 ts_tablet_manager.cc:1428] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:43.907814 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet eff9afcc868244aeb830fae2735da28d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e20e581a30e46889dd4c4d358d09c88) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.908509 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 82b9dad76ac94a03811e4793e0234aad
I20260928 14:50:43.908808 9851 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.911099 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b9dad76ac94a03811e4793e0234aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.911319 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:43.913975 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7879be7bb70430daf898fc79f5ce19c consensus state has no leader
I20260928 14:50:43.915058 11303 raft_consensus.cc:482] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.915196 11303 raft_consensus.cc:504] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.915736 11303 leader_election.cc:288] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.916391 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b75816a9816497ca6bc6ba8e5c5eb3d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.916851 9498 leader_election.cc:341] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.917423 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b75816a9816497ca6bc6ba8e5c5eb3d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.917963 9497 leader_election.cc:341] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.918077 9497 leader_election.cc:302] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.918479 11303 raft_consensus.cc:2726] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.922089 9851 tablet_bootstrap.cc:654] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.925338 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1083) took 1099 ms. Trace:
I20260928 14:50:43.927320 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b9dad76ac94a03811e4793e0234aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:43.927524 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.927587 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b9dad76ac94a03811e4793e0234aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.929374 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_267edcd5ab6549d8a3204bcc745fab2e" } modify_external_catalogs: true
I20260928 14:50:43.929548 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_267edcd5ab6549d8a3204bcc745fab2e" } modify_external_catalogs: true
I20260928 14:50:43.930100 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_db313c82c68e436bbccf67e69c6c10cf" } modify_external_catalogs: true
I20260928 14:50:43.930251 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_db313c82c68e436bbccf67e69c6c10cf" } modify_external_catalogs: true
I20260928 14:50:43.932222 11303 raft_consensus.cc:482] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.932334 11303 raft_consensus.cc:504] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.932832 11303 leader_election.cc:288] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.933696 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.934305 9497 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.934719 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.937759 9498 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.937848 9498 leader_election.cc:302] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.938225 11303 raft_consensus.cc:2726] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.938544 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e6a5804ccfed48b2ba911013b6a4b1ab" } new_table_name: "default.Table_b60092af06a64e498cebe5e021e56247" modify_external_catalogs: true
I20260928 14:50:43.939785 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d74997e24e947b09eae991bafdc55ae" } modify_external_catalogs: true
I20260928 14:50:43.939920 9855 tablet_bootstrap.cc:492] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:43.940047 9855 ts_tablet_manager.cc:1397] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.002s
I20260928 14:50:43.940027 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8d74997e24e947b09eae991bafdc55ae" } modify_external_catalogs: true
I20260928 14:50:43.942521 9855 raft_consensus.cc:348] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.942759 9855 raft_consensus.cc:374] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.942817 9855 raft_consensus.cc:729] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.942988 9855 consensus_queue.cc:260] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.943543 9855 ts_tablet_manager.cc:1428] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260928 14:50:43.943819 9855 tablet_bootstrap.cc:492] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:43.926309 9814 rpcz_store.cc:276] 0928 14:50:42.825875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.825991 (+ 116us) service_pool.cc:227] Handling call
0928 14:50:43.681502 (+855511us) ts_tablet_manager.cc:1145] Deleting tablet 2c88ccde6f7540d4aa7cf9b29aa3718d
0928 14:50:43.681514 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.711525 (+ 30011us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.791204 (+ 79679us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.925316 (+134112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":855341}
I20260928 14:50:43.945076 11303 raft_consensus.cc:482] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.945192 11303 raft_consensus.cc:504] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.945307 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8a08d91a06ca4effbc8fc4e83d88fe93
I20260928 14:50:43.945693 11303 leader_election.cc:288] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.945827 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 8a08d91a06ca4effbc8fc4e83d88fe93 deleted and replaced by tablet 96ddaeb45f01494b9efb8c9ee4cd63b8
I20260928 14:50:43.946573 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ddaeb45f01494b9efb8c9ee4cd63b8) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.947027 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 287a1ca845fe440da98bf68aafa0e49c from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:43.947345 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ddaeb45f01494b9efb8c9ee4cd63b8) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.947688 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bb9c7fc599425484fd3fc0b94f3a8c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.948217 9498 leader_election.cc:341] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:43.952909 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 654698224424484baaee5410c12a1016 has no consensus state
I20260928 14:50:43.953070 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d27a357d905e463ba9507f74e575acb1
I20260928 14:50:43.953907 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet d27a357d905e463ba9507f74e575acb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:43.954676 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet d27a357d905e463ba9507f74e575acb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:43.955001 9815 ts_tablet_manager.cc:1918] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.955101 9815 log.cc:1196] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4a14c0b50cad4954b5dc5666689810ba
I20260928 14:50:43.956832 11303 raft_consensus.cc:482] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.956938 11303 raft_consensus.cc:504] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.960494 11303 leader_election.cc:288] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.961632 11303 raft_consensus.cc:482] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.961740 11303 raft_consensus.cc:504] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.962250 11303 leader_election.cc:288] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:43.962831 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cf2eb5b59649e099da1947c4ccf430" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:43.963150 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c163d657ec4f40598d7f4f3879e6d817" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:43.963341 9498 leader_election.cc:341] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:43.963729 9498 leader_election.cc:341] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.965787 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:43.965831 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6814b40311fa4518b67267cd85fc9ad7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.966362 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:43.966408 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6814b40311fa4518b67267cd85fc9ad7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.967860 9815 ts_tablet_manager.cc:1939] T 4a14c0b50cad4954b5dc5666689810ba P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:43.968247 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d1076de0cb444aebb34e69cd6d644dc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:43.968740 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1076de0cb444aebb34e69cd6d644dc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:43.969806 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1102) took 1048 ms. Trace:
I20260928 14:50:43.969893 9815 rpcz_store.cc:276] 0928 14:50:42.921397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.921846 (+ 449us) service_pool.cc:227] Handling call
0928 14:50:43.835846 (+914000us) ts_tablet_manager.cc:1145] Deleting tablet 4a14c0b50cad4954b5dc5666689810ba
0928 14:50:43.835856 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.926220 (+ 90364us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.954909 (+ 28689us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.969788 (+ 14879us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":913846}
I20260928 14:50:43.970216 9815 tablet_replica.cc:330] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:43.970314 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4a14c0b50cad4954b5dc5666689810ba (table default.Table_c7687d91f40d47c99ca2f22db2dd127d [id=c3261b896b04437fa936a693b88a6e01]) successfully deleted
I20260928 14:50:43.970433 9815 raft_consensus.cc:2229] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:43.970562 9815 raft_consensus.cc:2258] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:43.971032 9815 ts_tablet_manager.cc:1905] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:43.975016 9855 tablet_bootstrap.cc:654] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.975399 9813 ts_tablet_manager.cc:1918] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:43.975507 9813 log.cc:1196] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/01c1e945f1c54281856bfabe08fba42e
I20260928 14:50:43.975863 9813 ts_tablet_manager.cc:1939] T 01c1e945f1c54281856bfabe08fba42e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:43.976133 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1060) took 1059 ms. Trace:
I20260928 14:50:43.976217 9813 rpcz_store.cc:276] 0928 14:50:42.916716 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.917736 (+ 1020us) service_pool.cc:227] Handling call
0928 14:50:43.899969 (+982233us) ts_tablet_manager.cc:1145] Deleting tablet 01c1e945f1c54281856bfabe08fba42e
0928 14:50:43.899980 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.955958 (+ 55978us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.975319 (+ 19361us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:43.976118 (+ 799us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":979716}
I20260928 14:50:43.976622 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 01c1e945f1c54281856bfabe08fba42e (table default.Table_cce29ecaa696477da8fdfa101b74b05a [id=5f086756701c4ad7b24c6db513489b13]) successfully deleted
I20260928 14:50:43.946336 9851 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.978127 9851 ts_tablet_manager.cc:1397] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.002s
I20260928 14:50:43.978536 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2c88ccde6f7540d4aa7cf9b29aa3718d (table default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]) successfully deleted
I20260928 14:50:43.978842 9851 raft_consensus.cc:348] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.946617 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a08d91a06ca4effbc8fc4e83d88fe93 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ddaeb45f01494b9efb8c9ee4cd63b8) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.947482 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bb9c7fc599425484fd3fc0b94f3a8c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.954330 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet d27a357d905e463ba9507f74e575acb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:43.961726 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c163d657ec4f40598d7f4f3879e6d817" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.963104 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cf2eb5b59649e099da1947c4ccf430" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:43.979686 9497 leader_election.cc:341] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.979787 9497 leader_election.cc:302] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:43.980091 9497 leader_election.cc:341] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.980180 9497 leader_election.cc:302] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.980429 11227 raft_consensus.cc:2726] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.980553 11227 raft_consensus.cc:2726] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:43.980834 9497 leader_election.cc:341] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:43.980914 9497 leader_election.cc:302] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:43.981072 11111 raft_consensus.cc:482] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:43.981184 11111 raft_consensus.cc:504] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:43.981699 11111 leader_election.cc:288] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:43.982283 11227 raft_consensus.cc:2726] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.982932 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:43.979033 9851 raft_consensus.cc:374] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:43.987385 9851 raft_consensus.cc:729] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:43.982218 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0868e5ce22874134a2f50e2404970bb8" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:43.987558 9851 consensus_queue.cc:260] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:43.987780 9360 leader_election.cc:302] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:43.988082 11111 raft_consensus.cc:2726] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:43.988179 9851 ts_tablet_manager.cc:1428] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260928 14:50:43.979002 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1087) took 1072 ms. Trace:
I20260928 14:50:43.988407 9851 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:43.989944 9851 tablet_bootstrap.cc:654] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:43.997642 9814 rpcz_store.cc:276] 0928 14:50:42.906784 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.906831 (+ 47us) service_pool.cc:227] Handling call
0928 14:50:43.978884 (+1072053us) ts_tablet_manager.cc:1145] Deleting tablet e0293fd4baf946579b82c73a35b06fcc
0928 14:50:43.978894 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.978986 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1071886}
I20260928 14:50:43.998544 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1088) took 1090 ms. Trace:
I20260928 14:50:43.998716 9814 rpcz_store.cc:276] 0928 14:50:42.907742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.907917 (+ 175us) service_pool.cc:227] Handling call
0928 14:50:43.998357 (+1090440us) ts_tablet_manager.cc:1145] Deleting tablet bd317286c9f54f0d917123d924f02058
0928 14:50:43.998367 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.998504 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090250}
I20260928 14:50:43.999469 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1089) took 1091 ms. Trace:
I20260928 14:50:43.999563 9851 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:43.999955 9851 ts_tablet_manager.cc:1397] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20260928 14:50:44.001262 9851 raft_consensus.cc:348] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.001659 9851 raft_consensus.cc:374] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.001796 9851 raft_consensus.cc:729] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.002170 9851 consensus_queue.cc:260] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.003193 9851 ts_tablet_manager.cc:1428] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:44.004040 9851 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.008193 9851 tablet_bootstrap.cc:654] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.012385 10975 raft_consensus.cc:482] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.012526 10975 raft_consensus.cc:504] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.013569 10975 leader_election.cc:288] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:44.014638 9219 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: edf76b53ded84392a39c73d7e653615d
W20260928 14:50:43.998170 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e0293fd4baf946579b82c73a35b06fcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0293fd4baf946579b82c73a35b06fcc already in progress: creating tablet
W20260928 14:50:44.017251 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet bd317286c9f54f0d917123d924f02058 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd317286c9f54f0d917123d924f02058 already in progress: creating tablet
I20260928 14:50:44.018070 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d57b7d81e0b6433189e5a27563cb7f4a" } new_table_name: "default.Table_6e56dd224c8c45e8976585ca770ac220" modify_external_catalogs: true
I20260928 14:50:44.020120 9855 tablet_bootstrap.cc:492] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:44.020308 9855 ts_tablet_manager.cc:1397] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.002s
I20260928 14:50:44.021087 9855 raft_consensus.cc:348] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.021670 9855 raft_consensus.cc:374] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.021771 9855 raft_consensus.cc:729] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.022002 9855 consensus_queue.cc:260] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.022048 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf76b53ded84392a39c73d7e653615d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.022826 9220 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.022930 9220 leader_election.cc:302] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.023531 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0d6530474e1842bd86cb8eb17ac76cbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.024161 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d6530474e1842bd86cb8eb17ac76cbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.025774 10975 raft_consensus.cc:2726] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.025985 9813 tablet_replica.cc:330] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.026237 9813 raft_consensus.cc:2229] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.026239 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4bc8db2b069e4b2f892d9399ee7f5adf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.026443 9813 raft_consensus.cc:2258] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:44.026831 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bc8db2b069e4b2f892d9399ee7f5adf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.026965 9813 ts_tablet_manager.cc:1905] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.030584 9284 raft_consensus.cc:1261] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Refusing update from remote peer 658e483a10314e8d93c2f6e9084f2a91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:44.032481 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_218278313d9c47819a4a1fd12e46bb8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.032958 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_218278313d9c47819a4a1fd12e46bb8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:44.034137 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a538edaf07a4fa2833fc32645803e73 consensus state has no leader
I20260928 14:50:44.041683 9848 tablet_bootstrap.cc:492] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.041814 9848 ts_tablet_manager.cc:1397] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.138s user 0.036s sys 0.024s
I20260928 14:50:44.042510 9848 raft_consensus.cc:348] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.042738 9848 raft_consensus.cc:374] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.042794 9848 raft_consensus.cc:729] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.042973 9848 consensus_queue.cc:260] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.043488 9848 ts_tablet_manager.cc:1428] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:44.044493 9848 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.046237 9848 tablet_bootstrap.cc:654] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.046968 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:44.055804 9848 tablet_bootstrap.cc:492] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.055922 9848 ts_tablet_manager.cc:1397] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.006s
I20260928 14:50:44.056556 9848 raft_consensus.cc:348] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.056756 9848 raft_consensus.cc:374] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.056811 9848 raft_consensus.cc:729] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.056977 9848 consensus_queue.cc:260] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.057469 9848 ts_tablet_manager.cc:1428] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:44.057952 9848 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.058382 10975 raft_consensus.cc:482] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.058507 10975 raft_consensus.cc:504] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.059072 10975 leader_election.cc:288] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:44.059489 9848 tablet_bootstrap.cc:654] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:44.060089 9219 leader_election.cc:341] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 42b9f78ecb674ae691d407615680ca56
I20260928 14:50:44.060854 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b9f78ecb674ae691d407615680ca56" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.061347 9220 leader_election.cc:341] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.061439 9220 leader_election.cc:302] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.061775 10975 raft_consensus.cc:2726] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.069873 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 76ad7685ece44665896f687697bddccf from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:44.070981 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:44.079402 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:44.080710 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 56151b288b634d6bb0bc7113afa5fbaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.084681 9813 ts_tablet_manager.cc:1918] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.084789 9813 log.cc:1196] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/0489aea8bb0a45daaaec6a48db756c51
I20260928 14:50:44.085059 9813 ts_tablet_manager.cc:1939] T 0489aea8bb0a45daaaec6a48db756c51 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.085760 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1061) took 1168 ms. Trace:
I20260928 14:50:44.085846 9813 rpcz_store.cc:276] 0928 14:50:42.916791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.917835 (+ 1044us) service_pool.cc:227] Handling call
0928 14:50:43.976505 (+1058670us) ts_tablet_manager.cc:1145] Deleting tablet 0489aea8bb0a45daaaec6a48db756c51
0928 14:50:43.976515 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.074708 (+ 98193us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.084590 (+ 9882us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.085742 (+ 1152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1056218}
I20260928 14:50:44.086120 9813 tablet_replica.cc:330] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.086311 9813 raft_consensus.cc:2229] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.086287 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 0489aea8bb0a45daaaec6a48db756c51 (table default.Table_5fc2ded1f8094f3090ab1aaf1e46af72 [id=2efd37817b7e4ded80e39c6d7295a07c]) successfully deleted
I20260928 14:50:44.086449 9813 raft_consensus.cc:2258] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.086892 9813 ts_tablet_manager.cc:1905] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.088389 9848 tablet_bootstrap.cc:492] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.088996 9848 ts_tablet_manager.cc:1397] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.020s
I20260928 14:50:44.092918 9848 raft_consensus.cc:348] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.094149 9848 raft_consensus.cc:374] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.094537 9848 raft_consensus.cc:729] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.095534 9848 consensus_queue.cc:260] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.098881 9848 ts_tablet_manager.cc:1428] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:44.100268 9848 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.100658 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 080159d2e65a4550861f4c63fb22d02e
I20260928 14:50:44.101069 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 080159d2e65a4550861f4c63fb22d02e deleted and replaced by tablet fb2e6fd4284946e6bec6688ac522be18
I20260928 14:50:44.101735 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 080159d2e65a4550861f4c63fb22d02e with delete_type TABLET_DATA_DELETED (replaced by tablet fb2e6fd4284946e6bec6688ac522be18) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.106247 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 287a1ca845fe440da98bf68aafa0e49c
I20260928 14:50:44.106604 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 287a1ca845fe440da98bf68aafa0e49c deleted and replaced by tablet cb9e66f2b273470e88e97ece175d6065
I20260928 14:50:44.107244 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 287a1ca845fe440da98bf68aafa0e49c with delete_type TABLET_DATA_DELETED (replaced by tablet cb9e66f2b273470e88e97ece175d6065) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.108098 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0f81e272545349678c7824ba5520ec8e
I20260928 14:50:44.108871 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.109042 9848 tablet_bootstrap.cc:654] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.109196 9170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0f81e272545349678c7824ba5520ec8e
I20260928 14:50:44.112289 11228 raft_consensus.cc:482] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.112416 11228 raft_consensus.cc:504] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.112965 11228 leader_election.cc:288] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.113190 9389 tablet_service.cc:1467] Processing CreateTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 (DEFAULT_TABLE table=default.Table_b7e412c4541447338570286096857459 [id=bb79c9450c2048b5bf6b6e041eef35ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.113566 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9655e6b8d164d7e8d7143b629b945a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.113965 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f (DEFAULT_TABLE table=default.Table_a1338e4028414b40a26489ec124db927 [id=d095fadab7bd46afae02c6805fd17d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.114267 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.114392 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb3cc5b42524a4399d0bcf21c851fd8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.114854 9220 leader_election.cc:341] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.117763 9408 tablet_service.cc:1467] Processing CreateTablet for tablet cee27a063a484e89bbe2179b4e966cba (DEFAULT_TABLE table=default.Table_9768e25a844d43468d95f5abd6fe5cce [id=f92b8ee85dec4123b93917a5fce30d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.117818 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7341dac419f2443594ea9ef9c65f2daa
I20260928 14:50:44.118058 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee27a063a484e89bbe2179b4e966cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.121749 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 989df9ccfce446008435161626ce4f5e (DEFAULT_TABLE table=default.Table_46225f43edd2436bbf9ed9816eec9298 [id=77f81aaf465b4472910bb69ad7956fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.122372 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7341dac419f2443594ea9ef9c65f2daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.123967 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 (DEFAULT_TABLE table=default.Table_56ac8188c64e44709eff9cb4c866c346 [id=a9e1b12a38ef488ca6ab6de072c41539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.124250 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.126364 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 080159d2e65a4550861f4c63fb22d02e with delete_type TABLET_DATA_DELETED (replaced by tablet fb2e6fd4284946e6bec6688ac522be18) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.126586 11228 raft_consensus.cc:482] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.126693 11228 raft_consensus.cc:504] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.126893 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ba0d51f1c2664e0b8c6acb7847eff7cc
I20260928 14:50:44.127230 11228 leader_election.cc:288] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:44.127521 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:44.128317 9219 leader_election.cc:341] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:44.129870 9406 tablet_service.cc:1467] Processing CreateTablet for tablet f0fd851daa884ee9b65925df904c1936 (DEFAULT_TABLE table=default.Table_73e6450166d64b5f8858464b12b02440 [id=3ef65d28da8e46009469783ccfb76da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.130082 9400 tablet_service.cc:1467] Processing CreateTablet for tablet aebb279ecc924ab1a9d84f88c0382acb (DEFAULT_TABLE table=default.Table_eaa64bfb59d24da6a26c2aa26935864b [id=d034dabd5e464366804536e8c2c2cb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.130362 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 287a1ca845fe440da98bf68aafa0e49c with delete_type TABLET_DATA_DELETED (replaced by tablet cb9e66f2b273470e88e97ece175d6065) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.131346 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.132470 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.132689 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83705b3cf3e746f4b0aca9c2c8bd2f2f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.133172 9220 leader_election.cc:341] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.133270 9220 leader_election.cc:302] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.133332 9398 tablet_service.cc:1467] Processing CreateTablet for tablet cdea7026d52f495696ca7fba6ba7e64d (DEFAULT_TABLE table=default.Table_ddfff45616b34ccbae6690c77ff66c2f [id=3aeff2f70f324434bbb7512c6781a857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.133638 11228 raft_consensus.cc:2726] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.134660 9253 tablet_service.cc:1467] Processing CreateTablet for tablet cee27a063a484e89bbe2179b4e966cba (DEFAULT_TABLE table=default.Table_9768e25a844d43468d95f5abd6fe5cce [id=f92b8ee85dec4123b93917a5fce30d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.135027 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee27a063a484e89bbe2179b4e966cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.138340 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 989df9ccfce446008435161626ce4f5e (DEFAULT_TABLE table=default.Table_46225f43edd2436bbf9ed9816eec9298 [id=77f81aaf465b4472910bb69ad7956fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.138667 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989df9ccfce446008435161626ce4f5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.139055 9219 leader_election.cc:341] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9cb3cc5b42524a4399d0bcf21c851fd8
I20260928 14:50:44.139150 9219 leader_election.cc:302] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.139530 11228 raft_consensus.cc:2726] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.142289 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 3841f8643cf746ae965bf54f24573c87 (DEFAULT_TABLE table=default.Table_eef0b655cea940fe9168838d4c3bcaf4 [id=a373eff87fa045d18851dc21cdfd23d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.144620 11228 raft_consensus.cc:482] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.144739 11228 raft_consensus.cc:504] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.145273 11228 leader_election.cc:288] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
W20260928 14:50:44.146086 9219 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e5ac853c5b6f4f9cb9de91e6aa448c75
I20260928 14:50:44.146636 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac853c5b6f4f9cb9de91e6aa448c75" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.146636 9401 tablet_service.cc:1467] Processing CreateTablet for tablet e32c9d9756e04d79b1c2350b4cc1ea57 (DEFAULT_TABLE table=default.Table_a91574affcef4ab393d67b3607364005 [id=965a5831672d40839f7fa0e89af60d45]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:44.147100 9220 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.147209 9220 leader_election.cc:302] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.147552 11228 raft_consensus.cc:2726] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.148480 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81e272545349678c7824ba5520ec8e (DEFAULT_TABLE table=default.Table_3df105fd8cd24039977b94b28b424121 [id=1d90cc07f34e4253ad62b7a7accb095b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.150704 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd4192e103245f681062f473a15d167 (DEFAULT_TABLE table=default.Table_f6a090218ff7459585093b6e8757a300 [id=f3b751c25a96414d9aeca04940d39387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.152820 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989df9ccfce446008435161626ce4f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.153236 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07eecd79a28446f49ecc3c931ffb8b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.153421 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fd851daa884ee9b65925df904c1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.154019 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aebb279ecc924ab1a9d84f88c0382acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.157708 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdea7026d52f495696ca7fba6ba7e64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.161357 9400 tablet_service.cc:1467] Processing CreateTablet for tablet f8b1156c1b4b437c98c07070452ee260 (DEFAULT_TABLE table=default.Table_92dcab49752f419c829f062d4491450f [id=f28332d74766471d82244c48d99783c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.161729 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b1156c1b4b437c98c07070452ee260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.165290 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 507c1420c1704ce5a93f4d7846a94a8d (DEFAULT_TABLE table=default.Table_59c1bfec007c491f9db9f98c7ba8c58b [id=2e18a281c5db468593ddbbe7e9f38845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.165668 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507c1420c1704ce5a93f4d7846a94a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.165732 11228 raft_consensus.cc:482] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.165854 11228 raft_consensus.cc:504] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.166414 11228 leader_election.cc:288] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.167145 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaacc1f839914859b23ae755042e02d8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.167635 9220 leader_election.cc:341] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.168138 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3841f8643cf746ae965bf54f24573c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.168330 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32c9d9756e04d79b1c2350b4cc1ea57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.168509 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81e272545349678c7824ba5520ec8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.168612 9219 leader_election.cc:341] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: aaacc1f839914859b23ae755042e02d8
I20260928 14:50:44.168702 9219 leader_election.cc:302] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.169071 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd4192e103245f681062f473a15d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.169577 11228 raft_consensus.cc:2726] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.170773 9813 ts_tablet_manager.cc:1918] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.170881 9813 log.cc:1196] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d30d06c910fa4142a6248e8bfd00f4b2
I20260928 14:50:44.171578 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 7341dac419f2443594ea9ef9c65f2daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.171975 9253 tablet_service.cc:1467] Processing CreateTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 (DEFAULT_TABLE table=default.Table_b7e412c4541447338570286096857459 [id=bb79c9450c2048b5bf6b6e041eef35ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.172400 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9655e6b8d164d7e8d7143b629b945a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.176062 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f (DEFAULT_TABLE table=default.Table_a1338e4028414b40a26489ec124db927 [id=d095fadab7bd46afae02c6805fd17d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.176565 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.181936 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 49d3f127d068409789646dc574e92c05 (DEFAULT_TABLE table=default.Table_fa618acba76146c38ef92d78d5d33ac7 [id=2d9cc0de8d1a4f62b9c9e1a4243cd4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.182396 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d3f127d068409789646dc574e92c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.182943 9405 tablet_service.cc:1467] Processing CreateTablet for tablet b17faf5198e048b2824aea3308070fa8 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.183802 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 (DEFAULT_TABLE table=default.Table_56ac8188c64e44709eff9cb4c866c346 [id=a9e1b12a38ef488ca6ab6de072c41539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.183035 9393 tablet_service.cc:1467] Processing CreateTablet for tablet b9c8417487b3473dab516b5359e15bb9 (DEFAULT_TABLE table=default.Table_b1e0f6176c744afc8e6250bfbdc9ba66 [id=aac575ca8489439485eefba2029cdfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.183283 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7541995a414dbb84ff9d3f2fe11c01 (DEFAULT_TABLE table=default.Table_951b956bd54e4638ab60ffd1774fda07 [id=4a1a982559b04201b54be385cf587f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.184104 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07eecd79a28446f49ecc3c931ffb8b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.183722 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 5130bf03e54d4c308b937e1879fc5f55 (DEFAULT_TABLE table=default.Table_6f501e4753ad4e16be7238bc969b0a7d [id=c300e841015c4daf850b842df98a366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.182750 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 654698224424484baaee5410c12a1016 (DEFAULT_TABLE table=default.Table_b60092af06a64e498cebe5e021e56247 [id=903086c862a949b08d3dbb1f0d1af340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.184979 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7541995a414dbb84ff9d3f2fe11c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.185367 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5130bf03e54d4c308b937e1879fc5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.185945 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2d5ce241c71f456e8f610e60eedd4b2b" } new_table_name: "default.Table_71c71919497b404eaeea5f2761d3e19c" modify_external_catalogs: true
I20260928 14:50:44.189805 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17faf5198e048b2824aea3308070fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.193653 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c8417487b3473dab516b5359e15bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.194175 9249 tablet_service.cc:1467] Processing CreateTablet for tablet f0fd851daa884ee9b65925df904c1936 (DEFAULT_TABLE table=default.Table_73e6450166d64b5f8858464b12b02440 [id=3ef65d28da8e46009469783ccfb76da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.194468 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fd851daa884ee9b65925df904c1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.196053 9813 ts_tablet_manager.cc:1939] T d30d06c910fa4142a6248e8bfd00f4b2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.197016 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1062) took 1280 ms. Trace:
I20260928 14:50:44.197140 9813 rpcz_store.cc:276] 0928 14:50:42.916855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.917926 (+ 1071us) service_pool.cc:227] Handling call
0928 14:50:44.086079 (+1168153us) ts_tablet_manager.cc:1145] Deleting tablet d30d06c910fa4142a6248e8bfd00f4b2
0928 14:50:44.086088 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.143016 (+ 56928us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.170695 (+ 27679us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.196977 (+ 26282us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165762}
W20260928 14:50:44.197753 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f243e9fcce4d4b2396b96939250a8968 consensus state has no leader
I20260928 14:50:44.197757 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d30d06c910fa4142a6248e8bfd00f4b2 (table default.Table_4e86b9df2c224f9083cc99ffe56ecbb4 [id=720e4385ef6d42cbbaa26b3fc3cb5521]) successfully deleted
I20260928 14:50:44.198279 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1053) took 1282 ms. Trace:
I20260928 14:50:44.198664 9813 rpcz_store.cc:276] 0928 14:50:42.916153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.928365 (+ 12212us) service_pool.cc:227] Handling call
0928 14:50:44.198085 (+1269720us) ts_tablet_manager.cc:1145] Deleting tablet e0293fd4baf946579b82c73a35b06fcc
0928 14:50:44.198095 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.198262 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1269554}
W20260928 14:50:44.199182 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e0293fd4baf946579b82c73a35b06fcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0293fd4baf946579b82c73a35b06fcc already in progress: creating tablet
I20260928 14:50:44.199350 9402 tablet_service.cc:1467] Processing CreateTablet for tablet ba43a88f7aa94597ab76a47869e463cd (DEFAULT_TABLE table=default.Table_51ff7a6d884645c1974704ec54c878c2 [id=9d13da16d5344a3db45eb37e49632bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.199731 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba43a88f7aa94597ab76a47869e463cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.201959 9813 tablet_replica.cc:330] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.202515 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654698224424484baaee5410c12a1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.203541 9813 raft_consensus.cc:2229] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.203974 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9dbe9cd8ab4040e3aa7e1d3e5c4a19ac" } new_table_name: "default.Table_7698541777cb402d94dd301c893d7d0a" modify_external_catalogs: true
I20260928 14:50:44.204463 9813 raft_consensus.cc:2258] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.206393 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a7c87abccc9e4738a131a19f0fd15b13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.207070 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7c87abccc9e4738a131a19f0fd15b13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.207631 9813 ts_tablet_manager.cc:1905] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:44.209965 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fccef376c9f40f7b7f6cafbb83f8f0b consensus state has no leader
I20260928 14:50:44.209830 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_04368bfd9f374ed4b7935788ee68abe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.210338 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04368bfd9f374ed4b7935788ee68abe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.212625 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 34a037a1976e4b5395ab5b5a95e343f0 (DEFAULT_TABLE table=default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.212960 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a037a1976e4b5395ab5b5a95e343f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.216204 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:44.216612 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 2 got 0
I20260928 14:50:44.219816 11228 raft_consensus.cc:482] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.219956 11228 raft_consensus.cc:504] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.220950 11228 leader_election.cc:288] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.221782 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fc92b51b52204e60b316163867152d8d" } new_table_name: "default.Table_842e5c186d154cb085e953072a42ac90" modify_external_catalogs: true
I20260928 14:50:44.223958 11344 raft_consensus.cc:482] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.224155 11344 raft_consensus.cc:504] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:44.226601 9219 leader_election.cc:341] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 148e81f8add349f2b233862a7049e54c
I20260928 14:50:44.227253 11344 leader_election.cc:288] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.229888 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_496a2bee552243288885986e6448b485"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.230022 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.230597 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_496a2bee552243288885986e6448b485 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.230788 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "148e81f8add349f2b233862a7049e54c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.231227 9220 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:44.231387 9220 leader_election.cc:341] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.231469 9220 leader_election.cc:302] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.231670 11228 raft_consensus.cc:2726] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.232012 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9fa35f27069447e9a08b9747aacb5038" } modify_external_catalogs: true
I20260928 14:50:44.232391 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9fa35f27069447e9a08b9747aacb5038" } modify_external_catalogs: true
I20260928 14:50:44.234424 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f24a84b5dc26497789fa19d09f9c30fd" } new_table_name: "default.Table_786543992e7b4bcd830f953e0323a919" modify_external_catalogs: true
I20260928 14:50:44.234658 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d7270bcdf2fd41f59e502b5bbe93cd19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.235241 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7270bcdf2fd41f59e502b5bbe93cd19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.237465 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1ba61d5485a7452e96ee458e70e06b38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.237950 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ba61d5485a7452e96ee458e70e06b38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.239261 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7e412c4541447338570286096857459" } modify_external_catalogs: true
I20260928 14:50:44.239430 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7e412c4541447338570286096857459" } modify_external_catalogs: true
I20260928 14:50:44.241135 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_84295f6ff46b4fee9a2d41e0b2720900"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.241761 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84295f6ff46b4fee9a2d41e0b2720900 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.241901 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.241602 9813 ts_tablet_manager.cc:1918] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.242483 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.242722 9813 log.cc:1196] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/75f9359df0ac466c912cd20fc6b94390
I20260928 14:50:44.243851 9262 tablet_service.cc:1467] Processing CreateTablet for tablet aebb279ecc924ab1a9d84f88c0382acb (DEFAULT_TABLE table=default.Table_eaa64bfb59d24da6a26c2aa26935864b [id=d034dabd5e464366804536e8c2c2cb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.244223 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aebb279ecc924ab1a9d84f88c0382acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.245121 9813 ts_tablet_manager.cc:1939] T 75f9359df0ac466c912cd20fc6b94390 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.246485 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1067) took 1284 ms. Trace:
I20260928 14:50:44.247872 9814 rpcz_store.cc:276] 0928 14:50:42.907866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.907925 (+ 59us) service_pool.cc:227] Handling call
0928 14:50:43.999267 (+1091342us) ts_tablet_manager.cc:1145] Deleting tablet fc0a83bcaa0647c9bfe9b4635d391b0e
0928 14:50:43.999278 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:43.999407 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1091095}
I20260928 14:50:44.247056 9813 rpcz_store.cc:276] 0928 14:50:42.962039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.962169 (+ 130us) service_pool.cc:227] Handling call
0928 14:50:44.201772 (+1239603us) ts_tablet_manager.cc:1145] Deleting tablet 75f9359df0ac466c912cd20fc6b94390
0928 14:50:44.201930 (+ 158us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.224854 (+ 22924us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.241065 (+ 16211us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.246468 (+ 5403us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228479}
I20260928 14:50:44.248306 9814 tablet_replica.cc:330] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.248538 9814 raft_consensus.cc:2229] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:44.248562 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 75f9359df0ac466c912cd20fc6b94390 (table default.Table_354f08bdef784c8ab09d3cabf60e928b [id=eeda270762d14600be7e85cb38546bce]) successfully deleted
I20260928 14:50:44.248914 9814 pending_rounds.cc:62] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Trying to abort 1 pending ops.
I20260928 14:50:44.248970 9814 pending_rounds.cc:68] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326445258125312 op_type: NO_OP noop_request { }
I20260928 14:50:44.249082 9814 raft_consensus.cc:2866] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:44.249171 9814 raft_consensus.cc:2258] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.249845 9814 ts_tablet_manager.cc:1905] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.249748 9813 tablet_replica.cc:330] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.250892 9813 raft_consensus.cc:2229] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.251696 9813 raft_consensus.cc:2258] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.253324 11341 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:44.255061 9813 ts_tablet_manager.cc:1905] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.255859 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4c9961ae311d47e0bb1b02bd1afe6609"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.256405 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9961ae311d47e0bb1b02bd1afe6609 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.266898 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8a378e8c5f20412facc0e20d8eb04869" } new_table_name: "default.Table_659002d3409c4d7498f6fed3d1657dfa" modify_external_catalogs: true
I20260928 14:50:44.268414 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1f42b0c58c5745b088e519844f09e67b
W20260928 14:50:44.268846 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fbe74a73dda4330af8814bbba0cfc70 consensus state has no leader
W20260928 14:50:44.269057 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6f09bae9c9a40c9a94823a92706a65d consensus state has no leader
I20260928 14:50:44.270193 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f42b0c58c5745b088e519844f09e67b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.272534 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d9655e6b8d164d7e8d7143b629b945a7
I20260928 14:50:44.273355 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.031203 11227 consensus_queue.cc:1035] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:44.067654 9815 ts_tablet_manager.cc:1918] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.274646 9815 log.cc:1196] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8af72ac7bedb4cd7aed28cffda867c96
I20260928 14:50:44.274976 9815 ts_tablet_manager.cc:1939] T 8af72ac7bedb4cd7aed28cffda867c96 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.275259 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1104) took 1353 ms. Trace:
I20260928 14:50:44.275338 9815 rpcz_store.cc:276] 0928 14:50:42.921669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.921960 (+ 291us) service_pool.cc:227] Handling call
0928 14:50:43.970179 (+1048219us) ts_tablet_manager.cc:1145] Deleting tablet 8af72ac7bedb4cd7aed28cffda867c96
0928 14:50:43.970188 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.011666 (+ 41478us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.067540 (+ 55874us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.275242 (+207702us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1048082}
W20260928 14:50:44.275504 9498 consensus_peers.cc:487] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91 -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:44.275641 9815 tablet_replica.cc:330] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:44.275621 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 243623us
I20260928 14:50:44.129541 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 080159d2e65a4550861f4c63fb22d02e with delete_type TABLET_DATA_DELETED (replaced by tablet fb2e6fd4284946e6bec6688ac522be18) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.130831 9546 tablet_service.cc:1514] Processing DeleteTablet for tablet 287a1ca845fe440da98bf68aafa0e49c with delete_type TABLET_DATA_DELETED (replaced by tablet cb9e66f2b273470e88e97ece175d6065) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.131817 9529 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.134096 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f81e272545349678c7824ba5520ec8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.138108 9534 tablet_service.cc:1467] Processing CreateTablet for tablet cee27a063a484e89bbe2179b4e966cba (DEFAULT_TABLE table=default.Table_9768e25a844d43468d95f5abd6fe5cce [id=f92b8ee85dec4123b93917a5fce30d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.170318 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 989df9ccfce446008435161626ce4f5e (DEFAULT_TABLE table=default.Table_46225f43edd2436bbf9ed9816eec9298 [id=77f81aaf465b4472910bb69ad7956fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.170871 9536 tablet_service.cc:1467] Processing CreateTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 (DEFAULT_TABLE table=default.Table_b7e412c4541447338570286096857459 [id=bb79c9450c2048b5bf6b6e041eef35ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.276849 11227 raft_consensus.cc:482] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.171131 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 7341dac419f2443594ea9ef9c65f2daa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.276970 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cee27a063a484e89bbe2179b4e966cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.175414 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f (DEFAULT_TABLE table=default.Table_a1338e4028414b40a26489ec124db927 [id=d095fadab7bd46afae02c6805fd17d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.277266 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989df9ccfce446008435161626ce4f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.277449 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99aad3f5d0cf4a13baeb67171c4e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.277669 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9655e6b8d164d7e8d7143b629b945a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.183351 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 (DEFAULT_TABLE table=default.Table_56ac8188c64e44709eff9cb4c866c346 [id=a9e1b12a38ef488ca6ab6de072c41539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.221728 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:44.242235 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.243566 9543 tablet_service.cc:1467] Processing CreateTablet for tablet f0fd851daa884ee9b65925df904c1936 (DEFAULT_TABLE table=default.Table_73e6450166d64b5f8858464b12b02440 [id=3ef65d28da8e46009469783ccfb76da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.280670 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07eecd79a28446f49ecc3c931ffb8b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.280882 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fd851daa884ee9b65925df904c1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.244347 9538 tablet_service.cc:1467] Processing CreateTablet for tablet aebb279ecc924ab1a9d84f88c0382acb (DEFAULT_TABLE table=default.Table_eaa64bfb59d24da6a26c2aa26935864b [id=d034dabd5e464366804536e8c2c2cb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.281316 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aebb279ecc924ab1a9d84f88c0382acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.276969 11227 raft_consensus.cc:504] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.290301 11227 leader_election.cc:288] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.290418 11227 raft_consensus.cc:482] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.290508 11227 raft_consensus.cc:504] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.290930 11227 leader_election.cc:288] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.291028 11227 raft_consensus.cc:482] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.291103 11227 raft_consensus.cc:504] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.291505 11227 leader_election.cc:288] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.291600 11227 raft_consensus.cc:482] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.291693 11227 raft_consensus.cc:504] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.292088 11227 leader_election.cc:288] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.295030 9815 raft_consensus.cc:2229] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.295188 9815 raft_consensus.cc:2258] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.295753 9815 ts_tablet_manager.cc:1905] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.302757 11111 raft_consensus.cc:482] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.302886 11111 raft_consensus.cc:504] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.303591 11111 leader_election.cc:288] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:44.303937 9813 ts_tablet_manager.cc:1918] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.304138 9815 ts_tablet_manager.cc:1918] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.304237 9815 log.cc:1196] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8a06859c8dcc41d99d29365aae350afa
I20260928 14:50:44.304316 9813 log.cc:1196] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/e760d7e556a54fda9dc91300b9968c68
I20260928 14:50:44.304517 9815 ts_tablet_manager.cc:1939] T 8a06859c8dcc41d99d29365aae350afa P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:44.304484 9360 leader_election.cc:341] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:44.305207 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1101) took 1383 ms. Trace:
I20260928 14:50:44.305359 9813 ts_tablet_manager.cc:1939] T e760d7e556a54fda9dc91300b9968c68 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.305301 9815 rpcz_store.cc:276] 0928 14:50:42.921314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.922121 (+ 807us) service_pool.cc:227] Handling call
0928 14:50:44.275589 (+1353468us) ts_tablet_manager.cc:1145] Deleting tablet 8a06859c8dcc41d99d29365aae350afa
0928 14:50:44.275600 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.300913 (+ 25313us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.304070 (+ 3157us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.305188 (+ 1118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19189,"tablet-delete.queue_time_us":1353329}
I20260928 14:50:44.305832 9815 tablet_replica.cc:330] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.306008 9815 raft_consensus.cc:2229] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.306176 9815 raft_consensus.cc:2258] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.306461 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1069) took 1334 ms. Trace:
I20260928 14:50:44.306959 9815 ts_tablet_manager.cc:1905] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.306989 9813 rpcz_store.cc:276] 0928 14:50:42.972416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.972464 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:44.249514 (+1277050us) ts_tablet_manager.cc:1145] Deleting tablet e760d7e556a54fda9dc91300b9968c68
0928 14:50:44.249565 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.271558 (+ 21993us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.303667 (+ 32109us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.306443 (+ 2776us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276037}
I20260928 14:50:44.308177 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet e760d7e556a54fda9dc91300b9968c68 (table default.Table_6b9ef5b0cda2426bb8bf6a02c4e950cc [id=dbed9bfa98404b708a11688e563f1f86]) successfully deleted
I20260928 14:50:44.308517 9813 tablet_replica.cc:330] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.309019 9813 raft_consensus.cc:2229] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.309255 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "835ba6c803a34707b77bb8bc280b9e68" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.309646 9813 raft_consensus.cc:2258] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.310993 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5cb151d58f545d9b1e6f652a0627ab9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.311597 9813 ts_tablet_manager.cc:1905] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.313289 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c5877a52264f0e9ebb070792e39e55" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.313721 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:44.314605 9497 leader_election.cc:341] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.280535 9568 raft_consensus.cc:2454] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:44.316412 9219 leader_election.cc:302] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.316851 11223 raft_consensus.cc:2781] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:44.316928 11223 raft_consensus.cc:482] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:44.316985 11223 raft_consensus.cc:3037] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:44.319517 11223 raft_consensus.cc:504] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.320518 11223 leader_election.cc:288] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.321054 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:44.321651 9568 raft_consensus.cc:3037] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:44.322362 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb704c5128a4880ae1b89b4d4d1fcfd" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:44.323396 9220 leader_election.cc:341] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.325825 9568 raft_consensus.cc:2454] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:44.326293 9219 leader_election.cc:302] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.326817 11223 raft_consensus.cc:2781] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:44.327049 11223 raft_consensus.cc:686] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:44.327320 11223 consensus_queue.cc:237] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:44.328847 9815 ts_tablet_manager.cc:1918] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:44.328948 9815 log.cc:1196] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/88d6b4482e7b42fca17e5b917e1c1bed
I20260928 14:50:44.329272 9815 ts_tablet_manager.cc:1939] T 88d6b4482e7b42fca17e5b917e1c1bed P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.329851 9813 ts_tablet_manager.cc:1918] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.330247 9813 log.cc:1196] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/71b5f68b570e4fff8f8748e4c762ad78
W20260928 14:50:44.333966 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f385d804a10442e3b725a86e201dd6a5 consensus state has no leader
I20260928 14:50:44.337038 9813 ts_tablet_manager.cc:1939] T 71b5f68b570e4fff8f8748e4c762ad78 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.338317 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1068) took 1376 ms. Trace:
I20260928 14:50:44.338680 9813 rpcz_store.cc:276] 0928 14:50:42.962123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.962248 (+ 125us) service_pool.cc:227] Handling call
0928 14:50:44.308198 (+1345950us) ts_tablet_manager.cc:1145] Deleting tablet 71b5f68b570e4fff8f8748e4c762ad78
0928 14:50:44.308327 (+ 129us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.321002 (+ 12675us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.329446 (+ 8444us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.338297 (+ 8851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334769}
I20260928 14:50:44.339795 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 71b5f68b570e4fff8f8748e4c762ad78 (table default.Table_725d6b822a1d4f99a2232890822325ab [id=4ec4ed32b9434e4a96b2d9172546fcc0]) successfully deleted
I20260928 14:50:44.340514 9813 tablet_replica.cc:330] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.341140 9813 raft_consensus.cc:2229] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.341826 9813 raft_consensus.cc:2258] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.343755 9813 ts_tablet_manager.cc:1905] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:44.353768 9497 leader_election.cc:341] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:44.354053 9497 leader_election.cc:341] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:44.354257 9497 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.363050 11341 tablet.cc:1722] T e13976317a32495ab377654b738667ca P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:44.364483 9813 ts_tablet_manager.cc:1918] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.364970 9813 log.cc:1196] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/46fe647c6d80431bbb76899126d01c3b
I20260928 14:50:44.366080 9813 ts_tablet_manager.cc:1939] T 46fe647c6d80431bbb76899126d01c3b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.367230 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1106) took 1443 ms. Trace:
I20260928 14:50:44.367092 9813 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34142 (request call id 1066) took 1405 ms. Trace:
I20260928 14:50:44.367332 9815 rpcz_store.cc:276] 0928 14:50:42.923527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.923633 (+ 106us) service_pool.cc:227] Handling call
0928 14:50:44.305789 (+1382156us) ts_tablet_manager.cc:1145] Deleting tablet 88d6b4482e7b42fca17e5b917e1c1bed
0928 14:50:44.305800 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.311930 (+ 6130us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.328771 (+ 16841us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.367206 (+ 38435us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382006}
I20260928 14:50:44.367672 9815 tablet_replica.cc:330] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.367575 9813 rpcz_store.cc:276] 0928 14:50:42.961951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.962004 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:44.340380 (+1378376us) ts_tablet_manager.cc:1145] Deleting tablet 46fe647c6d80431bbb76899126d01c3b
0928 14:50:44.340393 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.354368 (+ 13975us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.364200 (+ 9832us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.367074 (+ 2874us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366849}
I20260928 14:50:44.369760 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 46fe647c6d80431bbb76899126d01c3b (table default.Table_ab3473736270443b95023ad0ed180aa3 [id=a653b9509beb4e1684a5fc9bc5124074]) successfully deleted
W20260928 14:50:44.370057 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a5eb8907be064167a3739715d24c94e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5eb8907be064167a3739715d24c94e9 already in progress: creating tablet
W20260928 14:50:44.370750 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 19a668806adc4975bebb4ebb1a9d3c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19a668806adc4975bebb4ebb1a9d3c82 already in progress: creating tablet
W20260928 14:50:44.371795 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d604978c5289471a854c9b286d137f61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604978c5289471a854c9b286d137f61 already in progress: creating tablet
W20260928 14:50:44.372767 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6f73568a67cb401388beaa266a0324fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f73568a67cb401388beaa266a0324fc already in progress: creating tablet
W20260928 14:50:44.373833 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d8e4357c3d5487fa76e1e49c6cb7547 already in progress: creating tablet
W20260928 14:50:44.376390 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 71ec7763cd5e4578919ce5824eea1329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ec7763cd5e4578919ce5824eea1329 already in progress: creating tablet
I20260928 14:50:44.376978 9813 tablet_replica.cc:330] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.377761 9813 raft_consensus.cc:2229] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.378257 9813 raft_consensus.cc:2258] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.315333 11346 raft_consensus.cc:482] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.380230 9815 raft_consensus.cc:2229] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.380159 11346 raft_consensus.cc:504] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.380160 9813 ts_tablet_manager.cc:1905] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.380903 11346 leader_election.cc:288] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.381491 11346 raft_consensus.cc:482] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.381669 11346 raft_consensus.cc:504] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.382167 11346 leader_election.cc:288] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.380541 9848 tablet_bootstrap.cc:492] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.382870 9848 ts_tablet_manager.cc:1397] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.283s user 0.007s sys 0.012s
I20260928 14:50:44.254280 11343 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:44.380420 9815 raft_consensus.cc:2258] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.387035 11303 raft_consensus.cc:482] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.387163 11303 raft_consensus.cc:504] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.387790 11303 leader_election.cc:288] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.388392 9855 ts_tablet_manager.cc:1428] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.368s user 0.001s sys 0.001s
I20260928 14:50:44.387903 9848 raft_consensus.cc:348] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.388551 9848 raft_consensus.cc:374] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.388797 9848 raft_consensus.cc:729] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.389590 9815 ts_tablet_manager.cc:1905] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.389472 9848 consensus_queue.cc:260] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.396082 9848 ts_tablet_manager.cc:1428] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 14:50:44.400691 9848 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.404740 11351 tablet.cc:1722] T e13976317a32495ab377654b738667ca P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:44.409510 9855 tablet_bootstrap.cc:492] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:44.411276 9855 tablet_bootstrap.cc:654] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.418648 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 3841f8643cf746ae965bf54f24573c87 (DEFAULT_TABLE table=default.Table_eef0b655cea940fe9168838d4c3bcaf4 [id=a373eff87fa045d18851dc21cdfd23d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.419083 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3841f8643cf746ae965bf54f24573c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.431201 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81e272545349678c7824ba5520ec8e (DEFAULT_TABLE table=default.Table_3df105fd8cd24039977b94b28b424121 [id=1d90cc07f34e4253ad62b7a7accb095b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.431551 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81e272545349678c7824ba5520ec8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.437455 9262 tablet_service.cc:1467] Processing CreateTablet for tablet e32c9d9756e04d79b1c2350b4cc1ea57 (DEFAULT_TABLE table=default.Table_a91574affcef4ab393d67b3607364005 [id=965a5831672d40839f7fa0e89af60d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.437877 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32c9d9756e04d79b1c2350b4cc1ea57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.445962 9815 ts_tablet_manager.cc:1918] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.446074 9815 log.cc:1196] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7a2f051a09e143b8bb0ba3be81406b98
I20260928 14:50:44.446369 9815 ts_tablet_manager.cc:1939] T 7a2f051a09e143b8bb0ba3be81406b98 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.446871 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "835ba6c803a34707b77bb8bc280b9e68" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.447736 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5cb151d58f545d9b1e6f652a0627ab9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.448995 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c5877a52264f0e9ebb070792e39e55" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.449800 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.452718 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1119) took 1315 ms. Trace:
I20260928 14:50:44.452811 9815 rpcz_store.cc:276] 0928 14:50:43.137236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.138965 (+ 1729us) service_pool.cc:227] Handling call
0928 14:50:44.367616 (+1228651us) ts_tablet_manager.cc:1145] Deleting tablet 7a2f051a09e143b8bb0ba3be81406b98
0928 14:50:44.367631 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.414278 (+ 46647us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.445882 (+ 31604us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.452700 (+ 6818us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228405}
I20260928 14:50:44.453087 9815 tablet_replica.cc:330] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.453358 9815 raft_consensus.cc:2229] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.453490 9815 raft_consensus.cc:2258] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.453997 9815 ts_tablet_manager.cc:1905] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.463340 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet ab71087d034c4bedb06df9e5ccefad45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.464159 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd4192e103245f681062f473a15d167 (DEFAULT_TABLE table=default.Table_f6a090218ff7459585093b6e8757a300 [id=f3b751c25a96414d9aeca04940d39387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.464709 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd4192e103245f681062f473a15d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.470525 9261 tablet_service.cc:1467] Processing CreateTablet for tablet f8b1156c1b4b437c98c07070452ee260 (DEFAULT_TABLE table=default.Table_92dcab49752f419c829f062d4491450f [id=f28332d74766471d82244c48d99783c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.470863 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b1156c1b4b437c98c07070452ee260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.471087 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 49d3f127d068409789646dc574e92c05 (DEFAULT_TABLE table=default.Table_fa618acba76146c38ef92d78d5d33ac7 [id=2d9cc0de8d1a4f62b9c9e1a4243cd4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.471418 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d3f127d068409789646dc574e92c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.471982 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ba43a88f7aa94597ab76a47869e463cd (DEFAULT_TABLE table=default.Table_51ff7a6d884645c1974704ec54c878c2 [id=9d13da16d5344a3db45eb37e49632bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.472246 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba43a88f7aa94597ab76a47869e463cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.473270 9255 tablet_service.cc:1467] Processing CreateTablet for tablet b9c8417487b3473dab516b5359e15bb9 (DEFAULT_TABLE table=default.Table_b1e0f6176c744afc8e6250bfbdc9ba66 [id=aac575ca8489439485eefba2029cdfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.473572 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c8417487b3473dab516b5359e15bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.473743 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 507c1420c1704ce5a93f4d7846a94a8d (DEFAULT_TABLE table=default.Table_59c1bfec007c491f9db9f98c7ba8c58b [id=2e18a281c5db468593ddbbe7e9f38845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.474041 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507c1420c1704ce5a93f4d7846a94a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.474313 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 34a037a1976e4b5395ab5b5a95e343f0 (DEFAULT_TABLE table=default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.474624 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a037a1976e4b5395ab5b5a95e343f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.474941 9258 tablet_service.cc:1467] Processing CreateTablet for tablet b17faf5198e048b2824aea3308070fa8 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.475090 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 654698224424484baaee5410c12a1016 (DEFAULT_TABLE table=default.Table_b60092af06a64e498cebe5e021e56247 [id=903086c862a949b08d3dbb1f0d1af340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.475224 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17faf5198e048b2824aea3308070fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.475394 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654698224424484baaee5410c12a1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.477219 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 5130bf03e54d4c308b937e1879fc5f55 (DEFAULT_TABLE table=default.Table_6f501e4753ad4e16be7238bc969b0a7d [id=c300e841015c4daf850b842df98a366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.477516 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5130bf03e54d4c308b937e1879fc5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.478224 9248 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.478833 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.482278 9851 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.482393 9851 ts_tablet_manager.cc:1397] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.479s user 0.000s sys 0.004s
I20260928 14:50:44.482999 9851 raft_consensus.cc:348] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.483184 9851 raft_consensus.cc:374] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.483232 9851 raft_consensus.cc:729] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.483395 9851 consensus_queue.cc:260] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.485863 9813 ts_tablet_manager.cc:1918] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.485975 9813 log.cc:1196] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ea7b363d546c45ceb3efb9352cf184f4
I20260928 14:50:44.486249 9813 ts_tablet_manager.cc:1939] T ea7b363d546c45ceb3efb9352cf184f4 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.486608 9813 tablet_replica.cc:330] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.486768 9813 raft_consensus.cc:2229] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.486891 9813 raft_consensus.cc:2258] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.487380 9813 ts_tablet_manager.cc:1905] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.488374 9815 ts_tablet_manager.cc:1918] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.489158 9815 log.cc:1196] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/79f4b20a5e784d909f7297cc7f1b05e6
I20260928 14:50:44.490015 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ea7b363d546c45ceb3efb9352cf184f4 (table default.Table_38e8d8c399254d78ba45f973e9064285 [id=c7a56fd7639749f79590b127587f602e]) successfully deleted
I20260928 14:50:44.491288 9815 ts_tablet_manager.cc:1939] T 79f4b20a5e784d909f7297cc7f1b05e6 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.496803 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1121) took 1358 ms. Trace:
I20260928 14:50:44.497376 9848 tablet_bootstrap.cc:654] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.497336 9815 rpcz_store.cc:276] 0928 14:50:43.137983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.139267 (+ 1284us) service_pool.cc:227] Handling call
0928 14:50:44.453052 (+1313785us) ts_tablet_manager.cc:1145] Deleting tablet 79f4b20a5e784d909f7297cc7f1b05e6
0928 14:50:44.453061 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.457001 (+ 3940us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.487841 (+ 30840us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.496781 (+ 8940us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1313559}
I20260928 14:50:44.499657 9815 tablet_replica.cc:330] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.501149 9815 raft_consensus.cc:2229] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.502261 9815 raft_consensus.cc:2258] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.503607 9249 tablet_service.cc:1467] Processing CreateTablet for tablet cdea7026d52f495696ca7fba6ba7e64d (DEFAULT_TABLE table=default.Table_ddfff45616b34ccbae6690c77ff66c2f [id=3aeff2f70f324434bbb7512c6781a857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.503950 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdea7026d52f495696ca7fba6ba7e64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.506026 9815 ts_tablet_manager.cc:1905] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.520031 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.521209 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.521443 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.522390 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:44.522791 9360 leader_election.cc:341] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:44.522897 9360 leader_election.cc:302] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:44.523231 11111 raft_consensus.cc:2726] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:44.524166 9498 leader_election.cc:341] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.524344 9498 leader_election.cc:302] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:44.524821 9498 leader_election.cc:341] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.524966 9498 leader_election.cc:302] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:44.525369 9498 leader_election.cc:341] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.532996 9851 ts_tablet_manager.cc:1428] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.051s user 0.000s sys 0.001s
I20260928 14:50:44.533385 9851 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.535584 9851 tablet_bootstrap.cc:654] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:44.535905 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fc0a83bcaa0647c9bfe9b4635d391b0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0a83bcaa0647c9bfe9b4635d391b0e already in progress: creating tablet
I20260928 14:50:44.541121 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.541931 9281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.542455 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.525410 11352 raft_consensus.cc:2726] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.525552 11348 raft_consensus.cc:2726] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.550498 9498 leader_election.cc:302] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.550768 11348 raft_consensus.cc:2726] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:44.550849 9498 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.531365 9815 ts_tablet_manager.cc:1918] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.542292 11303 raft_consensus.cc:482] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.551057 11303 raft_consensus.cc:504] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.551388 9848 tablet_bootstrap.cc:492] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.551529 11303 leader_election.cc:288] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.543048 9538 tablet_service.cc:1467] Processing CreateTablet for tablet cdea7026d52f495696ca7fba6ba7e64d (DEFAULT_TABLE table=default.Table_ddfff45616b34ccbae6690c77ff66c2f [id=3aeff2f70f324434bbb7512c6781a857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.551637 9848 ts_tablet_manager.cc:1397] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.155s user 0.001s sys 0.018s
I20260928 14:50:44.551851 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdea7026d52f495696ca7fba6ba7e64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.552659 9814 ts_tablet_manager.cc:1918] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:44.552798 9814 log.cc:1196] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/78379bd4cfce46fa812374f046d9d329
I20260928 14:50:44.553270 9814 ts_tablet_manager.cc:1939] T 78379bd4cfce46fa812374f046d9d329 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:44.553133 9848 raft_consensus.cc:348] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.553570 9848 raft_consensus.cc:374] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.553689 9848 raft_consensus.cc:729] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.554064 9848 consensus_queue.cc:260] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.555380 9851 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.555480 9851 ts_tablet_manager.cc:1397] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.003s
I20260928 14:50:44.556105 9851 raft_consensus.cc:348] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.556464 9851 raft_consensus.cc:374] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.556520 9851 raft_consensus.cc:729] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.556691 9851 consensus_queue.cc:260] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.543403 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 3841f8643cf746ae965bf54f24573c87 (DEFAULT_TABLE table=default.Table_eef0b655cea940fe9168838d4c3bcaf4 [id=a373eff87fa045d18851dc21cdfd23d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.557298 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3841f8643cf746ae965bf54f24573c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.543602 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 7dd4192e103245f681062f473a15d167 (DEFAULT_TABLE table=default.Table_f6a090218ff7459585093b6e8757a300 [id=f3b751c25a96414d9aeca04940d39387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.558338 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dd4192e103245f681062f473a15d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.560325 9851 ts_tablet_manager.cc:1428] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:44.560564 9851 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.543712 9537 tablet_service.cc:1467] Processing CreateTablet for tablet e32c9d9756e04d79b1c2350b4cc1ea57 (DEFAULT_TABLE table=default.Table_a91574affcef4ab393d67b3607364005 [id=965a5831672d40839f7fa0e89af60d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.561954 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32c9d9756e04d79b1c2350b4cc1ea57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.562188 9851 tablet_bootstrap.cc:654] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.563390 9815 log.cc:1196] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2ebd54cdc07549e5b7cb179f4ab3aa9f
I20260928 14:50:44.563652 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1090) took 1652 ms. Trace:
I20260928 14:50:44.563829 9815 ts_tablet_manager.cc:1939] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.563751 9814 rpcz_store.cc:276] 0928 14:50:42.910896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.911020 (+ 124us) service_pool.cc:227] Handling call
0928 14:50:44.248261 (+1337241us) ts_tablet_manager.cc:1145] Deleting tablet 78379bd4cfce46fa812374f046d9d329
0928 14:50:44.248272 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.527530 (+279258us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.552528 (+ 24998us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.563634 (+ 11106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7492,"tablet-delete.queue_time_us":1337100}
I20260928 14:50:44.564253 9814 tablet_replica.cc:330] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.564419 9814 raft_consensus.cc:2229] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:44.564695 9814 raft_consensus.cc:2258] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.564833 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1118) took 1428 ms. Trace:
I20260928 14:50:44.565440 9814 ts_tablet_manager.cc:1905] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.543948 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 507c1420c1704ce5a93f4d7846a94a8d (DEFAULT_TABLE table=default.Table_59c1bfec007c491f9db9f98c7ba8c58b [id=2e18a281c5db468593ddbbe7e9f38845]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.565600 9815 rpcz_store.cc:276] 0928 14:50:43.136818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.139550 (+ 2732us) service_pool.cc:227] Handling call
0928 14:50:44.499390 (+1359840us) ts_tablet_manager.cc:1145] Deleting tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f
0928 14:50:44.499403 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.528352 (+ 28949us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.531289 (+ 2937us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.564813 (+ 33524us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1359387}
I20260928 14:50:44.544538 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 49d3f127d068409789646dc574e92c05 (DEFAULT_TABLE table=default.Table_fa618acba76146c38ef92d78d5d33ac7 [id=2d9cc0de8d1a4f62b9c9e1a4243cd4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.544766 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 34a037a1976e4b5395ab5b5a95e343f0 (DEFAULT_TABLE table=default.Table_9a63611e04b34faf88bfc79521f8a164 [id=d8c0c4feb9be4af4a6776f750cc243d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.545174 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 654698224424484baaee5410c12a1016 (DEFAULT_TABLE table=default.Table_b60092af06a64e498cebe5e021e56247 [id=903086c862a949b08d3dbb1f0d1af340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.545293 9546 tablet_service.cc:1467] Processing CreateTablet for tablet b17faf5198e048b2824aea3308070fa8 (DEFAULT_TABLE table=default.Table_e0f6421a3947442ea2ee9829ccece5e0 [id=5044e4fc14e349d19cf91c2afe135f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.545495 9529 tablet_service.cc:1467] Processing CreateTablet for tablet ba43a88f7aa94597ab76a47869e463cd (DEFAULT_TABLE table=default.Table_51ff7a6d884645c1974704ec54c878c2 [id=9d13da16d5344a3db45eb37e49632bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.566644 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c5877a52264f0e9ebb070792e39e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.566955 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 5130bf03e54d4c308b937e1879fc5f55 (DEFAULT_TABLE table=default.Table_6f501e4753ad4e16be7238bc969b0a7d [id=c300e841015c4daf850b842df98a366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.567436 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:44.567706 9530 tablet_service.cc:1467] Processing CreateTablet for tablet b9c8417487b3473dab516b5359e15bb9 (DEFAULT_TABLE table=default.Table_b1e0f6176c744afc8e6250bfbdc9ba66 [id=aac575ca8489439485eefba2029cdfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.568363 9815 tablet_replica.cc:330] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.568709 9424 raft_consensus.cc:3037] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:44.569093 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 78379bd4cfce46fa812374f046d9d329 (table default.Table_af4830aab30c4fccb57822e100e21564 [id=4808092de350419bba3b7bffa8967276]) successfully deleted
I20260928 14:50:44.569090 9815 raft_consensus.cc:2229] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.569762 9815 raft_consensus.cc:2258] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.543900 9543 tablet_service.cc:1467] Processing CreateTablet for tablet f8b1156c1b4b437c98c07070452ee260 (DEFAULT_TABLE table=default.Table_92dcab49752f419c829f062d4491450f [id=f28332d74766471d82244c48d99783c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.543403 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 0f81e272545349678c7824ba5520ec8e (DEFAULT_TABLE table=default.Table_3df105fd8cd24039977b94b28b424121 [id=1d90cc07f34e4253ad62b7a7accb095b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.565843 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507c1420c1704ce5a93f4d7846a94a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.572302 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654698224424484baaee5410c12a1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.572523 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f81e272545349678c7824ba5520ec8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.572523 9851 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.572835 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17faf5198e048b2824aea3308070fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.573657 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b1156c1b4b437c98c07070452ee260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.574175 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d3f127d068409789646dc574e92c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.576282 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a037a1976e4b5395ab5b5a95e343f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.579991 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba43a88f7aa94597ab76a47869e463cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.580199 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5130bf03e54d4c308b937e1879fc5f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.585083 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c8417487b3473dab516b5359e15bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.595718 9851 ts_tablet_manager.cc:1397] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260928 14:50:44.595929 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f42b0c58c5745b088e519844f09e67b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.550930 9498 leader_election.cc:302] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.597240 11303 raft_consensus.cc:2726] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.595745 9815 ts_tablet_manager.cc:1905] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:44.597288 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 46444.8us
W20260928 14:50:44.567293 9497 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.602154 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.603667 9848 ts_tablet_manager.cc:1428] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260928 14:50:44.603932 9848 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.604017 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8af72ac7bedb4cd7aed28cffda867c96 (table default.Table_cea129f875fa43ee92facec9a977a47e [id=a4802fba8b2c4291864aaa9ce687f468]) successfully deleted
I20260928 14:50:44.604856 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8a06859c8dcc41d99d29365aae350afa (table default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]) successfully deleted
I20260928 14:50:44.607503 10975 raft_consensus.cc:482] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.607620 10975 raft_consensus.cc:504] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.610754 10975 leader_election.cc:288] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:44.610955 9813 ts_tablet_manager.cc:1918] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.611049 9813 log.cc:1196] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/eff9afcc868244aeb830fae2735da28d
I20260928 14:50:44.611286 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96492abf8cf459a992dd1d7b0226b57" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.611436 9813 ts_tablet_manager.cc:1939] T eff9afcc868244aeb830fae2735da28d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:44.611687 9219 leader_election.cc:341] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d96492abf8cf459a992dd1d7b0226b57
W20260928 14:50:44.611951 9220 leader_election.cc:341] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.612092 9813 tablet_replica.cc:330] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.612170 9220 leader_election.cc:302] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.612392 9813 raft_consensus.cc:2229] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.612476 10975 raft_consensus.cc:2726] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.612699 9813 raft_consensus.cc:2258] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.613698 9813 ts_tablet_manager.cc:1905] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.613829 9851 raft_consensus.cc:348] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.614269 9851 raft_consensus.cc:374] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.614434 9851 raft_consensus.cc:729] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.614753 9851 consensus_queue.cc:260] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.615428 9851 ts_tablet_manager.cc:1428] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260928 14:50:44.615622 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7541995a414dbb84ff9d3f2fe11c01 (DEFAULT_TABLE table=default.Table_951b956bd54e4638ab60ffd1774fda07 [id=4a1a982559b04201b54be385cf587f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.616667 9848 tablet_bootstrap.cc:654] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.618595 9851 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.619477 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7541995a414dbb84ff9d3f2fe11c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.623986 9813 ts_tablet_manager.cc:1918] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:44.624239 9813 log.cc:1196] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/82b9dad76ac94a03811e4793e0234aad
I20260928 14:50:44.624955 9813 ts_tablet_manager.cc:1939] T 82b9dad76ac94a03811e4793e0234aad P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.625767 9813 tablet_replica.cc:330] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.626099 9813 raft_consensus.cc:2229] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.626379 9813 raft_consensus.cc:2258] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.627250 9813 ts_tablet_manager.cc:1905] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.605439 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 88d6b4482e7b42fca17e5b917e1c1bed (table default.Table_6dacb88cb9c74873a8f69da29a43fed9 [id=27d3ad1dac4641e2b16e86da4d16ea0e]) successfully deleted
I20260928 14:50:44.628185 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7a2f051a09e143b8bb0ba3be81406b98 (table default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]) successfully deleted
I20260928 14:50:44.628469 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 79f4b20a5e784d909f7297cc7f1b05e6 (table default.Table_69359a2fb5f541a5a6f13af1a82119b2 [id=796bdf7268ff407d9c87a2c0487e18ee]) successfully deleted
I20260928 14:50:44.629246 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7c4af055532746f8b4b4a9f82b803099"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.612270 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet eff9afcc868244aeb830fae2735da28d (table default.Table_e01ee9de5cd04851ac4c3b43e61208c8 [id=0a24b7cf7d1d45faa8fef4abf95aca66]) successfully deleted
W20260928 14:50:44.629856 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c4af055532746f8b4b4a9f82b803099 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.630254 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 82b9dad76ac94a03811e4793e0234aad (table default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]) successfully deleted
I20260928 14:50:44.621031 8948 catalog_manager.cc:5495] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:44.630621 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_a295eec0df314d1daf27bb41be119c4c [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 1 got 0
I20260928 14:50:44.632196 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e (DEFAULT_TABLE table=default.Table_a7c87abccc9e4738a131a19f0fd15b13 [id=617326d935a14e2ea40fb98b092e115a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.632534 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c5d12b6e1774b7f8a02fc906c9a417e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.632678 9400 tablet_service.cc:1467] Processing CreateTablet for tablet f6a7726d4ce54195825969142808210a (DEFAULT_TABLE table=default.Table_4bc8db2b069e4b2f892d9399ee7f5adf [id=e661e357076440e980aefa6cb4236ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.632944 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a7726d4ce54195825969142808210a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.637806 9399 tablet_service.cc:1467] Processing CreateTablet for tablet c6e60c75f6b24d88b0f5e6082104c357 (DEFAULT_TABLE table=default.Table_218278313d9c47819a4a1fd12e46bb8d [id=d6d8647354bd4516b772b042343eba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.638108 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6e60c75f6b24d88b0f5e6082104c357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.641302 9814 ts_tablet_manager.cc:1918] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:44.641781 9408 tablet_service.cc:1467] Processing CreateTablet for tablet affea6f5d2df43238f47fd1110b64acc (DEFAULT_TABLE table=default.Table_d1076de0cb444aebb34e69cd6d644dc5 [id=16cc10251c75488fb175da95a37b43cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.642118 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet affea6f5d2df43238f47fd1110b64acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.642187 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 639a2abad7eb40bf9e04ec4f4b91a98a (DEFAULT_TABLE table=default.Table_6814b40311fa4518b67267cd85fc9ad7 [id=f11c18605129424e83297754b2d2190c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.642460 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639a2abad7eb40bf9e04ec4f4b91a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.647023 9814 log.cc:1196] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/88d6b4482e7b42fca17e5b917e1c1bed
W20260928 14:50:44.647184 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f385d804a10442e3b725a86e201dd6a5 (table default.Table_659002d3409c4d7498f6fed3d1657dfa [id=efe7bcff144d4a8b87d5cfc0545b55a0], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f385d804a10442e3b725a86e201dd6a5 consensus state has no leader
I20260928 14:50:44.647425 9814 ts_tablet_manager.cc:1939] T 88d6b4482e7b42fca17e5b917e1c1bed P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:44.642807 9851 tablet_bootstrap.cc:654] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.648514 8948 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2] alter complete (version 2)
I20260928 14:50:44.649242 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1092) took 1725 ms. Trace:
I20260928 14:50:44.652565 9813 ts_tablet_manager.cc:1918] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:44.652766 9813 log.cc:1196] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8a08d91a06ca4effbc8fc4e83d88fe93
I20260928 14:50:44.652793 9814 rpcz_store.cc:276] 0928 14:50:42.923371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.923443 (+ 72us) service_pool.cc:227] Handling call
0928 14:50:44.564217 (+1640774us) ts_tablet_manager.cc:1145] Deleting tablet 88d6b4482e7b42fca17e5b917e1c1bed
0928 14:50:44.564227 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.617689 (+ 53462us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.641207 (+ 23518us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.649222 (+ 8015us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640620}
I20260928 14:50:44.653456 9814 tablet_replica.cc:330] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.653483 9813 ts_tablet_manager.cc:1939] T 8a08d91a06ca4effbc8fc4e83d88fe93 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.653910 9814 raft_consensus.cc:2229] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.654286 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (table default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]) successfully deleted
I20260928 14:50:44.654690 9813 tablet_replica.cc:330] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:44.654798 9498 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.655123 9498 leader_election.cc:302] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.655171 8948 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_6dc63b0600564c98b9f3ac0d01162e82 [id=066bd906e956423ea4fb9370314cfbd2] alter complete (version 2)
I20260928 14:50:44.655186 9813 raft_consensus.cc:2229] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:44.655421 11303 raft_consensus.cc:2726] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:44.656852 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 58873.8us
W20260928 14:50:44.657181 9498 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:44.601241 9497 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:44.657668 9497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 56407.6us
W20260928 14:50:44.658130 9497 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.658246 9497 leader_election.cc:302] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.658454 11303 raft_consensus.cc:2726] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:44.659132 9497 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.659374 9814 raft_consensus.cc:2258] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.660152 9814 ts_tablet_manager.cc:1905] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.660503 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f42b0c58c5745b088e519844f09e67b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.661053 9543 tablet_service.cc:1514] Processing DeleteTablet for tablet d9655e6b8d164d7e8d7143b629b945a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.661821 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 8e7541995a414dbb84ff9d3f2fe11c01 (DEFAULT_TABLE table=default.Table_951b956bd54e4638ab60ffd1774fda07 [id=4a1a982559b04201b54be385cf587f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.662292 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e7541995a414dbb84ff9d3f2fe11c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.662213 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:44.663164 9815 ts_tablet_manager.cc:1918] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.663599 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_84c246878fa24a1ca4ac14c7ca79efea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.664155 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84c246878fa24a1ca4ac14c7ca79efea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.664544 9813 raft_consensus.cc:2258] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.665374 9813 ts_tablet_manager.cc:1905] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.667624 11362 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:44.672359 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_92dcb0d682fc43e482536a941dd8b135"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.672923 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92dcb0d682fc43e482536a941dd8b135 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.674918 9814 ts_tablet_manager.cc:1918] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.676164 9813 ts_tablet_manager.cc:1918] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:44.676430 9813 log.cc:1196] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d27a357d905e463ba9507f74e575acb1
I20260928 14:50:44.677165 9813 ts_tablet_manager.cc:1939] T d27a357d905e463ba9507f74e575acb1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.678201 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]) successfully deleted
I20260928 14:50:44.678576 9813 tablet_replica.cc:330] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.679860 9813 raft_consensus.cc:2229] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.680104 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6bbca659342d47fa879bd3441a38f962" } modify_external_catalogs: true
I20260928 14:50:44.680171 9813 raft_consensus.cc:2258] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.680305 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6bbca659342d47fa879bd3441a38f962" } modify_external_catalogs: true
I20260928 14:50:44.681166 9813 ts_tablet_manager.cc:1905] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.687021 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6ade6066d90547b6bb9be50799bf8d5f
I20260928 14:50:44.687759 9400 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.687898 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cda034a8dee64de597915af61ba85f2a" } modify_external_catalogs: true
I20260928 14:50:44.688205 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cda034a8dee64de597915af61ba85f2a" } modify_external_catalogs: true
I20260928 14:50:44.690670 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 71b5f68b570e4fff8f8748e4c762ad78 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:44.690930 9848 tablet_bootstrap.cc:492] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.691033 9848 ts_tablet_manager.cc:1397] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.003s
I20260928 14:50:44.691272 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e5255bb38a7641a99bbebeb44410d860" } modify_external_catalogs: true
I20260928 14:50:44.691473 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e5255bb38a7641a99bbebeb44410d860" } modify_external_catalogs: true
I20260928 14:50:44.692451 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:44.692579 8953 master_service.cc:946] ReplaceTablet: received request to replace tablet b339b4e3cfbd40c1a35a4c6083926869 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:44.693580 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 88d6b4482e7b42fca17e5b917e1c1bed (table default.Table_6dacb88cb9c74873a8f69da29a43fed9 [id=27d3ad1dac4641e2b16e86da4d16ea0e]) successfully deleted
I20260928 14:50:44.694649 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f (table default.Table_b7a4bbe399d049febce65ba67480aa5b [id=c7da048bc94343ceb9f28c8b810d8505]) successfully deleted
I20260928 14:50:44.695801 9848 raft_consensus.cc:348] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.695966 9848 raft_consensus.cc:374] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.696010 9848 raft_consensus.cc:729] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.696163 9848 consensus_queue.cc:260] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.693826 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cf545aef440c4f55add88d6e91729547" } new_table_name: "default.Table_afe458b953024701bb4e889aa540df7f" modify_external_catalogs: true
I20260928 14:50:44.694037 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ee99ff1c771d463fa139847102145b47" } new_table_name: "default.Table_c517262f67d747928c9dbb4b470f167c" modify_external_catalogs: true
I20260928 14:50:44.702083 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 35b9aa8b2fb64528af024a86c9e29e57 (DEFAULT_TABLE table=default.Table_24223101f6054757a0e18eaec7b32802 [id=3f969256308041dcb5ce28b45e1cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.702416 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b9aa8b2fb64528af024a86c9e29e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.703636 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:44.703811 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 37a88328ce824b66b682df561cc307c3 (DEFAULT_TABLE table=default.Table_dd796afb3f1c4d0e954db5c51225c5fa [id=864df1be84b348959b1603a0157302bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.704149 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a88328ce824b66b682df561cc307c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.704334 8948 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5b171a26e7e643c9bc98c580b7bae60f (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]). Expected version 2 got 0
I20260928 14:50:44.704949 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:44.705200 8948 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5b171a26e7e643c9bc98c580b7bae60f (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5b171a26e7e643c9bc98c580b7bae60f consensus state has no leader
I20260928 14:50:44.705711 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 (DEFAULT_TABLE table=default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf [id=4bba7657f83b4c5786fa99cb2726cebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.705921 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 04b62b15e0c74f3daeee1299b674afef (DEFAULT_TABLE table=default.Table_e8af7c0d4df34461a4185b78977b526f [id=2e38d005f42a47e5bb0c65dd9207f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.707036 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5fa33bfc194aafa72f79656f8492d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.707234 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b62b15e0c74f3daeee1299b674afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.708680 9813 ts_tablet_manager.cc:1918] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.708809 9813 log.cc:1196] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/56151b288b634d6bb0bc7113afa5fbaa
I20260928 14:50:44.709319 9813 ts_tablet_manager.cc:1939] T 56151b288b634d6bb0bc7113afa5fbaa P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.709935 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 56151b288b634d6bb0bc7113afa5fbaa (table default.Table_d2f4dbbc71b9434bb2a869ed05653fda [id=9fbe5dc5576640caaef162edb5362740]) successfully deleted
W20260928 14:50:44.710664 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 080159d2e65a4550861f4c63fb22d02e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 080159d2e65a4550861f4c63fb22d02e already in progress: creating tablet
W20260928 14:50:44.711424 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 287a1ca845fe440da98bf68aafa0e49c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 287a1ca845fe440da98bf68aafa0e49c already in progress: creating tablet
W20260928 14:50:44.712342 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
W20260928 14:50:44.713251 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7341dac419f2443594ea9ef9c65f2daa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7341dac419f2443594ea9ef9c65f2daa already in progress: creating tablet
W20260928 14:50:44.714118 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
W20260928 14:50:44.714896 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ba0d51f1c2664e0b8c6acb7847eff7cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0d51f1c2664e0b8c6acb7847eff7cc already in progress: creating tablet
W20260928 14:50:44.715967 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1f42b0c58c5745b088e519844f09e67b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f42b0c58c5745b088e519844f09e67b already in progress: creating tablet
W20260928 14:50:44.716673 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d9655e6b8d164d7e8d7143b629b945a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9655e6b8d164d7e8d7143b629b945a7 already in progress: creating tablet
I20260928 14:50:44.717015 9813 tablet_replica.cc:330] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.717657 9815 log.cc:1196] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1016ad6219294ccd829fca9b264ab06f
I20260928 14:50:44.717648 9813 raft_consensus.cc:2229] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.718138 9815 ts_tablet_manager.cc:1939] T 1016ad6219294ccd829fca9b264ab06f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:44.718972 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1120) took 1581 ms. Trace:
I20260928 14:50:44.719091 9815 rpcz_store.cc:276] 0928 14:50:43.137609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.148104 (+ 10495us) service_pool.cc:227] Handling call
0928 14:50:44.568288 (+1420184us) ts_tablet_manager.cc:1145] Deleting tablet 1016ad6219294ccd829fca9b264ab06f
0928 14:50:44.568299 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.659811 (+ 91512us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.663083 (+ 3272us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.718934 (+ 55851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419777}
W20260928 14:50:44.668951 9498 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.721815 9498 leader_election.cc:302] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.722146 11303 raft_consensus.cc:2726] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.723519 9848 ts_tablet_manager.cc:1428] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.032s user 0.001s sys 0.002s
I20260928 14:50:44.724148 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:44.724797 9848 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.725775 9399 tablet_service.cc:1467] Processing CreateTablet for tablet d321d64ad40645c8979d28a69ee3bab4 (DEFAULT_TABLE table=default.Table_13e05569d38a40b081e20e2d67cb1f12 [id=75a0cd0aeff44c66a9c74b10b16bc889]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:44.726238 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 68771.3us
I20260928 14:50:44.727133 11303 raft_consensus.cc:482] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.727267 11303 raft_consensus.cc:504] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.727511 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 00b65284d7da4ee186d228c64a4013d6 (DEFAULT_TABLE table=default.Table_272ae048ec1e43cd95fdc4772c5a38a3 [id=0bb2ebcf91e943cdaba32e8f1f21d780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.727867 9815 tablet_replica.cc:330] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:44.727874 11303 leader_election.cc:288] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:44.728117 9815 raft_consensus.cc:2229] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.731848 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0728defd0fb44c37bb8aa1e18825f3f4
I20260928 14:50:44.732754 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.733304 9815 raft_consensus.cc:2258] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.734081 9815 ts_tablet_manager.cc:1905] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.669045 9855 tablet_bootstrap.cc:492] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:44.695776 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e (DEFAULT_TABLE table=default.Table_a7c87abccc9e4738a131a19f0fd15b13 [id=617326d935a14e2ea40fb98b092e115a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.735450 9814 log.cc:1196] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3f17eb03f5ed4cb581c29fc0d8619ff2
I20260928 14:50:44.735670 9855 ts_tablet_manager.cc:1397] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.326s user 0.004s sys 0.000s
I20260928 14:50:44.735728 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c5d12b6e1774b7f8a02fc906c9a417e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.735780 9814 ts_tablet_manager.cc:1939] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:44.692466 9537 tablet_service.cc:1467] Processing CreateTablet for tablet c6e60c75f6b24d88b0f5e6082104c357 (DEFAULT_TABLE table=default.Table_218278313d9c47819a4a1fd12e46bb8d [id=d6d8647354bd4516b772b042343eba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.736102 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6e60c75f6b24d88b0f5e6082104c357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.736459 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1093) took 1809 ms. Trace:
I20260928 14:50:44.736538 9814 rpcz_store.cc:276] 0928 14:50:42.926868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.926914 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:44.653409 (+1726495us) ts_tablet_manager.cc:1145] Deleting tablet 3f17eb03f5ed4cb581c29fc0d8619ff2
0928 14:50:44.653422 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.664447 (+ 11025us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.674837 (+ 10390us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.736438 (+ 61601us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1726345}
I20260928 14:50:44.736907 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1095) took 1809 ms. Trace:
I20260928 14:50:44.736977 9814 rpcz_store.cc:276] 0928 14:50:42.927089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.927144 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:44.736818 (+1809674us) ts_tablet_manager.cc:1145] Deleting tablet 59ced67c921e43e48bcb5195da212582
0928 14:50:44.736828 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.736891 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809535}
I20260928 14:50:44.737200 9814 tablet_replica.cc:330] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.737363 9814 raft_consensus.cc:2229] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.737473 9814 raft_consensus.cc:2258] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.692950 9535 tablet_service.cc:1467] Processing CreateTablet for tablet affea6f5d2df43238f47fd1110b64acc (DEFAULT_TABLE table=default.Table_d1076de0cb444aebb34e69cd6d644dc5 [id=16cc10251c75488fb175da95a37b43cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.737814 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet affea6f5d2df43238f47fd1110b64acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.738169 9814 ts_tablet_manager.cc:1905] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.696125 9262 tablet_service.cc:1467] Processing CreateTablet for tablet f6a7726d4ce54195825969142808210a (DEFAULT_TABLE table=default.Table_4bc8db2b069e4b2f892d9399ee7f5adf [id=e661e357076440e980aefa6cb4236ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.739810 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a7726d4ce54195825969142808210a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.740608 9848 tablet_bootstrap.cc:654] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.742398 9855 raft_consensus.cc:348] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.742555 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 200632864b62451b9174676bb07b9bb4 (DEFAULT_TABLE table=default.Table_496a2bee552243288885986e6448b485 [id=e9616ee689ef4927a47793b145557952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.742681 9855 raft_consensus.cc:374] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.742862 9855 raft_consensus.cc:729] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.743108 9855 consensus_queue.cc:260] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.743691 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d6b0563370744b0fac2e75499803cfb3 (DEFAULT_TABLE table=default.Table_4cb83b9d56df409dbed6569e1a6ac95d [id=384e0b17f11c43c6ae7a33f4177bb673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.696426 9253 tablet_service.cc:1467] Processing CreateTablet for tablet c6e60c75f6b24d88b0f5e6082104c357 (DEFAULT_TABLE table=default.Table_218278313d9c47819a4a1fd12e46bb8d [id=d6d8647354bd4516b772b042343eba89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.744751 9406 tablet_service.cc:1467] Processing CreateTablet for tablet e302360c83ec4574b9e6ec621b5c5bc3 (DEFAULT_TABLE table=default.Table_1ba61d5485a7452e96ee458e70e06b38 [id=3c3b0917f409433999fafb7706f1ddd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.744882 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6e60c75f6b24d88b0f5e6082104c357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.748912 9855 ts_tablet_manager.cc:1428] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:44.749178 9855 tablet_bootstrap.cc:492] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:44.696694 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 639a2abad7eb40bf9e04ec4f4b91a98a (DEFAULT_TABLE table=default.Table_6814b40311fa4518b67267cd85fc9ad7 [id=f11c18605129424e83297754b2d2190c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.749769 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639a2abad7eb40bf9e04ec4f4b91a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.693821 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e (DEFAULT_TABLE table=default.Table_a7c87abccc9e4738a131a19f0fd15b13 [id=617326d935a14e2ea40fb98b092e115a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.696866 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet 622a7af04be44ddebc1af16fcc6325ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.696985 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 7376f56883dc4032b120cc4494fa8936 with delete_type TABLET_DATA_DELETED (replaced by tablet a8f6de1135234f58aa2e534efead2880) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.697078 9264 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.697659 9265 tablet_service.cc:1467] Processing CreateTablet for tablet affea6f5d2df43238f47fd1110b64acc (DEFAULT_TABLE table=default.Table_d1076de0cb444aebb34e69cd6d644dc5 [id=16cc10251c75488fb175da95a37b43cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.753953 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet affea6f5d2df43238f47fd1110b64acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.753947 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c5d12b6e1774b7f8a02fc906c9a417e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.754565 9389 tablet_service.cc:1467] Processing CreateTablet for tablet cd36bd6fdd1b48fb827eb879db822cf1 (DEFAULT_TABLE table=default.Table_0d6530474e1842bd86cb8eb17ac76cbe [id=0bdb1438d0024b48b873b4bdaa85bc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.755411 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 50b464717caf48bcb81ec8618091d7a9 (DEFAULT_TABLE table=default.Table_6a14097e0acf40e6a81b13806b67983d [id=0c7de59300344cd08e84a97c34174bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.756183 9395 tablet_service.cc:1467] Processing CreateTablet for tablet bcd4b5ce5688410292b32fc11fc03f4e (DEFAULT_TABLE table=default.Table_84295f6ff46b4fee9a2d41e0b2720900 [id=ab8c3ce02c9343e788f5c1d2dccb9aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.757309 9403 tablet_service.cc:1467] Processing CreateTablet for tablet ee432f8c22ad4134a5a2fb47190fcf48 (DEFAULT_TABLE table=default.Table_4c9961ae311d47e0bb1b02bd1afe6609 [id=9f0044ba4fc9404985d95ca31ef4c2c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:44.710179 9220 consensus_peers.cc:487] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a08d91a06ca4effbc8fc4e83d88fe93. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:44.735023 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a70f70162c2433aab5136514bd5fc03" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:44.757628 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 47488.2us
I20260928 14:50:44.758462 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.759518 9388 tablet_service.cc:1467] Processing CreateTablet for tablet fb2e6fd4284946e6bec6688ac522be18 (DEFAULT_TABLE table=default.Table_bbc7f5f92c2447c1a6ba6df83536d05a [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:44.760116 9497 leader_election.cc:341] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.693998 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.691982 9531 tablet_service.cc:1467] Processing CreateTablet for tablet f6a7726d4ce54195825969142808210a (DEFAULT_TABLE table=default.Table_4bc8db2b069e4b2f892d9399ee7f5adf [id=e661e357076440e980aefa6cb4236ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.760696 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.760759 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a7726d4ce54195825969142808210a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.766985 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 05342bec2afe44d3a6e21e19a16091a4
I20260928 14:50:44.768539 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:44.769093 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c19910c560964cc6a17cc11f141d647d consensus state has no leader
W20260928 14:50:44.769486 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71a94a7a6c81453c8e47149be3d6479e consensus state has no leader
I20260928 14:50:44.769065 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b339b4e3cfbd40c1a35a4c6083926869
I20260928 14:50:44.770226 8953 catalog_manager.cc:6565] ReplaceTablet: tablet b339b4e3cfbd40c1a35a4c6083926869 deleted and replaced by tablet 93c0fb8b710c424d8aeaabc83587d597
I20260928 14:50:44.770665 9405 tablet_service.cc:1514] Processing DeleteTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c0fb8b710c424d8aeaabc83587d597) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.774374 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 (DEFAULT_TABLE table=default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf [id=4bba7657f83b4c5786fa99cb2726cebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.774833 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5fa33bfc194aafa72f79656f8492d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.777284 9426 raft_consensus.cc:3037] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:44.777319 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.780197 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d321d64ad40645c8979d28a69ee3bab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.781059 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 35b9aa8b2fb64528af024a86c9e29e57 (DEFAULT_TABLE table=default.Table_24223101f6054757a0e18eaec7b32802 [id=3f969256308041dcb5ce28b45e1cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.781402 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b9aa8b2fb64528af024a86c9e29e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.781546 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e302360c83ec4574b9e6ec621b5c5bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.785724 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6b0563370744b0fac2e75499803cfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.787474 9851 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.787608 9851 ts_tablet_manager.cc:1397] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.169s user 0.005s sys 0.004s
I20260928 14:50:44.788362 9851 raft_consensus.cc:348] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.788600 9851 raft_consensus.cc:374] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.788656 9851 raft_consensus.cc:729] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.788842 9851 consensus_queue.cc:260] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.789333 9851 ts_tablet_manager.cc:1428] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:44.789503 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50b464717caf48bcb81ec8618091d7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.789563 11111 raft_consensus.cc:482] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:44.789697 11111 raft_consensus.cc:504] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.790002 9851 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.790305 11111 leader_election.cc:288] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:44.791589 9360 leader_election.cc:341] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:44.792088 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 04b62b15e0c74f3daeee1299b674afef (DEFAULT_TABLE table=default.Table_e8af7c0d4df34461a4185b78977b526f [id=2e38d005f42a47e5bb0c65dd9207f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.792413 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b62b15e0c74f3daeee1299b674afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.792438 9851 tablet_bootstrap.cc:654] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.793754 9813 raft_consensus.cc:2258] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.796005 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd4b5ce5688410292b32fc11fc03f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.797726 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee432f8c22ad4134a5a2fb47190fcf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.797896 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd36bd6fdd1b48fb827eb879db822cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.797559 9813 ts_tablet_manager.cc:1905] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.798401 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 37a88328ce824b66b682df561cc307c3 (DEFAULT_TABLE table=default.Table_dd796afb3f1c4d0e954db5c51225c5fa [id=864df1be84b348959b1603a0157302bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.798493 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2871c2000c9f41f9ba8145ed0c3ee508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.798698 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a88328ce824b66b682df561cc307c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.798785 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200632864b62451b9174676bb07b9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.803568 9254 tablet_service.cc:1467] Processing CreateTablet for tablet d321d64ad40645c8979d28a69ee3bab4 (DEFAULT_TABLE table=default.Table_13e05569d38a40b081e20e2d67cb1f12 [id=75a0cd0aeff44c66a9c74b10b16bc889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.803903 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d321d64ad40645c8979d28a69ee3bab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.809372 9254 tablet_service.cc:1514] Processing DeleteTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.810328 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 00b65284d7da4ee186d228c64a4013d6 (DEFAULT_TABLE table=default.Table_272ae048ec1e43cd95fdc4772c5a38a3 [id=0bb2ebcf91e943cdaba32e8f1f21d780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.810442 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b65284d7da4ee186d228c64a4013d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.810595 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b65284d7da4ee186d228c64a4013d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.811154 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2e6fd4284946e6bec6688ac522be18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.813723 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.815965 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 200632864b62451b9174676bb07b9bb4 (DEFAULT_TABLE table=default.Table_496a2bee552243288885986e6448b485 [id=e9616ee689ef4927a47793b145557952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.816273 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200632864b62451b9174676bb07b9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.821628 9249 tablet_service.cc:1467] Processing CreateTablet for tablet d6b0563370744b0fac2e75499803cfb3 (DEFAULT_TABLE table=default.Table_4cb83b9d56df409dbed6569e1a6ac95d [id=384e0b17f11c43c6ae7a33f4177bb673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.821973 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6b0563370744b0fac2e75499803cfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.824048 9848 tablet_bootstrap.cc:492] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.824877 9848 ts_tablet_manager.cc:1397] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.012s
I20260928 14:50:44.827339 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:44.827976 9264 tablet_service.cc:1467] Processing CreateTablet for tablet e302360c83ec4574b9e6ec621b5c5bc3 (DEFAULT_TABLE table=default.Table_1ba61d5485a7452e96ee458e70e06b38 [id=3c3b0917f409433999fafb7706f1ddd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.828295 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e302360c83ec4574b9e6ec621b5c5bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.833990 9264 tablet_service.cc:1467] Processing CreateTablet for tablet cd36bd6fdd1b48fb827eb879db822cf1 (DEFAULT_TABLE table=default.Table_0d6530474e1842bd86cb8eb17ac76cbe [id=0bdb1438d0024b48b873b4bdaa85bc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.832614 9848 raft_consensus.cc:348] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.834667 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd36bd6fdd1b48fb827eb879db822cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.834748 9848 raft_consensus.cc:374] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.835359 9848 raft_consensus.cc:729] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.837037 9848 consensus_queue.cc:260] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.841578 9851 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.841768 9851 ts_tablet_manager.cc:1397] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.007s
I20260928 14:50:44.842720 9851 raft_consensus.cc:348] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.843030 9851 raft_consensus.cc:374] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.843094 9253 tablet_service.cc:1467] Processing CreateTablet for tablet bcd4b5ce5688410292b32fc11fc03f4e (DEFAULT_TABLE table=default.Table_84295f6ff46b4fee9a2d41e0b2720900 [id=ab8c3ce02c9343e788f5c1d2dccb9aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.843499 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd4b5ce5688410292b32fc11fc03f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.844714 9813 ts_tablet_manager.cc:1918] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.844813 9813 log.cc:1196] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ab71087d034c4bedb06df9e5ccefad45
I20260928 14:50:44.843118 9851 raft_consensus.cc:729] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.846187 9851 consensus_queue.cc:260] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.844883 9848 ts_tablet_manager.cc:1428] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.019s user 0.002s sys 0.002s
I20260928 14:50:44.846755 9848 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.846717 9851 ts_tablet_manager.cc:1428] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:44.846237 9422 raft_consensus.cc:3037] T 36613153c867446f9255d2290cfd9d06 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:44.847338 9250 tablet_service.cc:1467] Processing CreateTablet for tablet ee432f8c22ad4134a5a2fb47190fcf48 (DEFAULT_TABLE table=default.Table_4c9961ae311d47e0bb1b02bd1afe6609 [id=9f0044ba4fc9404985d95ca31ef4c2c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.847937 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c (DEFAULT_TABLE table=default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e [id=a5ae6b115ca8493991add2545755adde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.847927 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.848203 9848 tablet_bootstrap.cc:654] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.848241 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.848587 9262 tablet_service.cc:1467] Processing CreateTablet for tablet fb2e6fd4284946e6bec6688ac522be18 (DEFAULT_TABLE table=default.Table_bbc7f5f92c2447c1a6ba6df83536d05a [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.849215 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.849673 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.850071 9813 ts_tablet_manager.cc:1939] T ab71087d034c4bedb06df9e5ccefad45 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.850848 9257 tablet_service.cc:1514] Processing DeleteTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c0fb8b710c424d8aeaabc83587d597) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.851814 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ab71087d034c4bedb06df9e5ccefad45 (table default.Table_6e50a29433014e98b687ee424debf6d5 [id=c21ae162198d4e5393efc4d962fd68b1]) successfully deleted
I20260928 14:50:44.853018 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1016ad6219294ccd829fca9b264ab06f (table default.Table_4184ff7f97d64119a5a80a7baf746830 [id=d530e32c2df249aea93ebf2a3cbfb968]) successfully deleted
I20260928 14:50:44.853487 9851 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:44.853895 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee432f8c22ad4134a5a2fb47190fcf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.854246 9813 tablet_replica.cc:330] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:44.855144 9813 raft_consensus.cc:2229] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.855428 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2e6fd4284946e6bec6688ac522be18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.855810 9813 raft_consensus.cc:2258] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.857753 9813 ts_tablet_manager.cc:1905] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.861070 9851 tablet_bootstrap.cc:654] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.861931 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 50b464717caf48bcb81ec8618091d7a9 (DEFAULT_TABLE table=default.Table_6a14097e0acf40e6a81b13806b67983d [id=0c7de59300344cd08e84a97c34174bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.862926 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2871c2000c9f41f9ba8145ed0c3ee508. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.853859 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6ade6066d90547b6bb9be50799bf8d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ade6066d90547b6bb9be50799bf8d5f already in progress: creating tablet
I20260928 14:50:44.856266 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_deaec7dc095d4ecbba6dc7f7082aee96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.867009 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deaec7dc095d4ecbba6dc7f7082aee96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.856747 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d3027d35337d473da5ba0b110ddbfcbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.868302 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3027d35337d473da5ba0b110ddbfcbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.857157 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ad468fb701f64828b8a6f4c732ae8c3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.869434 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad468fb701f64828b8a6f4c732ae8c3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.869932 9848 tablet_bootstrap.cc:492] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:44.870087 9848 ts_tablet_manager.cc:1397] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20260928 14:50:44.857911 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e" } modify_external_catalogs: true
I20260928 14:50:44.871093 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e" } modify_external_catalogs: true
I20260928 14:50:44.871318 9848 raft_consensus.cc:348] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.871645 9848 raft_consensus.cc:374] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.871731 9848 raft_consensus.cc:729] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.872053 9848 consensus_queue.cc:260] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.859709 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_07605c4032844711b41d39435f0194a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.860129 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_21325fac865e4186aaab85da75813b38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.860533 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_39c68d94f854438e86cf0bdea2f25b90" } modify_external_catalogs: true
W20260928 14:50:44.872872 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07605c4032844711b41d39435f0194a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.872889 9848 ts_tablet_manager.cc:1428] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:44.872948 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_39c68d94f854438e86cf0bdea2f25b90" } modify_external_catalogs: true
I20260928 14:50:44.860860 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6dc63b0600564c98b9f3ac0d01162e82" } new_table_name: "default.Table_978ad5acfb5443d696539c6b347ebb2b" modify_external_catalogs: true
I20260928 14:50:44.861186 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a295eec0df314d1daf27bb41be119c4c" } new_table_name: "default.Table_7684b6725e84453281f0ec575a8b7bca" modify_external_catalogs: true
I20260928 14:50:44.861541 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d8ef185fa3b84d43a783f18d2e04e880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:44.875445 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.875618 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50b464717caf48bcb81ec8618091d7a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.875654 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8ef185fa3b84d43a783f18d2e04e880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:44.872874 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21325fac865e4186aaab85da75813b38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.891117 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2014e5f360ee46b895ae0b0c621a6f8e
I20260928 14:50:44.896421 9813 ts_tablet_manager.cc:1918] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.897850 9813 log.cc:1196] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:44.898576 9814 ts_tablet_manager.cc:1918] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.899118 9814 log.cc:1196] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:44.899715 9813 ts_tablet_manager.cc:1939] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:44.900595 9814 ts_tablet_manager.cc:1939] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:44.902472 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 6e5ad3ee185f47c3b8b3deb4ac354f51 (table default.Table_3fb54ea0da09494c99d850793c1cc0ef [id=0b05308461c1416e8c3d67b3aff24cc2]) successfully deleted
I20260928 14:50:44.903517 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_69628778959040419e3a0f0be17e29ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:44.905449 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0728defd0fb44c37bb8aa1e18825f3f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0728defd0fb44c37bb8aa1e18825f3f4 already in progress: creating tablet
W20260928 14:50:44.906263 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 05342bec2afe44d3a6e21e19a16091a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05342bec2afe44d3a6e21e19a16091a4 already in progress: creating tablet
I20260928 14:50:44.906950 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet 6e4f703cc19c453cbc46432a4430a204 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:44.907411 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b339b4e3cfbd40c1a35a4c6083926869 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b339b4e3cfbd40c1a35a4c6083926869 already in progress: creating tablet
I20260928 14:50:44.908504 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c
W20260928 14:50:44.908958 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69628778959040419e3a0f0be17e29ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:44.909024 9396 tablet_service.cc:1467] Processing CreateTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 (DEFAULT_TABLE table=default.Table_3499650ce231436095c708ac28e8970d [id=40aa526cc2e245a8a9adea28e2a15537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.909122 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.909377 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de77b0bec60a4ebbb0a1b6f779eaaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.910928 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 4cccb5b9c17644cf91971919bd66a82a (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.911278 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cccb5b9c17644cf91971919bd66a82a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.911343 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c already in progress: creating tablet
W20260928 14:50:44.913404 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 60400.9us
I20260928 14:50:44.913385 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 (DEFAULT_TABLE table=default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf [id=4bba7657f83b4c5786fa99cb2726cebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.913863 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (table default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]) successfully deleted
W20260928 14:50:44.914062 8939 catalog_manager.cc:4808] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 59ced67c921e43e48bcb5195da212582 because the tablet was not found. No further retry: Not found: Tablet not found: 59ced67c921e43e48bcb5195da212582
W20260928 14:50:44.914595 9498 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.181.61:41417, user_credentials={real_user=slave}} blocked reactor thread for 45076.1us
I20260928 14:50:44.915211 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a70f70162c2433aab5136514bd5fc03" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:44.915563 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.915643 9538 tablet_service.cc:1467] Processing CreateTablet for tablet 639a2abad7eb40bf9e04ec4f4b91a98a (DEFAULT_TABLE table=default.Table_6814b40311fa4518b67267cd85fc9ad7 [id=f11c18605129424e83297754b2d2190c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.916255 9855 tablet_bootstrap.cc:654] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.916975 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d05d8d79537247a1a6ef77e4e00859d5" } new_table_name: "default.Table_3557bdde57c6469e98e04a37fa1517d2" modify_external_catalogs: true
I20260928 14:50:44.919950 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919 (DEFAULT_TABLE table=default.Table_b5f2ef84e1d5493197263d4c75351a01 [id=d894c6c5ba6546fda50ae25e110d8345]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:44.920082 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2014e5f360ee46b895ae0b0c621a6f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2014e5f360ee46b895ae0b0c621a6f8e already in progress: creating tablet
I20260928 14:50:44.920383 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.921190 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8e14c545fca34272b631c4ba26cc5af3 (DEFAULT_TABLE table=default.Table_984254761e7344bbbde3d73a0ca783ea [id=e43130edbf994321a4a0a4ddd3837145]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.921489 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e14c545fca34272b631c4ba26cc5af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.922639 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 04b62b15e0c74f3daeee1299b674afef (DEFAULT_TABLE table=default.Table_e8af7c0d4df34461a4185b78977b526f [id=2e38d005f42a47e5bb0c65dd9207f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.922899 9815 ts_tablet_manager.cc:1918] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.922998 9815 log.cc:1196] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/58bb9c7fc599425484fd3fc0b94f3a8c
I20260928 14:50:44.921250 9402 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e66f2b273470e88e97ece175d6065 (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.923506 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e66f2b273470e88e97ece175d6065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.923914 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 35b9aa8b2fb64528af024a86c9e29e57 (DEFAULT_TABLE table=default.Table_24223101f6054757a0e18eaec7b32802 [id=3f969256308041dcb5ce28b45e1cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.926528 9851 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:44.926717 9851 ts_tablet_manager.cc:1397] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.000s
I20260928 14:50:44.927259 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet c163d657ec4f40598d7f4f3879e6d817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:44.927562 9851 raft_consensus.cc:348] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.927772 9851 raft_consensus.cc:374] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:44.927841 9851 raft_consensus.cc:729] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:44.928020 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639a2abad7eb40bf9e04ec4f4b91a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.928027 9851 consensus_queue.cc:260] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:44.928329 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6e4f703cc19c453cbc46432a4430a204
I20260928 14:50:44.928493 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5fa33bfc194aafa72f79656f8492d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.928717 8949 catalog_manager.cc:6565] ReplaceTablet: tablet 6e4f703cc19c453cbc46432a4430a204 deleted and replaced by tablet 6e975a709ce14064a2d4f4af21d22633
I20260928 14:50:44.928998 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b9aa8b2fb64528af024a86c9e29e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.929467 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b62b15e0c74f3daeee1299b674afef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.929731 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e4f703cc19c453cbc46432a4430a204 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e975a709ce14064a2d4f4af21d22633) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:44.930052 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9430a9410f41cc9c3858755a710a99 (DEFAULT_TABLE table=default.Table_c9bfad9c3b884d388ca4743438a34c0d [id=e98aef59f60a403cae71087cb3cca14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.930336 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9430a9410f41cc9c3858755a710a99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:44.930336 9498 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:44.930459 9498 leader_election.cc:302] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:44.933279 9851 ts_tablet_manager.cc:1428] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 14:50:44.935091 11303 raft_consensus.cc:2726] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:44.935971 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1096) took 2008 ms. Trace:
I20260928 14:50:44.936064 9814 rpcz_store.cc:276] 0928 14:50:42.927357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.927398 (+ 41us) service_pool.cc:227] Handling call
0928 14:50:44.737164 (+1809766us) ts_tablet_manager.cc:1145] Deleting tablet dc5ee93708ea4f3fabdf93aa9c33c1c8
0928 14:50:44.737173 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.740754 (+ 3581us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.898278 (+157524us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.935951 (+ 37673us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809642}
I20260928 14:50:44.938943 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]) successfully deleted
I20260928 14:50:44.945798 9814 tablet_replica.cc:330] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.947127 9814 raft_consensus.cc:2229] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.947286 9814 raft_consensus.cc:2258] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.947779 9814 ts_tablet_manager.cc:1905] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:44.948166 9851 tablet_bootstrap.cc:492] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:44.940666 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6e4f703cc19c453cbc46432a4430a204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e4f703cc19c453cbc46432a4430a204 already in progress: creating tablet
W20260928 14:50:44.941825 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 324a4c2340c9408c8aba7bab99bbe99c consensus state has no leader
I20260928 14:50:44.951700 9398 tablet_service.cc:1467] Processing CreateTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 (DEFAULT_TABLE table=default.Table_d7270bcdf2fd41f59e502b5bbe93cd19 [id=2f444af9ccd44795bdb9625d1dab53da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.952046 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39c67a1cf4c4a97af85aaf0484835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.952704 9851 tablet_bootstrap.cc:654] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.953979 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.955719 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d6975813b744fb80dcc432cec61cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.957366 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 0a20e579c7e74c5b84fc1d5e03b4d928 (DEFAULT_TABLE table=default.Table_be46200ec11c4f5a9a2f47854bed77a4 [id=80fab7753f4745ecbd4df38e852a2a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.957767 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a20e579c7e74c5b84fc1d5e03b4d928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.959127 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c (DEFAULT_TABLE table=default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e [id=a5ae6b115ca8493991add2545755adde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.959437 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.966080 9848 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:44.967252 9848 tablet_bootstrap.cc:654] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:44.969290 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.973472 9256 tablet_service.cc:1467] Processing CreateTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 (DEFAULT_TABLE table=default.Table_3499650ce231436095c708ac28e8970d [id=40aa526cc2e245a8a9adea28e2a15537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.974093 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de77b0bec60a4ebbb0a1b6f779eaaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.979194 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 4cccb5b9c17644cf91971919bd66a82a (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:44.981901 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cccb5b9c17644cf91971919bd66a82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:44.993710 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d197a8ba8848d98ba0f03b2e83d3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:44.994307 9814 ts_tablet_manager.cc:1918] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:44.994428 9814 log.cc:1196] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/41b8584ba1914c3390aee99baaee289e
I20260928 14:50:44.994735 9814 ts_tablet_manager.cc:1939] T 41b8584ba1914c3390aee99baaee289e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:44.995440 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1094) took 2068 ms. Trace:
I20260928 14:50:44.995532 9814 rpcz_store.cc:276] 0928 14:50:42.926977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.927588 (+ 611us) service_pool.cc:227] Handling call
0928 14:50:44.945757 (+2018169us) ts_tablet_manager.cc:1145] Deleting tablet 41b8584ba1914c3390aee99baaee289e
0928 14:50:44.945767 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.950550 (+ 4783us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.994222 (+ 43672us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.995420 (+ 1198us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2017923}
I20260928 14:50:44.995862 9814 tablet_replica.cc:330] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:44.996059 9814 raft_consensus.cc:2229] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:44.996204 9814 raft_consensus.cc:2258] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:44.996714 9814 ts_tablet_manager.cc:1905] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.002954 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919 (DEFAULT_TABLE table=default.Table_b5f2ef84e1d5493197263d4c75351a01 [id=d894c6c5ba6546fda50ae25e110d8345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.003381 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.013373 9529 tablet_service.cc:1467] Processing CreateTablet for tablet bcd4b5ce5688410292b32fc11fc03f4e (DEFAULT_TABLE table=default.Table_84295f6ff46b4fee9a2d41e0b2720900 [id=ab8c3ce02c9343e788f5c1d2dccb9aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.013584 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.013778 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd4b5ce5688410292b32fc11fc03f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.013942 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2871c2000c9f41f9ba8145ed0c3ee508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.017750 9533 tablet_service.cc:1467] Processing CreateTablet for tablet e302360c83ec4574b9e6ec621b5c5bc3 (DEFAULT_TABLE table=default.Table_1ba61d5485a7452e96ee458e70e06b38 [id=3c3b0917f409433999fafb7706f1ddd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.018050 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e302360c83ec4574b9e6ec621b5c5bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.018983 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 4cccb5b9c17644cf91971919bd66a82a (DEFAULT_TABLE table=default.Table_aa0fc30f113e4003b8a584c1aece6128 [id=97bac976308f4eb889ebb5ee9480dd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.019251 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cccb5b9c17644cf91971919bd66a82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.020820 9255 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e66f2b273470e88e97ece175d6065 (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.021157 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e66f2b273470e88e97ece175d6065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.021442 9541 tablet_service.cc:1467] Processing CreateTablet for tablet cd36bd6fdd1b48fb827eb879db822cf1 (DEFAULT_TABLE table=default.Table_0d6530474e1842bd86cb8eb17ac76cbe [id=0bdb1438d0024b48b873b4bdaa85bc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.021750 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd36bd6fdd1b48fb827eb879db822cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.021447 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet b339b4e3cfbd40c1a35a4c6083926869 with delete_type TABLET_DATA_DELETED (replaced by tablet 93c0fb8b710c424d8aeaabc83587d597) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.022908 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919 (DEFAULT_TABLE table=default.Table_b5f2ef84e1d5493197263d4c75351a01 [id=d894c6c5ba6546fda50ae25e110d8345]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.023183 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ea8f2fc0c84b108bf34ac3e7d1a919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.025739 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 50b464717caf48bcb81ec8618091d7a9 (DEFAULT_TABLE table=default.Table_6a14097e0acf40e6a81b13806b67983d [id=0c7de59300344cd08e84a97c34174bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.026000 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50b464717caf48bcb81ec8618091d7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.026535 9814 ts_tablet_manager.cc:1918] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.026643 9814 log.cc:1196] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/1e3a9f292618469c8d84da18059419b0
I20260928 14:50:45.026683 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9430a9410f41cc9c3858755a710a99 (DEFAULT_TABLE table=default.Table_c9bfad9c3b884d388ca4743438a34c0d [id=e98aef59f60a403cae71087cb3cca14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.026911 9814 ts_tablet_manager.cc:1939] T 1e3a9f292618469c8d84da18059419b0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:45.026973 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9430a9410f41cc9c3858755a710a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.027590 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1098) took 2099 ms. Trace:
I20260928 14:50:45.027678 9814 rpcz_store.cc:276] 0928 14:50:42.928309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.929001 (+ 692us) service_pool.cc:227] Handling call
0928 14:50:44.995822 (+2066821us) ts_tablet_manager.cc:1145] Deleting tablet 1e3a9f292618469c8d84da18059419b0
0928 14:50:44.995832 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.019414 (+ 23582us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.026466 (+ 7052us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.027571 (+ 1105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2066670}
I20260928 14:50:45.028334 9549 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e66f2b273470e88e97ece175d6065 (DEFAULT_TABLE table=default.Table_6e60e487cf1f4b219f698d44e4fdb1b6 [id=8ecccc88844646c0aa8774b07beb8b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.028599 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e66f2b273470e88e97ece175d6065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.029728 9536 tablet_service.cc:1467] Processing CreateTablet for tablet ee432f8c22ad4134a5a2fb47190fcf48 (DEFAULT_TABLE table=default.Table_4c9961ae311d47e0bb1b02bd1afe6609 [id=9f0044ba4fc9404985d95ca31ef4c2c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.029983 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee432f8c22ad4134a5a2fb47190fcf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.033699 9814 tablet_replica.cc:330] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:45.033720 9542 tablet_service.cc:1467] Processing CreateTablet for tablet fb2e6fd4284946e6bec6688ac522be18 (DEFAULT_TABLE table=default.Table_bbc7f5f92c2447c1a6ba6df83536d05a [id=3ad062eda9fb4bb9ac95267ea11f413c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.033890 9814 raft_consensus.cc:2229] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.033983 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2e6fd4284946e6bec6688ac522be18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.033950 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9430a9410f41cc9c3858755a710a99 (DEFAULT_TABLE table=default.Table_c9bfad9c3b884d388ca4743438a34c0d [id=e98aef59f60a403cae71087cb3cca14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.034036 9814 raft_consensus.cc:2258] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.034304 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9430a9410f41cc9c3858755a710a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.034550 9814 ts_tablet_manager.cc:1905] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.037627 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 05342bec2afe44d3a6e21e19a16091a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.037956 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8 (DEFAULT_TABLE table=default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.038257 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ddaeb45f01494b9efb8c9ee4cd63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.039008 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 8e14c545fca34272b631c4ba26cc5af3 (DEFAULT_TABLE table=default.Table_984254761e7344bbbde3d73a0ca783ea [id=e43130edbf994321a4a0a4ddd3837145]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.039328 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e14c545fca34272b631c4ba26cc5af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.041656 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 2014e5f360ee46b895ae0b0c621a6f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.042055 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c (DEFAULT_TABLE table=default.Table_d7c89464ff7a4f1e92b4d5078c6ed54e [id=a5ae6b115ca8493991add2545755adde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.042407 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.044675 11346 raft_consensus.cc:482] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.044797 11346 raft_consensus.cc:504] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.045444 11346 leader_election.cc:288] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.045640 9540 tablet_service.cc:1514] Processing DeleteTablet for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.046038 9544 tablet_service.cc:1467] Processing CreateTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 (DEFAULT_TABLE table=default.Table_3499650ce231436095c708ac28e8970d [id=40aa526cc2e245a8a9adea28e2a15537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.046237 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e4f703cc19c453cbc46432a4430a204 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e975a709ce14064a2d4f4af21d22633) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.046378 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de77b0bec60a4ebbb0a1b6f779eaaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.049649 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.049870 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:45.050443 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e4f703cc19c453cbc46432a4430a204 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e975a709ce14064a2d4f4af21d22633) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.051043 11111 raft_consensus.cc:482] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.051187 11111 raft_consensus.cc:504] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.051777 11111 leader_election.cc:288] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:45.053580 9498 leader_election.cc:341] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.053696 9498 leader_election.cc:302] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.054731 11346 raft_consensus.cc:2726] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.058037 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:45.059118 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.059301 9537 tablet_service.cc:1467] Processing CreateTablet for tablet d6b0563370744b0fac2e75499803cfb3 (DEFAULT_TABLE table=default.Table_4cb83b9d56df409dbed6569e1a6ac95d [id=384e0b17f11c43c6ae7a33f4177bb673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.059701 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 200632864b62451b9174676bb07b9bb4 (DEFAULT_TABLE table=default.Table_496a2bee552243288885986e6448b485 [id=e9616ee689ef4927a47793b145557952]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.060616 9498 leader_election.cc:341] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.061018 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dd30e15c31498299ca5f5a3b2770e9" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:45.061513 9497 leader_election.cc:341] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.061631 9497 leader_election.cc:302] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.061944 11303 raft_consensus.cc:2726] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.065974 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6b0563370744b0fac2e75499803cfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.068935 9814 ts_tablet_manager.cc:1918] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.069034 9814 log.cc:1196] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:45.069036 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 8e14c545fca34272b631c4ba26cc5af3 (DEFAULT_TABLE table=default.Table_984254761e7344bbbde3d73a0ca783ea [id=e43130edbf994321a4a0a4ddd3837145]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.069307 10975 raft_consensus.cc:482] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.069448 10975 raft_consensus.cc:504] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.070130 10975 leader_election.cc:288] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.070461 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e14c545fca34272b631c4ba26cc5af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.070930 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622a7af04be44ddebc1af16fcc6325ae" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.071348 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 0a20e579c7e74c5b84fc1d5e03b4d928 (DEFAULT_TABLE table=default.Table_be46200ec11c4f5a9a2f47854bed77a4 [id=80fab7753f4745ecbd4df38e852a2a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.071808 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a20e579c7e74c5b84fc1d5e03b4d928. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:45.075639 9220 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.069310 9814 ts_tablet_manager.cc:1939] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:45.076462 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1097) took 2148 ms. Trace:
I20260928 14:50:45.076556 9814 rpcz_store.cc:276] 0928 14:50:42.927877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:42.939710 (+ 11833us) service_pool.cc:227] Handling call
0928 14:50:45.033654 (+2093944us) ts_tablet_manager.cc:1145] Deleting tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b
0928 14:50:45.033666 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.066143 (+ 32477us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.068860 (+ 2717us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.076442 (+ 7582us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2050376}
I20260928 14:50:45.078372 9814 tablet_replica.cc:330] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:45.078565 9814 raft_consensus.cc:2229] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.078719 9814 raft_consensus.cc:2258] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.079216 9814 ts_tablet_manager.cc:1905] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.083932 9262 tablet_service.cc:1467] Processing CreateTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 (DEFAULT_TABLE table=default.Table_d7270bcdf2fd41f59e502b5bbe93cd19 [id=2f444af9ccd44795bdb9625d1dab53da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.084288 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39c67a1cf4c4a97af85aaf0484835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.094986 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 37a88328ce824b66b682df561cc307c3 (DEFAULT_TABLE table=default.Table_dd796afb3f1c4d0e954db5c51225c5fa [id=864df1be84b348959b1603a0157302bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.095469 9534 tablet_service.cc:1467] Processing CreateTablet for tablet d321d64ad40645c8979d28a69ee3bab4 (DEFAULT_TABLE table=default.Table_13e05569d38a40b081e20e2d67cb1f12 [id=75a0cd0aeff44c66a9c74b10b16bc889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.096251 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 00b65284d7da4ee186d228c64a4013d6 (DEFAULT_TABLE table=default.Table_272ae048ec1e43cd95fdc4772c5a38a3 [id=0bb2ebcf91e943cdaba32e8f1f21d780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.096566 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 7d4c0c27736e497a8967b68fb11de945 (DEFAULT_TABLE table=default.Table_69628778959040419e3a0f0be17e29ec [id=458b319bce874b1f8b36f8a7d22f6c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.096961 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d4c0c27736e497a8967b68fb11de945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.097095 9548 tablet_service.cc:1467] Processing CreateTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 (DEFAULT_TABLE table=default.Table_d7270bcdf2fd41f59e502b5bbe93cd19 [id=2f444af9ccd44795bdb9625d1dab53da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.098627 9538 tablet_service.cc:1514] Processing DeleteTablet for tablet 0728defd0fb44c37bb8aa1e18825f3f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.100055 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200632864b62451b9174676bb07b9bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.105099 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:45.105473 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:45.105912 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_978ad5acfb5443d696539c6b347ebb2b [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 3 got 2
I20260928 14:50:45.108251 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d321d64ad40645c8979d28a69ee3bab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.114089 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 0868e5ce22874134a2f50e2404970bb8 (table default.Table_978ad5acfb5443d696539c6b347ebb2b [id=066bd906e956423ea4fb9370314cfbd2]). Expected version 3 got 2
I20260928 14:50:45.114758 11362 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:45.116108 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_89970becf7bb4f1da02b5d175b4af221"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.116794 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89970becf7bb4f1da02b5d175b4af221 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.119125 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00b65284d7da4ee186d228c64a4013d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.119283 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_57e9cd68a9ee4659b9ad597f46bf83ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.119787 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57e9cd68a9ee4659b9ad597f46bf83ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.121011 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fed64561dbc24fbf960eabea8c2db568" } modify_external_catalogs: true
I20260928 14:50:45.121119 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39c67a1cf4c4a97af85aaf0484835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.121285 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fed64561dbc24fbf960eabea8c2db568" } modify_external_catalogs: true
I20260928 14:50:45.126398 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a88328ce824b66b682df561cc307c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.130734 9814 ts_tablet_manager.cc:1918] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.130927 9814 log.cc:1196] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/24b256211679481eb0e0309c56ff60c6
I20260928 14:50:45.132277 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 220eb184524b4cd58a4642dbbed5e9d8
I20260928 14:50:45.124454 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1e56500a46c047c2ad46ded3512d20ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:45.133599 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:45.133708 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e56500a46c047c2ad46ded3512d20ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:45.134626 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 220eb184524b4cd58a4642dbbed5e9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 220eb184524b4cd58a4642dbbed5e9d8 already in progress: creating tablet
I20260928 14:50:45.135079 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 45d3856100a14bb1bf2ae182214fddf4 (DEFAULT_TABLE table=default.Table_21325fac865e4186aaab85da75813b38 [id=c4a194ceba7045f6bd9a3da17a331a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.135478 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d3856100a14bb1bf2ae182214fddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.136719 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 045be7627e34491b9f37706b53eeaa69 (DEFAULT_TABLE table=default.Table_d3027d35337d473da5ba0b110ddbfcbd [id=e3819656e97848868f45ce3e0e573dc9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.136783 9220 consensus_peers.cc:487] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:45.137042 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045be7627e34491b9f37706b53eeaa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.139853 11378 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:45.141075 9815 ts_tablet_manager.cc:1939] T 58bb9c7fc599425484fd3fc0b94f3a8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.141913 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1127) took 1836 ms. Trace:
I20260928 14:50:45.142012 9815 rpcz_store.cc:276] 0928 14:50:43.305745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.305817 (+ 72us) service_pool.cc:227] Handling call
0928 14:50:44.727784 (+1421967us) ts_tablet_manager.cc:1145] Deleting tablet 58bb9c7fc599425484fd3fc0b94f3a8c
0928 14:50:44.727798 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:44.763183 (+ 35385us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:44.922815 (+159632us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.141892 (+219077us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4868,"tablet-delete.queue_time_us":1421765}
I20260928 14:50:45.142511 10975 raft_consensus.cc:482] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.142634 10975 raft_consensus.cc:504] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.142787 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1131) took 1541 ms. Trace:
I20260928 14:50:45.142920 9815 rpcz_store.cc:276] 0928 14:50:43.601854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.601902 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:45.142549 (+1540647us) ts_tablet_manager.cc:1145] Deleting tablet 19a668806adc4975bebb4ebb1a9d3c82
0928 14:50:45.142588 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.142746 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540474}
I20260928 14:50:45.143255 10975 leader_election.cc:288] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.143599 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1130) took 1542 ms. Trace:
I20260928 14:50:45.143744 9426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a6755b697134b8e90e457b554b9599c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.143718 9815 rpcz_store.cc:276] 0928 14:50:43.601382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.602687 (+ 1305us) service_pool.cc:227] Handling call
0928 14:50:45.143414 (+1540727us) ts_tablet_manager.cc:1145] Deleting tablet a5eb8907be064167a3739715d24c94e9
0928 14:50:45.143447 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.143582 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540533}
W20260928 14:50:45.144178 9220 leader_election.cc:341] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.144371 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1133) took 1419 ms. Trace:
I20260928 14:50:45.145200 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 0a20e579c7e74c5b84fc1d5e03b4d928 (DEFAULT_TABLE table=default.Table_be46200ec11c4f5a9a2f47854bed77a4 [id=80fab7753f4745ecbd4df38e852a2a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.144605 9815 rpcz_store.cc:276] 0928 14:50:43.724594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.725636 (+ 1042us) service_pool.cc:227] Handling call
0928 14:50:45.144190 (+1418554us) ts_tablet_manager.cc:1145] Deleting tablet 6f73568a67cb401388beaa266a0324fc
0928 14:50:45.144223 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.144354 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418397}
I20260928 14:50:45.145604 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a20e579c7e74c5b84fc1d5e03b4d928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.145612 9406 tablet_service.cc:1467] Processing CreateTablet for tablet a81108d19ab34014bc71245ae98e4a6d (DEFAULT_TABLE table=default.Table_deaec7dc095d4ecbba6dc7f7082aee96 [id=17c7b49a2e114c9e92b0e368f4384461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.146029 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a81108d19ab34014bc71245ae98e4a6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:45.146705 9220 consensus_peers.cc:487] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:45.149727 9814 ts_tablet_manager.cc:1939] T 24b256211679481eb0e0309c56ff60c6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:45.150449 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1120) took 1646 ms. Trace:
I20260928 14:50:45.150544 9814 rpcz_store.cc:276] 0928 14:50:43.504430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.505580 (+ 1150us) service_pool.cc:227] Handling call
0928 14:50:45.078330 (+1572750us) ts_tablet_manager.cc:1145] Deleting tablet 24b256211679481eb0e0309c56ff60c6
0928 14:50:45.078340 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.089373 (+ 11033us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.130635 (+ 41262us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.150431 (+ 19796us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1572520}
I20260928 14:50:45.150933 9814 tablet_replica.cc:330] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:45.151211 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_415acab6842745adb711bc6992d57aed" } modify_external_catalogs: true
I20260928 14:50:45.151434 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_415acab6842745adb711bc6992d57aed" } modify_external_catalogs: true
I20260928 14:50:45.151613 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_eaa64bfb59d24da6a26c2aa26935864b" } new_table_name: "default.Table_542d973cf27c4899a24e4e9982de6ff2" modify_external_catalogs: true
I20260928 14:50:45.152663 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1182be7988c347c290306523abc75e4c" } new_table_name: "default.Table_fb673ff2f0e343cbb8fb2adab2e6e063" modify_external_catalogs: true
I20260928 14:50:45.152789 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fb80509526ea4cbdb0f2308e95138278" } modify_external_catalogs: true
I20260928 14:50:45.153091 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fb80509526ea4cbdb0f2308e95138278" } modify_external_catalogs: true
I20260928 14:50:45.158638 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 6d467e52cb104289a13b580c2f1a73bb (DEFAULT_TABLE table=default.Table_07605c4032844711b41d39435f0194a3 [id=78ddc6a10c6a4b4d8f661e93973a4a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.159011 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d467e52cb104289a13b580c2f1a73bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:45.159828 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1131ee7f0ee4906be478cb5317719b3 consensus state has no leader
I20260928 14:50:45.159937 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2137c02d796a4290a8b160c57069fdd2
I20260928 14:50:45.160642 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 2137c02d796a4290a8b160c57069fdd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:45.161341 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2137c02d796a4290a8b160c57069fdd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2137c02d796a4290a8b160c57069fdd2 already in progress: creating tablet
I20260928 14:50:45.161418 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 38b0ec423eaf4720993c9dcde58f23e6 (DEFAULT_TABLE table=default.Table_92dcb0d682fc43e482536a941dd8b135 [id=8b3610640ac94d559307b420e8725419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.161757 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b0ec423eaf4720993c9dcde58f23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.163470 9398 tablet_service.cc:1467] Processing CreateTablet for tablet a652ac1034c74afaa627a9d3edfcc34d (DEFAULT_TABLE table=default.Table_d8ef185fa3b84d43a783f18d2e04e880 [id=92a8d12a677f48f6bea6edf2e5c03e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.163769 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a652ac1034c74afaa627a9d3edfcc34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.165766 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 6e975a709ce14064a2d4f4af21d22633 (DEFAULT_TABLE table=default.Table_712e858037a84d03a2f09ca4ae764c1d [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.166059 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e975a709ce14064a2d4f4af21d22633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.173516 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 19a668806adc4975bebb4ebb1a9d3c82 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:45.173979 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aebb279ecc924ab1a9d84f88c0382acb consensus state has no leader
I20260928 14:50:45.174567 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 41b8584ba1914c3390aee99baaee289e (table default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]) successfully deleted
I20260928 14:50:45.175083 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 1e3a9f292618469c8d84da18059419b0 (table default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]) successfully deleted
I20260928 14:50:45.175534 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (table default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]) successfully deleted
I20260928 14:50:45.176137 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 24b256211679481eb0e0309c56ff60c6 (table default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]) successfully deleted
W20260928 14:50:45.177261 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 244275us
I20260928 14:50:45.180668 11228 raft_consensus.cc:482] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.180783 11228 raft_consensus.cc:504] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.181294 11228 leader_election.cc:288] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.182109 11228 raft_consensus.cc:482] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.182243 9814 raft_consensus.cc:2229] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.182420 9814 raft_consensus.cc:2258] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.182315 11228 raft_consensus.cc:504] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.182932 11228 leader_election.cc:288] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.183039 9814 ts_tablet_manager.cc:1905] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.183099 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.183409 9422 raft_consensus.cc:3037] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:45.184154 9220 consensus_peers.cc:487] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82b9dad76ac94a03811e4793e0234aad. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:45.184335 9220 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.184836 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d6975813b744fb80dcc432cec61cb4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.185400 9220 leader_election.cc:341] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.189934 9855 tablet_bootstrap.cc:492] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.190111 9855 ts_tablet_manager.cc:1397] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.441s user 0.011s sys 0.004s
I20260928 14:50:45.191354 9855 raft_consensus.cc:348] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.191829 9855 raft_consensus.cc:374] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.192034 9855 raft_consensus.cc:729] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.192473 9855 consensus_queue.cc:260] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.193857 9855 ts_tablet_manager.cc:1428] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:45.195132 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a (DEFAULT_TABLE table=default.Table_7c4af055532746f8b4b4a9f82b803099 [id=b023c2d26d2546fb87dc72e7c5c3d95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.195947 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 93c0fb8b710c424d8aeaabc83587d597 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.196307 9396 tablet_service.cc:1467] Processing CreateTablet for tablet edc400ca4bb5474f9a721b0180001177 (DEFAULT_TABLE table=default.Table_ad468fb701f64828b8a6f4c732ae8c3a [id=28e30d2c84af41358d973ef505bb87af]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.197781 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 137209us
W20260928 14:50:45.198035 9360 leader_election.cc:341] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6e5ad3ee185f47c3b8b3deb4ac354f51
I20260928 14:50:45.198182 9360 leader_election.cc:302] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:45.198429 9360 raft_consensus.cc:2670] T 6e5ad3ee185f47c3b8b3deb4ac354f51 P ae832871bd1142f7af10c084115ffc12: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:45.199087 9360 leader_election.cc:302] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:45.199345 11111 raft_consensus.cc:2726] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.199949 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d4ff58de6c794b5ba7b44201800592d2 (DEFAULT_TABLE table=default.Table_84c246878fa24a1ca4ac14c7ca79efea [id=0f3fe1c6f9ec4c2d906f5534ca8101d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.203673 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.203902 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc400ca4bb5474f9a721b0180001177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.204950 9564 raft_consensus.cc:1261] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:45.205094 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0904b4dbbbd2417a88cba0e67e5a31a4
I20260928 14:50:45.207831 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.208909 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c0fb8b710c424d8aeaabc83587d597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.208941 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 45d3856100a14bb1bf2ae182214fddf4 (DEFAULT_TABLE table=default.Table_21325fac865e4186aaab85da75813b38 [id=c4a194ceba7045f6bd9a3da17a331a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.209599 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.209625 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 7d4c0c27736e497a8967b68fb11de945 (DEFAULT_TABLE table=default.Table_69628778959040419e3a0f0be17e29ec [id=458b319bce874b1f8b36f8a7d22f6c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.210017 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 220eb184524b4cd58a4642dbbed5e9d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:45.210165 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0904b4dbbbd2417a88cba0e67e5a31a4 already in progress: creating tablet
I20260928 14:50:45.210985 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 45d3856100a14bb1bf2ae182214fddf4 (DEFAULT_TABLE table=default.Table_21325fac865e4186aaab85da75813b38 [id=c4a194ceba7045f6bd9a3da17a331a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.211248 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ff58de6c794b5ba7b44201800592d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.212025 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 045be7627e34491b9f37706b53eeaa69 (DEFAULT_TABLE table=default.Table_d3027d35337d473da5ba0b110ddbfcbd [id=e3819656e97848868f45ce3e0e573dc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.213075 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1134) took 1487 ms. Trace:
I20260928 14:50:45.213164 9815 rpcz_store.cc:276] 0928 14:50:43.725940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.730173 (+ 4233us) service_pool.cc:227] Handling call
0928 14:50:45.146106 (+1415933us) ts_tablet_manager.cc:1145] Deleting tablet 5d8e4357c3d5487fa76e1e49c6cb7547
0928 14:50:45.146126 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.213056 (+ 66930us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415669}
I20260928 14:50:45.213742 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d3856100a14bb1bf2ae182214fddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.214578 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 045be7627e34491b9f37706b53eeaa69 (DEFAULT_TABLE table=default.Table_d3027d35337d473da5ba0b110ddbfcbd [id=e3819656e97848868f45ce3e0e573dc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.215529 9255 tablet_service.cc:1467] Processing CreateTablet for tablet a81108d19ab34014bc71245ae98e4a6d (DEFAULT_TABLE table=default.Table_deaec7dc095d4ecbba6dc7f7082aee96 [id=17c7b49a2e114c9e92b0e368f4384461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.215713 11228 consensus_queue.cc:1035] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:45.216480 9541 tablet_service.cc:1467] Processing CreateTablet for tablet a81108d19ab34014bc71245ae98e4a6d (DEFAULT_TABLE table=default.Table_deaec7dc095d4ecbba6dc7f7082aee96 [id=17c7b49a2e114c9e92b0e368f4384461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.218248 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 2137c02d796a4290a8b160c57069fdd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.218951 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 2137c02d796a4290a8b160c57069fdd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.219766 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 6d467e52cb104289a13b580c2f1a73bb (DEFAULT_TABLE table=default.Table_07605c4032844711b41d39435f0194a3 [id=78ddc6a10c6a4b4d8f661e93973a4a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.221572 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 38b0ec423eaf4720993c9dcde58f23e6 (DEFAULT_TABLE table=default.Table_92dcb0d682fc43e482536a941dd8b135 [id=8b3610640ac94d559307b420e8725419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.222417 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 6e975a709ce14064a2d4f4af21d22633 (DEFAULT_TABLE table=default.Table_712e858037a84d03a2f09ca4ae764c1d [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.225107 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 7d4c0c27736e497a8967b68fb11de945 (DEFAULT_TABLE table=default.Table_69628778959040419e3a0f0be17e29ec [id=458b319bce874b1f8b36f8a7d22f6c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.228889 9564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:45.229077 9564 raft_consensus.cc:2454] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:45.231204 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a81108d19ab34014bc71245ae98e4a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.235083 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 58bb9c7fc599425484fd3fc0b94f3a8c (table default.Table_dad1b85ab48345fbb7e8642eed1cc48d [id=35bead5cfc8549dc874c2ddd78a10fa9]) successfully deleted
W20260928 14:50:45.237185 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 19a668806adc4975bebb4ebb1a9d3c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19a668806adc4975bebb4ebb1a9d3c82 already in progress: creating tablet
W20260928 14:50:45.237985 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a5eb8907be064167a3739715d24c94e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5eb8907be064167a3739715d24c94e9 already in progress: creating tablet
W20260928 14:50:45.238713 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6f73568a67cb401388beaa266a0324fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f73568a67cb401388beaa266a0324fc already in progress: creating tablet
W20260928 14:50:45.239434 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d8e4357c3d5487fa76e1e49c6cb7547 already in progress: creating tablet
I20260928 14:50:45.241068 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f2f8216afaf94e34a8b155f58feca084"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.242640 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2f8216afaf94e34a8b155f58feca084 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.243788 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e2ac8d527e8f4da3a6936cbc70d62972"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.244314 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2ac8d527e8f4da3a6936cbc70d62972 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.244673 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf" } modify_external_catalogs: true
I20260928 14:50:45.245934 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c03ebae35c8140d3a70d796eaea31cf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.246443 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c03ebae35c8140d3a70d796eaea31cf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.247148 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_48e38a1afbb64c24911cd087a3bb9861" } modify_external_catalogs: true
I20260928 14:50:45.248577 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d5ddea2bf7a347278afc8c7e3cf9510c" } new_table_name: "default.Table_bed94a8b7b8144308d35c07dce3ef422" modify_external_catalogs: true
I20260928 14:50:45.256551 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c5f832e990de4254b20d4c6516c0773a" } new_table_name: "default.Table_c045d82b1980402990bbb2d9b475ce5f" modify_external_catalogs: true
I20260928 14:50:45.257081 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ccef6d9b32734860a9f8a5b9c4221450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.257761 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccef6d9b32734860a9f8a5b9c4221450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.260485 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_26700e2b9cae48c296507a8cdd745db0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.261117 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26700e2b9cae48c296507a8cdd745db0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.263444 9855 tablet_bootstrap.cc:492] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.265471 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6b217bb2fcfb41e3811aee74e67c9324"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.266064 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b217bb2fcfb41e3811aee74e67c9324 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.272886 9548 tablet_service.cc:1467] Processing CreateTablet for tablet a652ac1034c74afaa627a9d3edfcc34d (DEFAULT_TABLE table=default.Table_d8ef185fa3b84d43a783f18d2e04e880 [id=92a8d12a677f48f6bea6edf2e5c03e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.273268 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a652ac1034c74afaa627a9d3edfcc34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.278568 9425 raft_consensus.cc:3037] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:45.280490 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a (DEFAULT_TABLE table=default.Table_7c4af055532746f8b4b4a9f82b803099 [id=b023c2d26d2546fb87dc72e7c5c3d95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.280911 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.286321 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d3856100a14bb1bf2ae182214fddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.286494 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d467e52cb104289a13b580c2f1a73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.289711 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b0ec423eaf4720993c9dcde58f23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.289920 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d4c0c27736e497a8967b68fb11de945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.292215 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e975a709ce14064a2d4f4af21d22633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.293704 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045be7627e34491b9f37706b53eeaa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.300801 9855 tablet_bootstrap.cc:654] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.305858 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1132) took 1581 ms. Trace:
I20260928 14:50:45.307474 9815 rpcz_store.cc:276] 0928 14:50:43.724465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.772218 (+ 47753us) service_pool.cc:227] Handling call
0928 14:50:45.213516 (+1441298us) ts_tablet_manager.cc:1145] Deleting tablet d604978c5289471a854c9b286d137f61
0928 14:50:45.305725 (+ 92209us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.305843 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1441112}
I20260928 14:50:45.310209 9815 tablet_replica.cc:330] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.312158 9815 raft_consensus.cc:2229] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.312801 11228 consensus_queue.cc:1035] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:45.314952 9219 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 622a7af04be44ddebc1af16fcc6325ae
I20260928 14:50:45.315872 9815 raft_consensus.cc:2258] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.318975 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 38b0ec423eaf4720993c9dcde58f23e6 (DEFAULT_TABLE table=default.Table_92dcb0d682fc43e482536a941dd8b135 [id=8b3610640ac94d559307b420e8725419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.319401 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045be7627e34491b9f37706b53eeaa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.319555 9815 ts_tablet_manager.cc:1905] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.320458 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 6d467e52cb104289a13b580c2f1a73bb (DEFAULT_TABLE table=default.Table_07605c4032844711b41d39435f0194a3 [id=78ddc6a10c6a4b4d8f661e93973a4a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.320489 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 6e975a709ce14064a2d4f4af21d22633 (DEFAULT_TABLE table=default.Table_712e858037a84d03a2f09ca4ae764c1d [id=0a9cf252113942b39bbadfbb2134b8bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.320834 9254 tablet_service.cc:1467] Processing CreateTablet for tablet a652ac1034c74afaa627a9d3edfcc34d (DEFAULT_TABLE table=default.Table_d8ef185fa3b84d43a783f18d2e04e880 [id=92a8d12a677f48f6bea6edf2e5c03e20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.321231 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a (DEFAULT_TABLE table=default.Table_7c4af055532746f8b4b4a9f82b803099 [id=b023c2d26d2546fb87dc72e7c5c3d95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.321674 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 93c0fb8b710c424d8aeaabc83587d597 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.328293 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_48e38a1afbb64c24911cd087a3bb9861" } modify_external_catalogs: true
I20260928 14:50:45.339424 11303 raft_consensus.cc:482] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.339536 11303 raft_consensus.cc:504] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.339565 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ee3a4bfaf20141d4a8b95016f86d8dbf" } modify_external_catalogs: true
I20260928 14:50:45.340024 11303 leader_election.cc:288] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.340932 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:45.341593 9497 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.343724 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet 3bef7b73d24a42979fcb7a2e47e92919 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:45.344400 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ae8348f77764a5e8787a33f657ca80d consensus state has no leader
I20260928 14:50:45.347656 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:45.350920 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 87d038f4cb0c48f3b4cc6ff66621bb2b
I20260928 14:50:45.351281 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.351657 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:45.351990 9498 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.352087 9498 leader_election.cc:302] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.352398 11303 raft_consensus.cc:2726] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:45.352636 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d038f4cb0c48f3b4cc6ff66621bb2b already in progress: creating tablet
I20260928 14:50:45.362528 9258 tablet_service.cc:1467] Processing CreateTablet for tablet d4ff58de6c794b5ba7b44201800592d2 (DEFAULT_TABLE table=default.Table_84c246878fa24a1ca4ac14c7ca79efea [id=0f3fe1c6f9ec4c2d906f5534ca8101d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.362600 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.362762 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 93c0fb8b710c424d8aeaabc83587d597 (DEFAULT_TABLE table=default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.363976 9542 tablet_service.cc:1467] Processing CreateTablet for tablet edc400ca4bb5474f9a721b0180001177 (DEFAULT_TABLE table=default.Table_ad468fb701f64828b8a6f4c732ae8c3a [id=28e30d2c84af41358d973ef505bb87af]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.364902 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d604978c5289471a854c9b286d137f61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604978c5289471a854c9b286d137f61 already in progress: creating tablet
I20260928 14:50:45.365562 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.366474 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.366945 11362 tablet.cc:1722] T 01dd30e15c31498299ca5f5a3b2770e9 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:45.372085 9545 tablet_service.cc:1467] Processing CreateTablet for tablet d4ff58de6c794b5ba7b44201800592d2 (DEFAULT_TABLE table=default.Table_84c246878fa24a1ca4ac14c7ca79efea [id=0f3fe1c6f9ec4c2d906f5534ca8101d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.372360 9848 tablet_bootstrap.cc:492] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.372447 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c0fb8b710c424d8aeaabc83587d597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.372568 9848 ts_tablet_manager.cc:1397] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.407s user 0.071s sys 0.102s
I20260928 14:50:45.373770 9848 raft_consensus.cc:348] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.362231 9267 tablet_service.cc:1467] Processing CreateTablet for tablet edc400ca4bb5474f9a721b0180001177 (DEFAULT_TABLE table=default.Table_ad468fb701f64828b8a6f4c732ae8c3a [id=28e30d2c84af41358d973ef505bb87af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.374120 9848 raft_consensus.cc:374] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.374341 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ff58de6c794b5ba7b44201800592d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.374384 9848 raft_consensus.cc:729] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.374791 9848 consensus_queue.cc:260] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.375336 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc400ca4bb5474f9a721b0180001177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.375640 9848 ts_tablet_manager.cc:1428] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:45.317746 9219 leader_election.cc:302] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.376899 11371 raft_consensus.cc:2726] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:45.377609 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 62665.7us
I20260928 14:50:45.378113 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d467e52cb104289a13b580c2f1a73bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.385504 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4ff58de6c794b5ba7b44201800592d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.385957 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a81108d19ab34014bc71245ae98e4a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.386451 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e975a709ce14064a2d4f4af21d22633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.387822 9851 tablet_bootstrap.cc:492] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:45.387926 9851 ts_tablet_manager.cc:1397] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.440s user 0.013s sys 0.013s
I20260928 14:50:45.388720 9851 raft_consensus.cc:348] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.388902 9851 raft_consensus.cc:374] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.388947 9851 raft_consensus.cc:729] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.389132 9851 consensus_queue.cc:260] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.389622 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d4c0c27736e497a8967b68fb11de945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.389670 9851 ts_tablet_manager.cc:1428] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:45.389916 9851 tablet_bootstrap.cc:492] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:45.393663 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4394f50d9c4d47bdf56b8c9cafb19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.394979 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.396865 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a652ac1034c74afaa627a9d3edfcc34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.397356 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b0ec423eaf4720993c9dcde58f23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.397398 9855 tablet_bootstrap.cc:492] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.397512 9855 ts_tablet_manager.cc:1397] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.135s user 0.001s sys 0.008s
I20260928 14:50:45.398106 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c0fb8b710c424d8aeaabc83587d597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.398131 9855 raft_consensus.cc:348] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.398437 9855 raft_consensus.cc:374] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.398494 9855 raft_consensus.cc:729] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.398672 9855 consensus_queue.cc:260] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.398818 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc400ca4bb5474f9a721b0180001177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.399158 9855 ts_tablet_manager.cc:1428] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:45.401965 9814 ts_tablet_manager.cc:1918] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.402073 9814 log.cc:1196] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:45.402354 9814 ts_tablet_manager.cc:1939] T f28a74dc0afe4f20b47139a703550ef6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:45.402688 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1121) took 1898 ms. Trace:
I20260928 14:50:45.402768 9814 rpcz_store.cc:276] 0928 14:50:43.504541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.505831 (+ 1290us) service_pool.cc:227] Handling call
0928 14:50:45.150894 (+1645063us) ts_tablet_manager.cc:1145] Deleting tablet f28a74dc0afe4f20b47139a703550ef6
0928 14:50:45.150904 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.323081 (+172177us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.401871 (+ 78790us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.402644 (+ 773us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1644918}
I20260928 14:50:45.403079 9814 tablet_replica.cc:330] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:45.403251 9814 raft_consensus.cc:2229] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.403371 9814 raft_consensus.cc:2258] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.403831 9814 ts_tablet_manager.cc:1905] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.412850 9855 tablet_bootstrap.cc:492] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.420073 9855 tablet_bootstrap.cc:654] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.426457 9815 ts_tablet_manager.cc:1918] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.427263 9815 log.cc:1196] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e5cb151d58f545d9b1e6f652a0627ab9
I20260928 14:50:45.428011 11378 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:45.428689 11228 raft_consensus.cc:482] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.428798 11228 raft_consensus.cc:504] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.429312 11228 leader_election.cc:288] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.429437 9815 ts_tablet_manager.cc:1939] T e5cb151d58f545d9b1e6f652a0627ab9 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.430022 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f28a74dc0afe4f20b47139a703550ef6 (table default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]) successfully deleted
I20260928 14:50:45.430078 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7376f56883dc4032b120cc4494fa8936" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.430624 9220 leader_election.cc:341] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.431155 11362 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:45.431663 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1136) took 1648 ms. Trace:
I20260928 14:50:45.432272 9815 rpcz_store.cc:276] 0928 14:50:43.783134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.783191 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:45.310162 (+1526971us) ts_tablet_manager.cc:1145] Deleting tablet e5cb151d58f545d9b1e6f652a0627ab9
0928 14:50:45.310173 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.356161 (+ 45988us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.425948 (+ 69787us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.431424 (+ 5476us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1526622}
I20260928 14:50:45.434514 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e5cb151d58f545d9b1e6f652a0627ab9 (table default.Table_8b65474a1b4b4d50bdce1171e7645814 [id=74184a3b7e154ab8aba9191c450de754]) successfully deleted
I20260928 14:50:45.434779 9815 tablet_replica.cc:330] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.436271 9815 raft_consensus.cc:2229] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.437311 9815 raft_consensus.cc:2258] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.442031 9815 ts_tablet_manager.cc:1905] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.454936 9848 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.456400 9848 tablet_bootstrap.cc:654] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.458258 9855 tablet_bootstrap.cc:492] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.458386 9855 ts_tablet_manager.cc:1397] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.002s
I20260928 14:50:45.459095 9855 raft_consensus.cc:348] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.459296 9855 raft_consensus.cc:374] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.459354 9855 raft_consensus.cc:729] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.459532 9855 consensus_queue.cc:260] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.460139 9855 ts_tablet_manager.cc:1428] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:45.461340 9855 tablet_bootstrap.cc:492] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.462529 9855 tablet_bootstrap.cc:654] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.473040 9848 tablet_bootstrap.cc:492] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.473188 9848 ts_tablet_manager.cc:1397] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.009s
I20260928 14:50:45.473822 9848 raft_consensus.cc:348] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.474084 9848 raft_consensus.cc:374] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.474195 9848 raft_consensus.cc:729] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.474428 9848 consensus_queue.cc:260] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.475025 9848 ts_tablet_manager.cc:1428] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:45.475296 9848 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.476428 9855 tablet_bootstrap.cc:492] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.476590 9855 ts_tablet_manager.cc:1397] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260928 14:50:45.476876 9848 tablet_bootstrap.cc:654] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.477257 9855 raft_consensus.cc:348] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.477449 9855 raft_consensus.cc:374] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.477504 9855 raft_consensus.cc:729] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.477754 9855 consensus_queue.cc:260] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.478225 9855 ts_tablet_manager.cc:1428] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:45.478446 9855 tablet_bootstrap.cc:492] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.479602 9855 tablet_bootstrap.cc:654] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.493320 9848 tablet_bootstrap.cc:492] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.493503 9848 ts_tablet_manager.cc:1397] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260928 14:50:45.494182 9848 raft_consensus.cc:348] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.494437 9848 raft_consensus.cc:374] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.494526 9848 raft_consensus.cc:729] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.494760 9848 consensus_queue.cc:260] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.495273 9848 ts_tablet_manager.cc:1428] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:45.497673 9848 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.499023 9848 tablet_bootstrap.cc:654] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.500160 9814 ts_tablet_manager.cc:1918] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.500334 9814 log.cc:1196] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:45.500821 9814 ts_tablet_manager.cc:1939] T bc47ae6fbfca4fc0b0b053d0134a49d0 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:45.501197 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1122) took 1996 ms. Trace:
I20260928 14:50:45.501331 9814 rpcz_store.cc:276] 0928 14:50:43.504627 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.506003 (+ 1376us) service_pool.cc:227] Handling call
0928 14:50:45.403034 (+1897031us) ts_tablet_manager.cc:1145] Deleting tablet bc47ae6fbfca4fc0b0b053d0134a49d0
0928 14:50:45.403044 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.446526 (+ 43482us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.500054 (+ 53528us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.501181 (+ 1127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896919}
I20260928 14:50:45.513401 9848 tablet_bootstrap.cc:492] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.513590 9848 ts_tablet_manager.cc:1397] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.002s
I20260928 14:50:45.514552 9848 raft_consensus.cc:348] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.514803 9848 raft_consensus.cc:374] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.514897 9848 raft_consensus.cc:729] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.515120 9848 consensus_queue.cc:260] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.516007 9848 ts_tablet_manager.cc:1428] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:45.516709 9848 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.518478 9848 tablet_bootstrap.cc:654] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.520045 9855 tablet_bootstrap.cc:492] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.520169 9855 ts_tablet_manager.cc:1397] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260928 14:50:45.520805 9855 raft_consensus.cc:348] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.520999 9855 raft_consensus.cc:374] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.521044 9855 raft_consensus.cc:729] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.521209 9855 consensus_queue.cc:260] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.521812 9855 ts_tablet_manager.cc:1428] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:45.522325 9855 tablet_bootstrap.cc:492] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.524986 9855 tablet_bootstrap.cc:654] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.530279 11111 raft_consensus.cc:482] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.530408 11111 raft_consensus.cc:504] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.530936 11111 leader_election.cc:288] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:45.532446 9360 leader_election.cc:341] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: dc5ee93708ea4f3fabdf93aa9c33c1c8
W20260928 14:50:45.532812 9360 leader_election.cc:341] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:45.532958 9360 leader_election.cc:302] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:45.533350 9848 tablet_bootstrap.cc:492] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.533542 9848 ts_tablet_manager.cc:1397] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
I20260928 14:50:45.533372 11111 raft_consensus.cc:2726] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.534200 9848 raft_consensus.cc:348] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.534359 9848 raft_consensus.cc:374] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.534409 9848 raft_consensus.cc:729] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.534576 9848 consensus_queue.cc:260] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.535094 9848 ts_tablet_manager.cc:1428] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:45.535329 9848 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.536616 9848 tablet_bootstrap.cc:654] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.542529 9855 tablet_bootstrap.cc:492] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.542665 9855 ts_tablet_manager.cc:1397] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260928 14:50:45.543314 9855 raft_consensus.cc:348] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.543512 9855 raft_consensus.cc:374] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.543568 9855 raft_consensus.cc:729] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.543751 9855 consensus_queue.cc:260] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.544245 9855 ts_tablet_manager.cc:1428] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:45.546331 9855 tablet_bootstrap.cc:492] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.549031 9855 tablet_bootstrap.cc:654] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.550395 11362 tablet.cc:1722] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:45.551515 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (table default.Table_6e3dd5704ce1494096b9810b983fc8a9 [id=49157f905fed4cf8936325e4fcb30ae3]) successfully deleted
I20260928 14:50:45.517802 9851 tablet_bootstrap.cc:654] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:45.529675 9219 leader_election.cc:341] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 5a6755b697134b8e90e457b554b9599c
I20260928 14:50:45.534610 11378 tablet.cc:1722] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:45.560912 9219 leader_election.cc:302] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.554008 9814 tablet_replica.cc:330] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:45.564677 11223 raft_consensus.cc:2726] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:45.565083 9219 leader_election.cc:341] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:45.568607 9815 ts_tablet_manager.cc:1918] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.568723 9815 log.cc:1196] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7a70f70162c2433aab5136514bd5fc03
I20260928 14:50:45.569037 9815 ts_tablet_manager.cc:1939] T 7a70f70162c2433aab5136514bd5fc03 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.569399 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4eca68f459834ce2983a27c21361eef3
I20260928 14:50:45.569803 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1137) took 1786 ms. Trace:
I20260928 14:50:45.570062 9815 rpcz_store.cc:276] 0928 14:50:43.783246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.783289 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:45.434489 (+1651200us) ts_tablet_manager.cc:1145] Deleting tablet 7a70f70162c2433aab5136514bd5fc03
0928 14:50:45.434505 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.500626 (+ 66121us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.568506 (+ 67880us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.569782 (+ 1276us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1650880}
I20260928 14:50:45.570969 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eca68f459834ce2983a27c21361eef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.571040 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1135) took 1804 ms. Trace:
I20260928 14:50:45.571673 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7a70f70162c2433aab5136514bd5fc03 (table default.Table_358eb68dfac64e22a67fd5f8e0ce8a2c [id=666ea3e778c24323b14a49f198718eaa]) successfully deleted
I20260928 14:50:45.573004 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eca68f459834ce2983a27c21361eef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:45.573810 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4eca68f459834ce2983a27c21361eef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4eca68f459834ce2983a27c21361eef3 already in progress: creating tablet
I20260928 14:50:45.573757 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ef0baa0c73054cefa825a46f9d497875" } new_table_name: "default.Table_9d75a594efaf464ba848af9f011d0fdc" modify_external_catalogs: true
I20260928 14:50:45.576787 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f7ededd5c0d8482a9b0bfc0f3eafc589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.577301 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7ededd5c0d8482a9b0bfc0f3eafc589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.577610 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_33d213a97ea349d6ab97a84fd1571e6d" } modify_external_catalogs: true
I20260928 14:50:45.577843 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_33d213a97ea349d6ab97a84fd1571e6d" } modify_external_catalogs: true
I20260928 14:50:45.579993 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a3ab57d600bc4a8c9d5ba55a94279177"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.580485 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3ab57d600bc4a8c9d5ba55a94279177 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.581598 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d6b3a014ad054e0b88c6858332ada572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.582003 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6b3a014ad054e0b88c6858332ada572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.587527 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 5e325cbe459440cfa0f3cf9fd026cbb2 (table default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278]). Expected version 1 got 0
I20260928 14:50:45.587775 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 4f54c1b1f9054e1c9adfda720784e5a8 (table default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac]). Expected version 3 got 0
I20260928 14:50:45.588107 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet 01dd30e15c31498299ca5f5a3b2770e9 (table default.Table_c7c519080c7b493ca8249b294e8d446e [id=b58aea2205304defa62befcee84dfa0f]). Expected version 2 got 0
I20260928 14:50:45.571205 9815 rpcz_store.cc:276] 0928 14:50:43.766357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.783577 (+ 17220us) service_pool.cc:227] Handling call
0928 14:50:45.570802 (+1787225us) ts_tablet_manager.cc:1145] Deleting tablet 71ec7763cd5e4578919ce5824eea1329
0928 14:50:45.570817 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.571020 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787021}
I20260928 14:50:45.589793 9815 tablet_replica.cc:330] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
W20260928 14:50:45.590456 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2d455aacada41b7a7315b5aff797a76 consensus state has no leader
I20260928 14:50:45.590663 9815 raft_consensus.cc:2229] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.591800 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3bef7b73d24a42979fcb7a2e47e92919
I20260928 14:50:45.592164 8951 catalog_manager.cc:6565] ReplaceTablet: tablet 3bef7b73d24a42979fcb7a2e47e92919 deleted and replaced by tablet f8c263399eaa479b88f24e74d85618aa
I20260928 14:50:45.592612 9815 raft_consensus.cc:2258] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.592913 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 with delete_type TABLET_DATA_DELETED (replaced by tablet f8c263399eaa479b88f24e74d85618aa) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.593128 9813 tablet_replica.cc:330] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.593139 9815 ts_tablet_manager.cc:1905] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.593312 9813 raft_consensus.cc:2229] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:45.593609 9813 raft_consensus.cc:2258] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.594098 9813 ts_tablet_manager.cc:1905] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.595861 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 with delete_type TABLET_DATA_DELETED (replaced by tablet f8c263399eaa479b88f24e74d85618aa) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:45.596261 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 71ec7763cd5e4578919ce5824eea1329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ec7763cd5e4578919ce5824eea1329 already in progress: creating tablet
I20260928 14:50:45.596822 9848 tablet_bootstrap.cc:492] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.596948 9848 ts_tablet_manager.cc:1397] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.062s user 0.023s sys 0.013s
I20260928 14:50:45.597658 9848 raft_consensus.cc:348] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.597853 9848 raft_consensus.cc:374] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.597898 9848 raft_consensus.cc:729] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.598206 9848 consensus_queue.cc:260] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.572248 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eca68f459834ce2983a27c21361eef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.596894 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bef7b73d24a42979fcb7a2e47e92919 with delete_type TABLET_DATA_DELETED (replaced by tablet f8c263399eaa479b88f24e74d85618aa) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.599136 9219 leader_election.cc:302] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.599427 11223 raft_consensus.cc:2726] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.599552 9848 ts_tablet_manager.cc:1428] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 14:50:45.599788 9219 leader_election.cc:302] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.600004 11223 raft_consensus.cc:2781] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:45.600071 11223 raft_consensus.cc:482] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:45.600131 11223 raft_consensus.cc:3037] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:45.600215 9848 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.600246 9813 ts_tablet_manager.cc:1918] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:45.600457 9813 log.cc:1196] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/3bef7b73d24a42979fcb7a2e47e92919
I20260928 14:50:45.600993 9813 ts_tablet_manager.cc:1939] T 3bef7b73d24a42979fcb7a2e47e92919 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.601912 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]) successfully deleted
I20260928 14:50:45.603721 11223 raft_consensus.cc:504] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.603919 9848 tablet_bootstrap.cc:654] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.604480 11223 leader_election.cc:288] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.605080 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:45.605703 9220 leader_election.cc:341] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.607770 11362 tablet.cc:1717] T 4f54c1b1f9054e1c9adfda720784e5a8 P ae832871bd1142f7af10c084115ffc12: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:45.608660 11378 tablet.cc:1717] T 4f54c1b1f9054e1c9adfda720784e5a8 P 9b4626c584ad47ffaf346e81daff846b: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:45.610234 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1fadca1ccf534c46a7d46f64cd182d7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.610809 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fadca1ccf534c46a7d46f64cd182d7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.612419 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_49b35d3828044e0ea1384f19a5e183f9" } new_table_name: "default.Table_67625d9dc0e24ac0b543eaeb150a11d3" modify_external_catalogs: true
I20260928 14:50:45.612784 11111 raft_consensus.cc:482] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.612901 11111 raft_consensus.cc:504] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.613442 11111 leader_election.cc:288] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:45.615094 9360 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 92d1100b862b4170807be02a39307359
W20260928 14:50:45.615268 9360 leader_election.cc:341] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 92d1100b862b4170807be02a39307359
I20260928 14:50:45.615463 9360 leader_election.cc:302] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:45.615902 11111 raft_consensus.cc:2726] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.619846 8946 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_978ad5acfb5443d696539c6b347ebb2b [id=066bd906e956423ea4fb9370314cfbd2] alter complete (version 3)
W20260928 14:50:45.624413 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 948ad6c90d7146758788b5125a66d594 consensus state has no leader
I20260928 14:50:45.625941 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f24b3db09904135afe42a211b0442d6" } modify_external_catalogs: true
I20260928 14:50:45.626160 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6f24b3db09904135afe42a211b0442d6" } modify_external_catalogs: true
I20260928 14:50:45.637033 11223 raft_consensus.cc:482] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.637264 11223 raft_consensus.cc:504] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.638005 11223 leader_election.cc:288] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.640530 9815 ts_tablet_manager.cc:1918] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.640831 9815 log.cc:1196] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3b75816a9816497ca6bc6ba8e5c5eb3d
I20260928 14:50:45.641218 9815 ts_tablet_manager.cc:1939] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.641211 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8234670cb2604ba7b405ad7f70e03a2f with delete_type TABLET_DATA_DELETED (replaced by tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.641486 9813 tablet_replica.cc:330] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.641687 9813 raft_consensus.cc:2229] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.641816 9813 raft_consensus.cc:2258] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.641979 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1138) took 1858 ms. Trace:
I20260928 14:50:45.641911 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4b9a6480b5fe4c6db2eb4186012566d5" } new_table_name: "default.Table_36f9ea2f519041849b89dbd20ddf871e" modify_external_catalogs: true
I20260928 14:50:45.642055 9815 rpcz_store.cc:276] 0928 14:50:43.783568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.783603 (+ 35us) service_pool.cc:227] Handling call
0928 14:50:45.589651 (+1806048us) ts_tablet_manager.cc:1145] Deleting tablet 3b75816a9816497ca6bc6ba8e5c5eb3d
0928 14:50:45.589665 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.630812 (+ 41147us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.640431 (+ 9619us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.641959 (+ 1528us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1805733}
I20260928 14:50:45.642272 9813 ts_tablet_manager.cc:1905] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.642475 9815 tablet_replica.cc:330] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.642645 9815 raft_consensus.cc:2229] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.642765 9815 raft_consensus.cc:2258] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.643196 9815 ts_tablet_manager.cc:1905] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.645928 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3b75816a9816497ca6bc6ba8e5c5eb3d (table default.Table_02e5b36a67804830879c207d98f45dda [id=ad213ed249fa48f087d0f12f32893689]) successfully deleted
I20260928 14:50:45.648722 9815 ts_tablet_manager.cc:1918] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.649441 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet b339b4e3cfbd40c1a35a4c6083926869 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:45.649637 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7aa9167742a94a0ab586e15205a0ccdc
I20260928 14:50:45.650153 9813 ts_tablet_manager.cc:1918] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.650375 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.650367 9813 log.cc:1196] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/8234670cb2604ba7b405ad7f70e03a2f
I20260928 14:50:45.650987 9813 ts_tablet_manager.cc:1939] T 8234670cb2604ba7b405ad7f70e03a2f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.651600 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 8234670cb2604ba7b405ad7f70e03a2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
I20260928 14:50:45.651810 9256 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.651970 9813 tablet_replica.cc:330] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.652302 9813 raft_consensus.cc:2229] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.652576 9813 raft_consensus.cc:2258] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.651305 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.653234 9815 log.cc:1196] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d7cf2eb5b59649e099da1947c4ccf430
I20260928 14:50:45.653359 9813 ts_tablet_manager.cc:1905] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:45.655066 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c37480fb31e842c5b4ce0a93104d23bf consensus state has no leader
I20260928 14:50:45.656747 9815 ts_tablet_manager.cc:1939] T d7cf2eb5b59649e099da1947c4ccf430 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.658643 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1139) took 1874 ms. Trace:
W20260928 14:50:45.658897 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 948ad6c90d7146758788b5125a66d594 (table default.Table_9d75a594efaf464ba848af9f011d0fdc [id=1bbde8cd47814e21beade1cf5bc12627], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 948ad6c90d7146758788b5125a66d594 consensus state has no leader
I20260928 14:50:45.658838 9815 rpcz_store.cc:276] 0928 14:50:43.784344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.784387 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:45.642434 (+1858047us) ts_tablet_manager.cc:1145] Deleting tablet d7cf2eb5b59649e099da1947c4ccf430
0928 14:50:45.642444 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.646038 (+ 3594us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.648653 (+ 2615us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.658625 (+ 9972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1857890}
I20260928 14:50:45.659193 9815 tablet_replica.cc:330] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.659427 9815 raft_consensus.cc:2229] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.659602 9815 raft_consensus.cc:2258] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.660096 9815 ts_tablet_manager.cc:1905] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.662052 9855 tablet_bootstrap.cc:492] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.662189 9855 ts_tablet_manager.cc:1397] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.003s
I20260928 14:50:45.662967 9855 raft_consensus.cc:348] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.663183 9855 raft_consensus.cc:374] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.663244 9855 raft_consensus.cc:729] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.663287 11111 raft_consensus.cc:482] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.663401 11111 raft_consensus.cc:504] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.663429 9855 consensus_queue.cc:260] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.663921 11111 leader_election.cc:288] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.663964 9855 ts_tablet_manager.cc:1428] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:45.664199 9855 tablet_bootstrap.cc:492] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.663571 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d7cf2eb5b59649e099da1947c4ccf430 (table default.Table_d4428f89dc584ff1b0b45384b781c7ff [id=fc2da5874632462ca86a70d742522108]) successfully deleted
I20260928 14:50:45.667343 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_55e2dd0b086b49a09f8873ab4180b5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.667932 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55e2dd0b086b49a09f8873ab4180b5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.668255 9813 ts_tablet_manager.cc:1918] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:45.668533 9813 log.cc:1196] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7aa9167742a94a0ab586e15205a0ccdc
I20260928 14:50:45.669193 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d197a8ba8848d98ba0f03b2e83d3f6" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.669814 9220 leader_election.cc:341] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.669965 9813 ts_tablet_manager.cc:1939] T 7aa9167742a94a0ab586e15205a0ccdc P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.562160 9814 raft_consensus.cc:2229] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.669982 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5cce8a07a9ba4dfb839e1317e79122f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:45.670280 9814 raft_consensus.cc:2258] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:45.670480 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cce8a07a9ba4dfb839e1317e79122f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.670933 9814 ts_tablet_manager.cc:1905] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:45.671809 9360 leader_election.cc:341] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 59ced67c921e43e48bcb5195da212582
I20260928 14:50:45.672020 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_38c7c3087fe7474aa2d31c47bc84f0dd" } new_table_name: "default.Table_5bb3fb81c5514217a14e07309485a0d3" modify_external_catalogs: true
W20260928 14:50:45.672902 9360 leader_election.cc:341] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 59ced67c921e43e48bcb5195da212582
I20260928 14:50:45.672959 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_33d213a97ea349d6ab97a84fd1571e6d [id=e00f618e9273435db59f9445f6485b89]) successfully deleted
I20260928 14:50:45.672997 9360 leader_election.cc:302] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:45.673283 11377 raft_consensus.cc:2726] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.673259 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b767d88818724383a745af686bee65e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.673769 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b767d88818724383a745af686bee65e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.674873 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_113bd4fb4dfe4daaad54e66560882085" } modify_external_catalogs: true
I20260928 14:50:45.675030 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_113bd4fb4dfe4daaad54e66560882085" } modify_external_catalogs: true
I20260928 14:50:45.679761 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8fbe74a73dda4330af8814bbba0cfc70 (table default.Table_842e5c186d154cb085e953072a42ac90 [id=4f91c41523434de1aa823294e089f5eb]). Expected version 1 got 0
I20260928 14:50:45.680478 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dd6a6d295c8340ed89d704184bb78a67" } modify_external_catalogs: true
I20260928 14:50:45.680650 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dd6a6d295c8340ed89d704184bb78a67" } modify_external_catalogs: true
I20260928 14:50:45.681572 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_30cbca03b6f14748816af646b024220b [id=b59cd90b4cc5420fbf378dc148eb2278] alter complete (version 1)
I20260928 14:50:45.681633 9855 tablet_bootstrap.cc:654] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.685497 9851 tablet_bootstrap.cc:492] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:45.687647 9402 tablet_service.cc:1467] Processing CreateTablet for tablet e77215447ffd4ec688693d7681d9b098 (DEFAULT_TABLE table=default.Table_89970becf7bb4f1da02b5d175b4af221 [id=9649c8ecfd3d4ec7903e96e4804fd81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.687937 9851 ts_tablet_manager.cc:1397] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.298s user 0.004s sys 0.000s
I20260928 14:50:45.688001 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e77215447ffd4ec688693d7681d9b098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.688536 9256 tablet_service.cc:1467] Processing CreateTablet for tablet e77215447ffd4ec688693d7681d9b098 (DEFAULT_TABLE table=default.Table_89970becf7bb4f1da02b5d175b4af221 [id=9649c8ecfd3d4ec7903e96e4804fd81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.688901 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e77215447ffd4ec688693d7681d9b098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.688868 9851 raft_consensus.cc:348] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.689054 9851 raft_consensus.cc:374] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.689097 9851 raft_consensus.cc:729] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.694094 9815 ts_tablet_manager.cc:1918] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.694024 9402 tablet_service.cc:1467] Processing CreateTablet for tablet d58bb22756f94febbfef301657008241 (DEFAULT_TABLE table=default.Table_1e56500a46c047c2ad46ded3512d20ef [id=baba397841024c13b7ebde74e569689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.694355 9851 consensus_queue.cc:260] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.694510 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58bb22756f94febbfef301657008241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.694926 9249 tablet_service.cc:1467] Processing CreateTablet for tablet d58bb22756f94febbfef301657008241 (DEFAULT_TABLE table=default.Table_1e56500a46c047c2ad46ded3512d20ef [id=baba397841024c13b7ebde74e569689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.695283 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58bb22756f94febbfef301657008241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.695456 9851 ts_tablet_manager.cc:1428] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260928 14:50:45.697921 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 54488.9us
I20260928 14:50:45.700446 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 108d72b99208402793e0ba6dc3ba79a8 (DEFAULT_TABLE table=default.Table_57e9cd68a9ee4659b9ad597f46bf83ce [id=1d14e50881954b5f996dde9269eec2f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.700739 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 108d72b99208402793e0ba6dc3ba79a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.703112 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 108d72b99208402793e0ba6dc3ba79a8 (DEFAULT_TABLE table=default.Table_57e9cd68a9ee4659b9ad597f46bf83ce [id=1d14e50881954b5f996dde9269eec2f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.704538 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 104756us
I20260928 14:50:45.705495 9851 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:45.705601 11378 tablet.cc:1722] T ddb704c5128a4880ae1b89b4d4d1fcfd P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:45.707007 9851 tablet_bootstrap.cc:654] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.709348 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 108d72b99208402793e0ba6dc3ba79a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.694309 9533 tablet_service.cc:1467] Processing CreateTablet for tablet e77215447ffd4ec688693d7681d9b098 (DEFAULT_TABLE table=default.Table_89970becf7bb4f1da02b5d175b4af221 [id=9649c8ecfd3d4ec7903e96e4804fd81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.712121 9815 log.cc:1196] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/666de9dd64734708b35738605204ed7d
I20260928 14:50:45.712381 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e77215447ffd4ec688693d7681d9b098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.712476 9815 ts_tablet_manager.cc:1939] T 666de9dd64734708b35738605204ed7d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.702466 9545 tablet_service.cc:1467] Processing CreateTablet for tablet d58bb22756f94febbfef301657008241 (DEFAULT_TABLE table=default.Table_1e56500a46c047c2ad46ded3512d20ef [id=baba397841024c13b7ebde74e569689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.713886 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58bb22756f94febbfef301657008241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.714040 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1140) took 1929 ms. Trace:
I20260928 14:50:45.714135 9815 rpcz_store.cc:276] 0928 14:50:43.784681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.784717 (+ 36us) service_pool.cc:227] Handling call
0928 14:50:45.659151 (+1874434us) ts_tablet_manager.cc:1145] Deleting tablet 666de9dd64734708b35738605204ed7d
0928 14:50:45.659163 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.691284 (+ 32121us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.694022 (+ 2738us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.714021 (+ 19999us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874245}
I20260928 14:50:45.714515 9815 tablet_replica.cc:330] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.714699 9815 raft_consensus.cc:2229] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.714844 9815 raft_consensus.cc:2258] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.715422 9815 ts_tablet_manager.cc:1905] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.704515 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 108d72b99208402793e0ba6dc3ba79a8 (DEFAULT_TABLE table=default.Table_57e9cd68a9ee4659b9ad597f46bf83ce [id=1d14e50881954b5f996dde9269eec2f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.706465 9855 tablet_bootstrap.cc:492] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.717665 9855 ts_tablet_manager.cc:1397] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.002s
I20260928 14:50:45.717775 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 108d72b99208402793e0ba6dc3ba79a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.718310 9855 raft_consensus.cc:348] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.718488 9855 raft_consensus.cc:374] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.718534 9855 raft_consensus.cc:729] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.718719 9855 consensus_queue.cc:260] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.719192 9855 ts_tablet_manager.cc:1428] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:45.719429 9855 tablet_bootstrap.cc:492] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.720906 9855 tablet_bootstrap.cc:654] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.732981 9855 tablet_bootstrap.cc:492] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.733112 9855 ts_tablet_manager.cc:1397] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260928 14:50:45.733883 9855 raft_consensus.cc:348] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.734058 9855 raft_consensus.cc:374] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.734117 9855 raft_consensus.cc:729] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.734284 9855 consensus_queue.cc:260] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.734831 9855 ts_tablet_manager.cc:1428] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:45.735060 9855 tablet_bootstrap.cc:492] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.736487 9855 tablet_bootstrap.cc:654] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.746472 9851 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:45.746615 9851 ts_tablet_manager.cc:1397] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260928 14:50:45.709751 11374 mvcc.cc:205] Tried to move back new op lower bound from 7334326456873447424 to 7334326453567393792. Current Snapshot: MvccSnapshot[applied={T|T < 7334326456873447424}]
I20260928 14:50:45.755511 11303 raft_consensus.cc:482] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.755645 11303 raft_consensus.cc:504] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.756219 11303 leader_election.cc:288] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.756894 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a0117aff69403e816ff37592db935f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:45.757496 9497 leader_election.cc:341] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.758160 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 666de9dd64734708b35738605204ed7d (table default.Table_db83f8c905e54fbeb75b212120f77ba7 [id=fa3d7186cd7343c19f359f1ab5da6d34]) successfully deleted
I20260928 14:50:45.758912 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a0117aff69403e816ff37592db935f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.759233 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 54506.5us
W20260928 14:50:45.759413 9498 leader_election.cc:341] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.759534 9498 leader_election.cc:302] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.759953 11303 raft_consensus.cc:2726] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.760782 11303 raft_consensus.cc:482] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.760893 11303 raft_consensus.cc:504] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.761386 11303 leader_election.cc:288] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.761410 11377 raft_consensus.cc:482] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.761557 11377 raft_consensus.cc:504] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.762204 11377 leader_election.cc:288] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:45.764349 9360 leader_election.cc:341] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:45.764361 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43c887b7c4e8434a9342d49145fde3ae" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:45.764815 9497 leader_election.cc:341] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.768006 9855 tablet_bootstrap.cc:492] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.768122 9855 ts_tablet_manager.cc:1397] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
W20260928 14:50:45.768455 9360 leader_election.cc:341] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:45.768563 9360 leader_election.cc:302] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:45.769363 9855 raft_consensus.cc:348] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.769623 9855 raft_consensus.cc:374] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.769696 9855 raft_consensus.cc:729] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.769879 9855 consensus_queue.cc:260] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.770087 11377 raft_consensus.cc:2726] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.770402 9855 ts_tablet_manager.cc:1428] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:45.770730 9855 tablet_bootstrap.cc:492] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.772224 9855 tablet_bootstrap.cc:654] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.772367 9815 ts_tablet_manager.cc:1918] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.775709 9815 log.cc:1196] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/835ba6c803a34707b77bb8bc280b9e68
I20260928 14:50:45.775700 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43c887b7c4e8434a9342d49145fde3ae" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.776240 9498 leader_election.cc:341] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.776343 9498 leader_election.cc:302] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.777709 11303 raft_consensus.cc:2726] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.778146 9815 ts_tablet_manager.cc:1939] T 835ba6c803a34707b77bb8bc280b9e68 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.778399 9855 tablet_bootstrap.cc:492] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.778510 9855 ts_tablet_manager.cc:1397] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20260928 14:50:45.779134 9855 raft_consensus.cc:348] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.779314 9855 raft_consensus.cc:374] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.779363 9855 raft_consensus.cc:729] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.779542 9855 consensus_queue.cc:260] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.780104 9855 ts_tablet_manager.cc:1428] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:45.781160 9855 tablet_bootstrap.cc:492] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.783669 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1141) took 1950 ms. Trace:
I20260928 14:50:45.795441 11223 raft_consensus.cc:482] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.795743 11223 raft_consensus.cc:504] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.796980 11223 leader_election.cc:288] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.784226 9815 rpcz_store.cc:276] 0928 14:50:43.832759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.832834 (+ 75us) service_pool.cc:227] Handling call
0928 14:50:45.714473 (+1881639us) ts_tablet_manager.cc:1145] Deleting tablet 835ba6c803a34707b77bb8bc280b9e68
0928 14:50:45.714483 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.752409 (+ 37926us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.772268 (+ 19859us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.783643 (+ 11375us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1881457}
I20260928 14:50:45.809834 9815 tablet_replica.cc:330] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.810523 9855 tablet_bootstrap.cc:654] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.813113 9815 raft_consensus.cc:2229] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.813374 9815 raft_consensus.cc:2258] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.813966 9815 ts_tablet_manager.cc:1905] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.816748 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.817384 9220 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.826706 8951 master_service.cc:946] ReplaceTablet: received request to replace tablet a0d94bf844904306b84695e452d62ebd from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:45.827868 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 401b718f24e842f28d40a6d232d865b5 consensus state has no leader
I20260928 14:50:45.828096 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d48886de3194e898da13b5d546ca9d8 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:45.830364 8956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_a6d5cc8a14be4d9ab6a2ac41b36a71ae [id=f894dbddace24e628c6a53906c5c51ac] alter complete (version 3)
I20260928 14:50:45.831452 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2c50f7410dd549f399449487556f813d
I20260928 14:50:45.832055 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ba96eb0f6c0141ee96e30496cbb19edc
I20260928 14:50:45.832293 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b171a26e7e643c9bc98c580b7bae60f) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.832506 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 59ced67c921e43e48bcb5195da212582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.832687 9813 tablet_replica.cc:330] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.832763 9399 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d1100b862b4170807be02a39307359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.832852 9813 raft_consensus.cc:2229] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.832966 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50f7410dd549f399449487556f813d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.833137 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f04c05cdad04261a1e2ae7e044ddbfb with delete_type TABLET_DATA_DELETED (replaced by tablet 99e54a175c104f9db590e6fd9ef72838) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.832994 9813 raft_consensus.cc:2258] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.833841 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.833863 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet 78379bd4cfce46fa812374f046d9d329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.834158 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ce64a75bc55a4496bcd96070290a324c
I20260928 14:50:45.834204 9813 ts_tablet_manager.cc:1905] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.834728 9855 tablet_bootstrap.cc:492] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.835023 9855 ts_tablet_manager.cc:1397] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.003s
I20260928 14:50:45.836727 9855 raft_consensus.cc:348] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.837237 9855 raft_consensus.cc:374] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.837316 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet ce64a75bc55a4496bcd96070290a324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.837442 9855 raft_consensus.cc:729] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.837896 9855 consensus_queue.cc:260] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:45.838372 9220 consensus_peers.cc:487] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aa9167742a94a0ab586e15205a0ccdc. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:45.837481 11371 raft_consensus.cc:482] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.838900 11371 raft_consensus.cc:504] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.839053 9855 ts_tablet_manager.cc:1428] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 14:50:45.839900 11371 leader_election.cc:288] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:45.839950 9855 tablet_bootstrap.cc:492] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.840708 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d193edcfa684b8795b084f3106903c5" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.838352 9815 ts_tablet_manager.cc:1918] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:45.841156 9815 log.cc:1196] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/82b9dad76ac94a03811e4793e0234aad
I20260928 14:50:45.841552 9815 ts_tablet_manager.cc:1939] T 82b9dad76ac94a03811e4793e0234aad P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.841846 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1142) took 1914 ms. Trace:
I20260928 14:50:45.841928 9815 rpcz_store.cc:276] 0928 14:50:43.927486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.927532 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:45.809791 (+1882259us) ts_tablet_manager.cc:1145] Deleting tablet 82b9dad76ac94a03811e4793e0234aad
0928 14:50:45.809801 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.830529 (+ 20728us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.837443 (+ 6914us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.841832 (+ 4389us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2262,"tablet-delete.queue_time_us":1882060}
I20260928 14:50:45.843298 9855 tablet_bootstrap.cc:654] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:45.841349 9220 leader_election.cc:341] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.844422 9815 tablet_replica.cc:330] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.844599 9815 raft_consensus.cc:2229] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.844749 9815 raft_consensus.cc:2258] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.845214 9815 ts_tablet_manager.cc:1905] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.845892 9851 raft_consensus.cc:348] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.846083 9851 raft_consensus.cc:374] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.846139 9851 raft_consensus.cc:729] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.846333 9851 consensus_queue.cc:260] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.846798 9851 ts_tablet_manager.cc:1428] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:45.851292 9813 ts_tablet_manager.cc:1918] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.851509 9813 log.cc:1196] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/dc5ee93708ea4f3fabdf93aa9c33c1c8
I20260928 14:50:45.851962 9813 ts_tablet_manager.cc:1939] T dc5ee93708ea4f3fabdf93aa9c33c1c8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.852768 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet dc5ee93708ea4f3fabdf93aa9c33c1c8 (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]) successfully deleted
I20260928 14:50:45.852810 9813 tablet_replica.cc:330] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.853091 9813 raft_consensus.cc:2229] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.853417 9813 raft_consensus.cc:2258] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.855216 9813 ts_tablet_manager.cc:1905] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.863647 9813 ts_tablet_manager.cc:1918] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.863643 9855 tablet_bootstrap.cc:492] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.863840 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a0d94bf844904306b84695e452d62ebd
I20260928 14:50:45.863875 9855 ts_tablet_manager.cc:1397] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20260928 14:50:45.864553 8951 catalog_manager.cc:6565] ReplaceTablet: tablet a0d94bf844904306b84695e452d62ebd deleted and replaced by tablet 028100ff68ad408db9266317f590d693
I20260928 14:50:45.866880 9855 raft_consensus.cc:348] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.868281 9855 raft_consensus.cc:374] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.868547 9855 raft_consensus.cc:729] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.869203 9855 consensus_queue.cc:260] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.870463 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 8fbe74a73dda4330af8814bbba0cfc70 (table default.Table_842e5c186d154cb085e953072a42ac90 [id=4f91c41523434de1aa823294e089f5eb]). Expected version 1 got 0
I20260928 14:50:45.870637 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_7684b6725e84453281f0ec575a8b7bca [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 2 got 0
I20260928 14:50:45.870777 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 7ae8348f77764a5e8787a33f657ca80d (table default.Table_c045d82b1980402990bbb2d9b475ce5f [id=b6f02064389b40e18b15d907ed70c02a]). Expected version 3 got 0
I20260928 14:50:45.870894 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 3aff7eb9a7ff4ed79305806c30c30627 (table default.Table_15b982ba466a44da9677e93de728c4dc [id=3c7ccec83e854fe79539b979befdc62d]). Expected version 3 got 0
I20260928 14:50:45.871038 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 67956e8ba12d4411bfca6263b84aa93e (table default.Table_4b9a6480b5fe4c6db2eb4186012566d5 [id=8c5f014cd2f545abb221b135a4477b53]). Expected version 1 got 0
I20260928 14:50:45.871163 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 6ff596370c52465ca7c531b8760af5c8 (table default.Table_ed36dc3cdd8e4d7dbcad55d996184a4f [id=60cb5e1d86f7418b90bac3d625770081]). Expected version 2 got 0
I20260928 14:50:45.871551 9855 ts_tablet_manager.cc:1428] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 14:50:45.872491 9855 tablet_bootstrap.cc:492] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.874068 9815 ts_tablet_manager.cc:1918] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:45.874217 9815 log.cc:1196] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/8a08d91a06ca4effbc8fc4e83d88fe93
I20260928 14:50:45.874603 9815 ts_tablet_manager.cc:1939] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.874910 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1144) took 1927 ms. Trace:
I20260928 14:50:45.875015 9815 rpcz_store.cc:276] 0928 14:50:43.947229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.947292 (+ 63us) service_pool.cc:227] Handling call
0928 14:50:45.844379 (+1897087us) ts_tablet_manager.cc:1145] Deleting tablet 8a08d91a06ca4effbc8fc4e83d88fe93
0928 14:50:45.844389 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.853164 (+ 8775us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.873979 (+ 20815us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.874893 (+ 914us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896882}
I20260928 14:50:45.875509 9815 tablet_replica.cc:330] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.875746 9815 raft_consensus.cc:2229] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.875980 9815 raft_consensus.cc:2258] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.876533 9815 ts_tablet_manager.cc:1905] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:45.878046 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67956e8ba12d4411bfca6263b84aa93e consensus state has no leader
I20260928 14:50:45.879279 9855 tablet_bootstrap.cc:654] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.864612 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d94bf844904306b84695e452d62ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 028100ff68ad408db9266317f590d693) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:45.867594 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 48a64464b632429bbfb5df68df0923d1 (DEFAULT_TABLE table=default.Table_d6b3a014ad054e0b88c6858332ada572 [id=099e0967ea164691b399458287c7a39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.879918 9813 log.cc:1196] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/59ced67c921e43e48bcb5195da212582
I20260928 14:50:45.868152 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 8818315aa3a84725a3ec0776e3e81f6f (DEFAULT_TABLE table=default.Table_a3ab57d600bc4a8c9d5ba55a94279177 [id=da6767ae27e049a299c38886b7f63f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.880330 9813 ts_tablet_manager.cc:1939] T 59ced67c921e43e48bcb5195da212582 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.868959 9399 tablet_service.cc:1467] Processing CreateTablet for tablet f147ecc65d034af08645f2865206416d (DEFAULT_TABLE table=default.Table_f7ededd5c0d8482a9b0bfc0f3eafc589 [id=054f1d9942f84e5c846338e80967d8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.869681 9398 tablet_service.cc:1467] Processing CreateTablet for tablet e7097b5a70cc448495d62ab257770144 (DEFAULT_TABLE table=default.Table_26700e2b9cae48c296507a8cdd745db0 [id=84f7e406945d458ca884766c0d046be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.872953 9393 tablet_service.cc:1467] Processing CreateTablet for tablet facfe056ffeb41b68b1253b0387c15a1 (DEFAULT_TABLE table=default.Table_ccef6d9b32734860a9f8a5b9c4221450 [id=3b6eb35005344f4781b7524cad27b91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.874943 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 09981dbe345a40e5b1fbb06abf491ea9 (DEFAULT_TABLE table=default.Table_f2f8216afaf94e34a8b155f58feca084 [id=30052e1e06f8449fb6d6b438009a7512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.875775 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb194c83ae41678dcb4c08c5b66e23 (DEFAULT_TABLE table=default.Table_1fadca1ccf534c46a7d46f64cd182d7f [id=7500d4e7637144ccbfde6b97f1312785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.877131 9390 tablet_service.cc:1467] Processing CreateTablet for tablet f8c263399eaa479b88f24e74d85618aa (DEFAULT_TABLE table=default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.877461 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 9798f88e35b74aea922d4250bb3d99d0 (DEFAULT_TABLE table=default.Table_6b217bb2fcfb41e3811aee74e67c9324 [id=521b40e366b6491f909a51096cc44d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.878912 9403 tablet_service.cc:1467] Processing CreateTablet for tablet b5948def5cf7412da8cc128382a93854 (DEFAULT_TABLE table=default.Table_c03ebae35c8140d3a70d796eaea31cf5 [id=9fa3d2a72d3c459cae3aecab05290f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.879601 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 79640ef0f57b4b42b6be343ec46089b6 (DEFAULT_TABLE table=default.Table_e2ac8d527e8f4da3a6936cbc70d62972 [id=0656d7e3ad174dad81713d5d9342aea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.880224 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a64464b632429bbfb5df68df0923d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.882129 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79640ef0f57b4b42b6be343ec46089b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.881228 9813 tablet_replica.cc:330] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.885658 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet facfe056ffeb41b68b1253b0387c15a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.886680 9815 ts_tablet_manager.cc:1918] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:45.886768 9815 log.cc:1196] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d27a357d905e463ba9507f74e575acb1
I20260928 14:50:45.887090 9815 ts_tablet_manager.cc:1939] T d27a357d905e463ba9507f74e575acb1 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.887385 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1145) took 1932 ms. Trace:
I20260928 14:50:45.887429 9813 raft_consensus.cc:2229] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.887459 9815 rpcz_store.cc:276] 0928 14:50:43.954574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.954631 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:45.875455 (+1920824us) ts_tablet_manager.cc:1145] Deleting tablet d27a357d905e463ba9507f74e575acb1
0928 14:50:45.875474 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.879579 (+ 4105us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.886599 (+ 7020us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.887371 (+ 772us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920666}
I20260928 14:50:45.887650 9813 raft_consensus.cc:2258] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.888640 9813 ts_tablet_manager.cc:1905] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.889695 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7097b5a70cc448495d62ab257770144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.891141 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1147) took 1761 ms. Trace:
I20260928 14:50:45.891217 9815 rpcz_store.cc:276] 0928 14:50:44.129418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.129466 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:45.891009 (+1761543us) ts_tablet_manager.cc:1145] Deleting tablet 080159d2e65a4550861f4c63fb22d02e
0928 14:50:45.891020 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.891114 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615247}
I20260928 14:50:45.891631 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1148) took 1760 ms. Trace:
I20260928 14:50:45.891698 9815 rpcz_store.cc:276] 0928 14:50:44.130721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.130783 (+ 62us) service_pool.cc:227] Handling call
0928 14:50:45.891538 (+1760755us) ts_tablet_manager.cc:1145] Deleting tablet 287a1ca845fe440da98bf68aafa0e49c
0928 14:50:45.891547 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.891617 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615764}
I20260928 14:50:45.893695 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5948def5cf7412da8cc128382a93854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.895416 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1149) took 1763 ms. Trace:
I20260928 14:50:45.895489 9815 rpcz_store.cc:276] 0928 14:50:44.131717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.131762 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:45.895313 (+1763551us) ts_tablet_manager.cc:1145] Deleting tablet 0f81e272545349678c7824ba5520ec8e
0928 14:50:45.895324 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.895400 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618728}
I20260928 14:50:45.895872 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1150) took 1761 ms. Trace:
I20260928 14:50:45.895941 9815 rpcz_store.cc:276] 0928 14:50:44.134007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.134056 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:45.895774 (+1761718us) ts_tablet_manager.cc:1145] Deleting tablet 0f81e272545349678c7824ba5520ec8e
0928 14:50:45.895783 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.895857 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1619062}
I20260928 14:50:45.896551 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1154) took 1725 ms. Trace:
I20260928 14:50:45.896628 9815 rpcz_store.cc:276] 0928 14:50:44.171033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.171081 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:45.896454 (+1725373us) ts_tablet_manager.cc:1145] Deleting tablet 7341dac419f2443594ea9ef9c65f2daa
0928 14:50:45.896464 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.896536 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1619423}
I20260928 14:50:45.896946 9815 tablet_replica.cc:330] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.897157 9815 raft_consensus.cc:2229] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.897281 9815 pending_rounds.cc:62] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Trying to abort 1 pending ops.
I20260928 14:50:45.897315 9815 pending_rounds.cc:68] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334326451792760832 op_type: NO_OP noop_request { }
I20260928 14:50:45.897416 9815 raft_consensus.cc:2866] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 14:50:45.897490 9815 raft_consensus.cc:2258] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.897728 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9798f88e35b74aea922d4250bb3d99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.898253 9815 ts_tablet_manager.cc:1905] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.901674 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb194c83ae41678dcb4c08c5b66e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.903707 9855 tablet_bootstrap.cc:492] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:45.903995 9855 ts_tablet_manager.cc:1397] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260928 14:50:45.905710 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c263399eaa479b88f24e74d85618aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.905915 9815 ts_tablet_manager.cc:1918] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:45.906004 9815 log.cc:1196] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/ba0d51f1c2664e0b8c6acb7847eff7cc
I20260928 14:50:45.906345 9815 ts_tablet_manager.cc:1939] T ba0d51f1c2664e0b8c6acb7847eff7cc P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:45.906591 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1157) took 1664 ms. Trace:
I20260928 14:50:45.906656 9815 rpcz_store.cc:276] 0928 14:50:44.242120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.242175 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:45.896907 (+1654732us) ts_tablet_manager.cc:1145] Deleting tablet ba0d51f1c2664e0b8c6acb7847eff7cc
0928 14:50:45.896917 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.903076 (+ 6159us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.905849 (+ 2773us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:45.906578 (+ 729us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616375}
I20260928 14:50:45.908149 9855 raft_consensus.cc:348] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.909701 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09981dbe345a40e5b1fbb06abf491ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.909473 9855 raft_consensus.cc:374] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.909844 9855 raft_consensus.cc:729] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.910144 9813 ts_tablet_manager.cc:1918] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:45.910558 9813 log.cc:1196] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/92d1100b862b4170807be02a39307359
I20260928 14:50:45.910939 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50f7410dd549f399449487556f813d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.911340 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.911654 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet ce64a75bc55a4496bcd96070290a324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.911931 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50f7410dd549f399449487556f813d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.911029 9855 consensus_queue.cc:260] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.912307 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet ba96eb0f6c0141ee96e30496cbb19edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.912611 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet ce64a75bc55a4496bcd96070290a324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.912549 9813 ts_tablet_manager.cc:1939] T 92d1100b862b4170807be02a39307359 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:45.914598 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f147ecc65d034af08645f2865206416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.914361 9855 ts_tablet_manager.cc:1428] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260928 14:50:45.914796 9813 tablet_replica.cc:330] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.915787 9855 tablet_bootstrap.cc:492] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:45.915733 9813 raft_consensus.cc:2229] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.916957 9813 raft_consensus.cc:2258] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.917683 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8818315aa3a84725a3ec0776e3e81f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.918520 9815 tablet_replica.cc:330] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:45.918694 9815 raft_consensus.cc:2229] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.918814 9815 raft_consensus.cc:2258] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.919248 9815 ts_tablet_manager.cc:1905] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.920003 9813 ts_tablet_manager.cc:1905] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:45.923717 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d94bf844904306b84695e452d62ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 028100ff68ad408db9266317f590d693) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.925089 9855 tablet_bootstrap.cc:654] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.925258 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 8818315aa3a84725a3ec0776e3e81f6f (DEFAULT_TABLE table=default.Table_a3ab57d600bc4a8c9d5ba55a94279177 [id=da6767ae27e049a299c38886b7f63f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.925334 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d193edcfa684b8795b084f3106903c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.925629 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8818315aa3a84725a3ec0776e3e81f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.925669 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d94bf844904306b84695e452d62ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 028100ff68ad408db9266317f590d693) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:45.925685 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 59ced67c921e43e48bcb5195da212582 (table default.Table_91fba5be108742dfadfae0e7c4aa61f6 [id=ca5392bf870e48a5bfd32b024c85a0b9]) successfully deleted
I20260928 14:50:45.926039 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 92d1100b862b4170807be02a39307359 (table default.Table_f17ae9239f804baeb39a1a48f4dd7cd0 [id=2c36f18eb9eb4557a92e683da1f0a239]) successfully deleted
I20260928 14:50:45.926122 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 48a64464b632429bbfb5df68df0923d1 (DEFAULT_TABLE table=default.Table_d6b3a014ad054e0b88c6858332ada572 [id=099e0967ea164691b399458287c7a39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.926651 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 8818315aa3a84725a3ec0776e3e81f6f (DEFAULT_TABLE table=default.Table_a3ab57d600bc4a8c9d5ba55a94279177 [id=da6767ae27e049a299c38886b7f63f13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.927271 9265 tablet_service.cc:1467] Processing CreateTablet for tablet facfe056ffeb41b68b1253b0387c15a1 (DEFAULT_TABLE table=default.Table_ccef6d9b32734860a9f8a5b9c4221450 [id=3b6eb35005344f4781b7524cad27b91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.927593 9253 tablet_service.cc:1467] Processing CreateTablet for tablet f147ecc65d034af08645f2865206416d (DEFAULT_TABLE table=default.Table_f7ededd5c0d8482a9b0bfc0f3eafc589 [id=054f1d9942f84e5c846338e80967d8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.927732 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 09981dbe345a40e5b1fbb06abf491ea9 (DEFAULT_TABLE table=default.Table_f2f8216afaf94e34a8b155f58feca084 [id=30052e1e06f8449fb6d6b438009a7512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.928146 9255 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb194c83ae41678dcb4c08c5b66e23 (DEFAULT_TABLE table=default.Table_1fadca1ccf534c46a7d46f64cd182d7f [id=7500d4e7637144ccbfde6b97f1312785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.928593 11404 raft_consensus.cc:482] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.928562 9262 tablet_service.cc:1467] Processing CreateTablet for tablet f8c263399eaa479b88f24e74d85618aa (DEFAULT_TABLE table=default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.928738 11404 raft_consensus.cc:504] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.929081 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 9798f88e35b74aea922d4250bb3d99d0 (DEFAULT_TABLE table=default.Table_6b217bb2fcfb41e3811aee74e67c9324 [id=521b40e366b6491f909a51096cc44d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.929388 11404 leader_election.cc:288] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.929780 9541 tablet_service.cc:1467] Processing CreateTablet for tablet e7097b5a70cc448495d62ab257770144 (DEFAULT_TABLE table=default.Table_26700e2b9cae48c296507a8cdd745db0 [id=84f7e406945d458ca884766c0d046be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.930120 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7097b5a70cc448495d62ab257770144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.930239 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f761337edf4a0f9e5dcda0ae28cffd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:45.930734 9498 leader_election.cc:341] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.931185 9530 tablet_service.cc:1467] Processing CreateTablet for tablet facfe056ffeb41b68b1253b0387c15a1 (DEFAULT_TABLE table=default.Table_ccef6d9b32734860a9f8a5b9c4221450 [id=3b6eb35005344f4781b7524cad27b91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.931218 9258 tablet_service.cc:1467] Processing CreateTablet for tablet e7097b5a70cc448495d62ab257770144 (DEFAULT_TABLE table=default.Table_26700e2b9cae48c296507a8cdd745db0 [id=84f7e406945d458ca884766c0d046be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.932116 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 9798f88e35b74aea922d4250bb3d99d0 (DEFAULT_TABLE table=default.Table_6b217bb2fcfb41e3811aee74e67c9324 [id=521b40e366b6491f909a51096cc44d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.932818 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 835ba6c803a34707b77bb8bc280b9e68 (table default.Table_5325bfedb92641f799564a45fa0f40b6 [id=d028a977d3164064bd0d2671c828119d]) successfully deleted
I20260928 14:50:45.933004 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 82b9dad76ac94a03811e4793e0234aad (table default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]) successfully deleted
I20260928 14:50:45.933574 9254 tablet_service.cc:1467] Processing CreateTablet for tablet b5948def5cf7412da8cc128382a93854 (DEFAULT_TABLE table=default.Table_c03ebae35c8140d3a70d796eaea31cf5 [id=9fa3d2a72d3c459cae3aecab05290f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.933655 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f761337edf4a0f9e5dcda0ae28cffd" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:45.933677 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 79640ef0f57b4b42b6be343ec46089b6 (DEFAULT_TABLE table=default.Table_e2ac8d527e8f4da3a6936cbc70d62972 [id=0656d7e3ad174dad81713d5d9342aea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.935597 9546 tablet_service.cc:1467] Processing CreateTablet for tablet b5948def5cf7412da8cc128382a93854 (DEFAULT_TABLE table=default.Table_c03ebae35c8140d3a70d796eaea31cf5 [id=9fa3d2a72d3c459cae3aecab05290f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.935765 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 48a64464b632429bbfb5df68df0923d1 (DEFAULT_TABLE table=default.Table_d6b3a014ad054e0b88c6858332ada572 [id=099e0967ea164691b399458287c7a39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.936121 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 43c887b7c4e8434a9342d49145fde3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.936149 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 79640ef0f57b4b42b6be343ec46089b6 (DEFAULT_TABLE table=default.Table_e2ac8d527e8f4da3a6936cbc70d62972 [id=0656d7e3ad174dad81713d5d9342aea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.936287 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet d34a235b38aa4e9ba328a7f542342653 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:45.936419 9537 tablet_service.cc:1467] Processing CreateTablet for tablet f8c263399eaa479b88f24e74d85618aa (DEFAULT_TABLE table=default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.933151 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (table default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]) successfully deleted
I20260928 14:50:45.937681 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]) successfully deleted
W20260928 14:50:45.937868 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 080159d2e65a4550861f4c63fb22d02e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 080159d2e65a4550861f4c63fb22d02e already in progress: creating tablet
I20260928 14:50:45.937875 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb194c83ae41678dcb4c08c5b66e23 (DEFAULT_TABLE table=default.Table_1fadca1ccf534c46a7d46f64cd182d7f [id=7500d4e7637144ccbfde6b97f1312785]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.938042 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 287a1ca845fe440da98bf68aafa0e49c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 287a1ca845fe440da98bf68aafa0e49c already in progress: creating tablet
I20260928 14:50:45.938136 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 09981dbe345a40e5b1fbb06abf491ea9 (DEFAULT_TABLE table=default.Table_f2f8216afaf94e34a8b155f58feca084 [id=30052e1e06f8449fb6d6b438009a7512]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:45.938210 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
I20260928 14:50:45.938373 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet facfe056ffeb41b68b1253b0387c15a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:45.938391 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
W20260928 14:50:45.938563 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7341dac419f2443594ea9ef9c65f2daa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7341dac419f2443594ea9ef9c65f2daa already in progress: creating tablet
I20260928 14:50:45.938714 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet ba0d51f1c2664e0b8c6acb7847eff7cc (table default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]) successfully deleted
W20260928 14:50:45.939574 9497 leader_election.cc:341] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.939790 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5948def5cf7412da8cc128382a93854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.943168 9497 leader_election.cc:302] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.945863 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09981dbe345a40e5b1fbb06abf491ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.947024 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79640ef0f57b4b42b6be343ec46089b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.949615 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9798f88e35b74aea922d4250bb3d99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.953636 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb194c83ae41678dcb4c08c5b66e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.953668 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet 2871c2000c9f41f9ba8145ed0c3ee508 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:45.954270 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8ae5d3340f5844c1b3814fe86c95615f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.954787 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ae5d3340f5844c1b3814fe86c95615f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.954715 9813 ts_tablet_manager.cc:1918] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:45.955286 9813 log.cc:1196] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2c50f7410dd549f399449487556f813d
I20260928 14:50:45.957360 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a64464b632429bbfb5df68df0923d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.957221 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_db62e38a29e844bebcaaaf65d71237a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:45.957202 9813 ts_tablet_manager.cc:1939] T 2c50f7410dd549f399449487556f813d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
W20260928 14:50:45.957711 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db62e38a29e844bebcaaaf65d71237a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.958185 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b9bc46525f874a939ce9829dedf7c86a" } new_table_name: "default.Table_2c1b2eeea454411fa13c1c7b78b6c61b" modify_external_catalogs: true
I20260928 14:50:45.957238 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c0576b54ef0249b889f69aaa0ddc68bd" } modify_external_catalogs: true
I20260928 14:50:45.958815 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c0576b54ef0249b889f69aaa0ddc68bd" } modify_external_catalogs: true
I20260928 14:50:45.959105 11303 raft_consensus.cc:2726] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.959249 11303 raft_consensus.cc:482] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:45.959363 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]) successfully deleted
I20260928 14:50:45.959335 11303 raft_consensus.cc:504] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:45.959842 11303 leader_election.cc:288] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:45.960371 9813 tablet_replica.cc:330] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:45.960747 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:45.960935 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:45.961359 9813 raft_consensus.cc:2229] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:45.961586 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f2f8216afaf94e34a8b155f58feca084" } new_table_name: "default.Table_7a9d845260784a298e728d7c89c2e202" modify_external_catalogs: true
I20260928 14:50:45.962244 9813 raft_consensus.cc:2258] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:45.964280 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7a9eeb5c71b24b57ab5f5b8f3568b6de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.964753 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a9eeb5c71b24b57ab5f5b8f3568b6de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.943936 9542 tablet_service.cc:1467] Processing CreateTablet for tablet f147ecc65d034af08645f2865206416d (DEFAULT_TABLE table=default.Table_f7ededd5c0d8482a9b0bfc0f3eafc589 [id=054f1d9942f84e5c846338e80967d8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:45.965392 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f147ecc65d034af08645f2865206416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:45.969013 9848 tablet_bootstrap.cc:492] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.969136 9848 ts_tablet_manager.cc:1397] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.369s user 0.044s sys 0.127s
W20260928 14:50:45.970057 9498 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:45.970260 9497 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:45.970692 9848 raft_consensus.cc:348] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.970920 9848 raft_consensus.cc:374] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.971001 9848 raft_consensus.cc:729] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.971226 9848 consensus_queue.cc:260] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.971788 9848 ts_tablet_manager.cc:1428] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:45.972354 9848 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.976593 9848 tablet_bootstrap.cc:654] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.984419 9497 leader_election.cc:302] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:45.987272 11404 raft_consensus.cc:2726] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:45.988175 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_84f0368ec01a49b3a10843d57546a5fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:45.988821 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84f0368ec01a49b3a10843d57546a5fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:45.989104 9848 tablet_bootstrap.cc:492] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:45.989259 9848 ts_tablet_manager.cc:1397] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.008s
I20260928 14:50:45.990423 9848 raft_consensus.cc:348] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.991353 9848 raft_consensus.cc:374] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:45.991539 9848 raft_consensus.cc:729] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:45.991861 9848 consensus_queue.cc:260] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:45.993017 9848 ts_tablet_manager.cc:1428] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260928 14:50:45.993903 9848 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:45.997218 9848 tablet_bootstrap.cc:654] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:45.997274 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
I20260928 14:50:46.003674 11404 raft_consensus.cc:482] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.003796 11404 raft_consensus.cc:504] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.004184 9815 ts_tablet_manager.cc:1918] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.004279 9815 log.cc:1196] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/e2c5877a52264f0e9ebb070792e39e55
I20260928 14:50:46.004503 11404 leader_election.cc:288] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.004547 9815 ts_tablet_manager.cc:1939] T e2c5877a52264f0e9ebb070792e39e55 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.004812 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1174) took 1438 ms. Trace:
I20260928 14:50:46.004889 9815 rpcz_store.cc:276] 0928 14:50:44.566541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.566609 (+ 68us) service_pool.cc:227] Handling call
0928 14:50:45.918481 (+1351872us) ts_tablet_manager.cc:1145] Deleting tablet e2c5877a52264f0e9ebb070792e39e55
0928 14:50:45.918491 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:45.922050 (+ 3559us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.004098 (+ 82048us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.004800 (+ 702us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351719}
I20260928 14:50:46.005256 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1175) took 1344 ms. Trace:
I20260928 14:50:46.005324 9815 rpcz_store.cc:276] 0928 14:50:44.660398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.660448 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:46.005146 (+1344698us) ts_tablet_manager.cc:1145] Deleting tablet 1f42b0c58c5745b088e519844f09e67b
0928 14:50:46.005155 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.005241 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344489}
I20260928 14:50:46.005285 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d34a235b38aa4e9ba328a7f542342653" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.005882 9848 tablet_bootstrap.cc:492] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.006289 9848 ts_tablet_manager.cc:1397] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
W20260928 14:50:46.006377 9497 leader_election.cc:341] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.006587 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet e2c5877a52264f0e9ebb070792e39e55 (table default.Table_272ffcd346ae4b539727e6e5312c89ba [id=a2ce402620b04755ac7ff07c9f40851b]) successfully deleted
W20260928 14:50:46.006903 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1f42b0c58c5745b088e519844f09e67b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f42b0c58c5745b088e519844f09e67b already in progress: creating tablet
I20260928 14:50:46.007167 11404 raft_consensus.cc:482] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.007296 11404 raft_consensus.cc:504] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.007839 11404 leader_election.cc:288] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.007778 9848 raft_consensus.cc:348] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.008472 9848 raft_consensus.cc:374] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.008677 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eaafbd52e464862ae0f0d44ffae58cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.009380 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eaafbd52e464862ae0f0d44ffae58cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.009975 9498 leader_election.cc:341] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.009845 9813 ts_tablet_manager.cc:1905] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.010196 9497 leader_election.cc:341] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.010295 9497 leader_election.cc:302] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.010658 11404 raft_consensus.cc:2726] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.010923 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d34a235b38aa4e9ba328a7f542342653" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.011379 9498 leader_election.cc:341] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.011483 9498 leader_election.cc:302] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.011873 11404 raft_consensus.cc:2726] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.014256 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1176) took 1353 ms. Trace:
I20260928 14:50:46.014843 9815 rpcz_store.cc:276] 0928 14:50:44.660866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.660911 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:46.005518 (+1344607us) ts_tablet_manager.cc:1145] Deleting tablet d9655e6b8d164d7e8d7143b629b945a7
0928 14:50:46.013496 (+ 7978us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.014092 (+ 596us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344339}
W20260928 14:50:46.016913 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d9655e6b8d164d7e8d7143b629b945a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9655e6b8d164d7e8d7143b629b945a7 already in progress: creating tablet
I20260928 14:50:46.017959 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1182) took 1324 ms. Trace:
I20260928 14:50:46.018710 9815 rpcz_store.cc:276] 0928 14:50:44.693593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.693957 (+ 364us) service_pool.cc:227] Handling call
0928 14:50:46.017402 (+1323445us) ts_tablet_manager.cc:1145] Deleting tablet 6ade6066d90547b6bb9be50799bf8d5f
0928 14:50:46.017417 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.017943 (+ 526us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255474}
W20260928 14:50:46.020239 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6ade6066d90547b6bb9be50799bf8d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ade6066d90547b6bb9be50799bf8d5f already in progress: creating tablet
I20260928 14:50:46.020864 9815 tablet_replica.cc:330] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.022490 9815 raft_consensus.cc:2229] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.023646 9815 raft_consensus.cc:2258] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.023917 9855 tablet_bootstrap.cc:492] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.024112 9855 ts_tablet_manager.cc:1397] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.109s user 0.008s sys 0.029s
I20260928 14:50:46.024735 9855 raft_consensus.cc:348] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.024987 9855 raft_consensus.cc:374] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.025086 9855 raft_consensus.cc:729] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.025310 9855 consensus_queue.cc:260] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.025890 9855 ts_tablet_manager.cc:1428] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:46.026158 9855 tablet_bootstrap.cc:492] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.027433 9855 tablet_bootstrap.cc:654] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.027302 9815 ts_tablet_manager.cc:1905] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.030295 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4d48886de3194e898da13b5d546ca9d8
I20260928 14:50:46.030712 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 4d48886de3194e898da13b5d546ca9d8 deleted and replaced by tablet dd02e73d6efc4686b36879fc0540f861
I20260928 14:50:46.030958 9251 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d48886de3194e898da13b5d546ca9d8 with delete_type TABLET_DATA_DELETED (replaced by tablet dd02e73d6efc4686b36879fc0540f861) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.031364 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d48886de3194e898da13b5d546ca9d8 with delete_type TABLET_DATA_DELETED (replaced by tablet dd02e73d6efc4686b36879fc0540f861) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.033761 9848 raft_consensus.cc:729] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.036934 9848 consensus_queue.cc:260] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.038471 9855 tablet_bootstrap.cc:492] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.038620 9855 ts_tablet_manager.cc:1397] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260928 14:50:46.038751 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_51a8abb8f77e4a418a85f6114687b694" } modify_external_catalogs: true
I20260928 14:50:46.038924 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_51a8abb8f77e4a418a85f6114687b694" } modify_external_catalogs: true
I20260928 14:50:46.039160 11377 raft_consensus.cc:482] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.039266 11377 raft_consensus.cc:504] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.039785 11377 leader_election.cc:288] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.039767 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 76a0117aff69403e816ff37592db935f (table default.Table_8a8e9d4c48a54a77bbb629d2a35e4931 [id=282988394f5c48779b485b8b67505cf9]). Expected version 1 got 0
I20260928 14:50:46.039959 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b8237f7d97304a98889bde6817358eda (table default.Table_268a79e835004ddaa114b663c8be3a9c [id=6c0247f77b83490b90d1f7ccbfa55ab4]). Expected version 2 got 0
W20260928 14:50:46.040794 9360 leader_election.cc:341] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 82a58b7387564863a2141a722003c5d1
I20260928 14:50:46.041337 9855 raft_consensus.cc:348] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.041512 9855 raft_consensus.cc:374] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.041579 9855 raft_consensus.cc:729] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.041750 9855 consensus_queue.cc:260] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.041472 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_7aee7ac87b2648b19dee4865905706d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.042222 9855 ts_tablet_manager.cc:1428] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
W20260928 14:50:46.042627 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7aee7ac87b2648b19dee4865905706d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:46.042650 9360 leader_election.cc:341] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 82a58b7387564863a2141a722003c5d1
I20260928 14:50:46.042757 9360 leader_election.cc:302] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:46.043182 11377 raft_consensus.cc:2726] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.043340 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 4684ba575d9d45f3bb059a15efdd936d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.043606 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eaafbd52e464862ae0f0d44ffae58cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.043823 9848 ts_tablet_manager.cc:1428] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.037s user 0.015s sys 0.000s
I20260928 14:50:46.043949 9855 tablet_bootstrap.cc:492] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.045171 9855 tablet_bootstrap.cc:654] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.044318 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d48886de3194e898da13b5d546ca9d8 with delete_type TABLET_DATA_DELETED (replaced by tablet dd02e73d6efc4686b36879fc0540f861) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.044502 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d6b4482e7b42fca17e5b917e1c1bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.048151 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 43f761337edf4a0f9e5dcda0ae28cffd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:42 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.050900 9813 ts_tablet_manager.cc:1918] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.053042 9851 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.054390 9851 tablet_bootstrap.cc:654] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.054381 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3236b0fb0944dc0a1f0893eb8d8e3b4" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:46.051893 9813 log.cc:1196] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9f04c05cdad04261a1e2ae7e044ddbfb
I20260928 14:50:46.054531 9569 raft_consensus.cc:3037] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.056751 9569 raft_consensus.cc:2454] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:46.056634 9813 ts_tablet_manager.cc:1939] T 9f04c05cdad04261a1e2ae7e044ddbfb P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.061688 9848 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.062973 9848 tablet_bootstrap.cc:654] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.063485 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9f04c05cdad04261a1e2ae7e044ddbfb (table default.Table_555f59ea18fe4b02b2aa905e0dbf8e53 [id=e5caf3fa9dce480f95a2c4059910cd99]) successfully deleted
W20260928 14:50:46.066540 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ba96eb0f6c0141ee96e30496cbb19edc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba96eb0f6c0141ee96e30496cbb19edc already in progress: creating tablet
I20260928 14:50:46.067804 9813 tablet_replica.cc:330] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.068981 9813 raft_consensus.cc:2229] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.070144 9851 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.070341 9851 ts_tablet_manager.cc:1397] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260928 14:50:46.070413 9813 raft_consensus.cc:2258] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.071007 11404 raft_consensus.cc:482] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.071029 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c263399eaa479b88f24e74d85618aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.071050 9851 raft_consensus.cc:348] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.071126 11404 raft_consensus.cc:504] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.071264 9851 raft_consensus.cc:374] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.071321 9851 raft_consensus.cc:729] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.071496 9851 consensus_queue.cc:260] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.071987 9851 ts_tablet_manager.cc:1428] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:46.072300 9851 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.072481 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b339b4e3cfbd40c1a35a4c6083926869" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.072904 11404 leader_election.cc:288] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.073014 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b339b4e3cfbd40c1a35a4c6083926869" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.073108 9497 leader_election.cc:341] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:46.073628 9498 leader_election.cc:341] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.073735 9851 tablet_bootstrap.cc:654] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.073724 9498 leader_election.cc:302] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.073984 11404 raft_consensus.cc:2726] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.074589 9813 ts_tablet_manager.cc:1905] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.075654 9815 ts_tablet_manager.cc:1918] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.076596 9815 log.cc:1196] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/c163d657ec4f40598d7f4f3879e6d817
I20260928 14:50:46.078769 9815 ts_tablet_manager.cc:1939] T c163d657ec4f40598d7f4f3879e6d817 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.081596 9848 tablet_bootstrap.cc:492] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.080938 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1187) took 1156 ms. Trace:
I20260928 14:50:46.081758 9848 ts_tablet_manager.cc:1397] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.002s
I20260928 14:50:46.082322 9848 raft_consensus.cc:348] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.082540 9848 raft_consensus.cc:374] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.082619 9848 raft_consensus.cc:729] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.082863 9848 consensus_queue.cc:260] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.081933 9815 rpcz_store.cc:276] 0928 14:50:44.924503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.927215 (+ 2712us) service_pool.cc:227] Handling call
0928 14:50:46.020595 (+1093380us) ts_tablet_manager.cc:1145] Deleting tablet c163d657ec4f40598d7f4f3879e6d817
0928 14:50:46.020608 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.047735 (+ 27127us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.075053 (+ 27318us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.080919 (+ 5866us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092987}
I20260928 14:50:46.083446 9848 ts_tablet_manager.cc:1428] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.083678 9848 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.083729 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet c163d657ec4f40598d7f4f3879e6d817 (table default.Table_03bb5b055caf49f080ec90feb2a90fd0 [id=c8176e349a7d43b19cf1ab3e7c7c987b]) successfully deleted
I20260928 14:50:46.084949 9848 tablet_bootstrap.cc:654] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.084916 9815 tablet_replica.cc:330] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.086051 9851 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.086239 9851 ts_tablet_manager.cc:1397] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260928 14:50:46.086328 9815 raft_consensus.cc:2229] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.087016 9851 raft_consensus.cc:348] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.087294 9851 raft_consensus.cc:374] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.087383 9851 raft_consensus.cc:729] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.087440 9815 raft_consensus.cc:2258] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.087584 9851 consensus_queue.cc:260] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.088052 9851 ts_tablet_manager.cc:1428] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.088344 9851 tablet_bootstrap.cc:492] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.089744 9851 tablet_bootstrap.cc:654] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.091274 9815 ts_tablet_manager.cc:1905] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.096390 9848 tablet_bootstrap.cc:492] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.096554 9848 ts_tablet_manager.cc:1397] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s
I20260928 14:50:46.097196 9848 raft_consensus.cc:348] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.097429 9848 raft_consensus.cc:374] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.097538 9848 raft_consensus.cc:729] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.097805 9848 consensus_queue.cc:260] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.098449 9848 ts_tablet_manager.cc:1428] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.099044 9848 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.101318 9848 tablet_bootstrap.cc:654] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.101861 9851 tablet_bootstrap.cc:492] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.102037 9851 ts_tablet_manager.cc:1397] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260928 14:50:46.102792 9855 tablet_bootstrap.cc:492] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.102695 9851 raft_consensus.cc:348] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.102912 9855 ts_tablet_manager.cc:1397] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.059s user 0.014s sys 0.012s
I20260928 14:50:46.103006 9851 raft_consensus.cc:374] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.103101 9851 raft_consensus.cc:729] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.103336 9851 consensus_queue.cc:260] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.103545 9855 raft_consensus.cc:348] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.103737 9855 raft_consensus.cc:374] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.103792 9855 raft_consensus.cc:729] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.104000 9851 ts_tablet_manager.cc:1428] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.103963 9855 consensus_queue.cc:260] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.104342 9851 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.104411 9855 ts_tablet_manager.cc:1428] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:46.104645 9855 tablet_bootstrap.cc:492] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.105865 9855 tablet_bootstrap.cc:654] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.106098 9851 tablet_bootstrap.cc:654] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.109383 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:46.109587 9566 raft_consensus.cc:2454] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:46.116325 9855 tablet_bootstrap.cc:492] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.116446 9855 ts_tablet_manager.cc:1397] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260928 14:50:46.117434 9855 raft_consensus.cc:348] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.117646 9855 raft_consensus.cc:374] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.117702 9855 raft_consensus.cc:729] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.117900 9855 consensus_queue.cc:260] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.118389 9855 ts_tablet_manager.cc:1428] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.118907 9855 tablet_bootstrap.cc:492] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.120107 9855 tablet_bootstrap.cc:654] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.121711 9851 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.121869 9851 ts_tablet_manager.cc:1397] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260928 14:50:46.122556 9851 raft_consensus.cc:348] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.122895 9851 raft_consensus.cc:374] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.122987 9851 raft_consensus.cc:729] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.123203 9851 consensus_queue.cc:260] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.123721 9851 ts_tablet_manager.cc:1428] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.123546 9848 tablet_bootstrap.cc:492] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.123865 9848 ts_tablet_manager.cc:1397] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.005s
I20260928 14:50:46.123485 9813 ts_tablet_manager.cc:1918] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.124099 9813 log.cc:1196] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/78379bd4cfce46fa812374f046d9d329
I20260928 14:50:46.124433 9848 raft_consensus.cc:348] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.124632 9848 raft_consensus.cc:374] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.124701 9848 raft_consensus.cc:729] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.124933 9848 consensus_queue.cc:260] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.125559 9848 ts_tablet_manager.cc:1428] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:46.125840 9848 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.126020 9813 ts_tablet_manager.cc:1939] T 78379bd4cfce46fa812374f046d9d329 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.127000 9848 tablet_bootstrap.cc:654] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.128228 9855 tablet_bootstrap.cc:492] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.128360 9855 ts_tablet_manager.cc:1397] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260928 14:50:46.129002 9855 raft_consensus.cc:348] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.129197 9855 raft_consensus.cc:374] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.129267 9855 raft_consensus.cc:729] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.129470 9855 consensus_queue.cc:260] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.130002 9855 ts_tablet_manager.cc:1428] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.130263 9855 tablet_bootstrap.cc:492] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.130587 11426 tablet.cc:1722] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 14:50:46.130821 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 78379bd4cfce46fa812374f046d9d329 (table default.Table_af4830aab30c4fccb57822e100e21564 [id=4808092de350419bba3b7bffa8967276]) successfully deleted
I20260928 14:50:46.131738 9855 tablet_bootstrap.cc:654] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.132162 9851 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.132166 9815 ts_tablet_manager.cc:1918] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:46.132853 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ce64a75bc55a4496bcd96070290a324c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce64a75bc55a4496bcd96070290a324c already in progress: creating tablet
I20260928 14:50:46.133266 9848 tablet_bootstrap.cc:492] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.133268 9815 log.cc:1196] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b339b4e3cfbd40c1a35a4c6083926869
I20260928 14:50:46.133450 9848 ts_tablet_manager.cc:1397] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260928 14:50:46.133737 9851 tablet_bootstrap.cc:654] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:46.134099 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a0d94bf844904306b84695e452d62ebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d94bf844904306b84695e452d62ebd already in progress: creating tablet
I20260928 14:50:46.134065 9848 raft_consensus.cc:348] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.134240 9848 raft_consensus.cc:374] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.134308 9848 raft_consensus.cc:729] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.134510 9848 consensus_queue.cc:260] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:46.134877 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4d48886de3194e898da13b5d546ca9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d48886de3194e898da13b5d546ca9d8 already in progress: creating tablet
I20260928 14:50:46.134918 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:46.135119 9848 ts_tablet_manager.cc:1428] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:46.135231 9813 tablet_replica.cc:330] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.135386 9848 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.135561 9813 raft_consensus.cc:2229] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.135846 9813 raft_consensus.cc:2258] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.136546 9848 tablet_bootstrap.cc:654] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.136888 9813 ts_tablet_manager.cc:1905] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.137333 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a64464b632429bbfb5df68df0923d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.137565 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5948def5cf7412da8cc128382a93854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.137831 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8818315aa3a84725a3ec0776e3e81f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.138031 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09981dbe345a40e5b1fbb06abf491ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.138206 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet facfe056ffeb41b68b1253b0387c15a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.138188 9815 ts_tablet_manager.cc:1939] T b339b4e3cfbd40c1a35a4c6083926869 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.140507 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1202) took 1126 ms. Trace:
I20260928 14:50:46.140676 9815 rpcz_store.cc:276] 0928 14:50:45.013577 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.021410 (+ 7833us) service_pool.cc:227] Handling call
0928 14:50:46.084653 (+1063243us) ts_tablet_manager.cc:1145] Deleting tablet b339b4e3cfbd40c1a35a4c6083926869
0928 14:50:46.084667 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.114483 (+ 29816us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.131598 (+ 17115us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.140408 (+ 8810us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062245}
I20260928 14:50:46.141556 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b339b4e3cfbd40c1a35a4c6083926869 (table default.Table_52f8e9a66b7d4a3983276c85bcce6661 [id=ff4502acaafc4cc4a04258a3c0211e35]) successfully deleted
I20260928 14:50:46.141614 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb194c83ae41678dcb4c08c5b66e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.141781 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9798f88e35b74aea922d4250bb3d99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.141988 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f147ecc65d034af08645f2865206416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.142127 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1201) took 1128 ms. Trace:
I20260928 14:50:46.142333 9815 rpcz_store.cc:276] 0928 14:50:45.013473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.037569 (+ 24096us) service_pool.cc:227] Handling call
0928 14:50:46.141835 (+1104266us) ts_tablet_manager.cc:1145] Deleting tablet 05342bec2afe44d3a6e21e19a16091a4
0928 14:50:46.141871 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.142109 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104081}
W20260928 14:50:46.143421 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 05342bec2afe44d3a6e21e19a16091a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05342bec2afe44d3a6e21e19a16091a4 already in progress: creating tablet
I20260928 14:50:46.145349 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7097b5a70cc448495d62ab257770144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.145881 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79640ef0f57b4b42b6be343ec46089b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.149938 11404 raft_consensus.cc:482] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.150039 11404 raft_consensus.cc:504] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.150560 11404 leader_election.cc:288] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.151628 9813 ts_tablet_manager.cc:1918] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.151672 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fbe74a73dda4330af8814bbba0cfc70" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.151758 9813 log.cc:1196] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/88d6b4482e7b42fca17e5b917e1c1bed
I20260928 14:50:46.152097 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c263399eaa479b88f24e74d85618aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.152199 9813 ts_tablet_manager.cc:1939] T 88d6b4482e7b42fca17e5b917e1c1bed P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.153462 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 88d6b4482e7b42fca17e5b917e1c1bed (table default.Table_6dacb88cb9c74873a8f69da29a43fed9 [id=27d3ad1dac4641e2b16e86da4d16ea0e]) successfully deleted
I20260928 14:50:46.153762 11303 raft_consensus.cc:482] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.153872 11303 raft_consensus.cc:504] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.154325 11303 leader_election.cc:288] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.155201 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae8348f77764a5e8787a33f657ca80d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.155280 9497 leader_election.cc:341] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:46.157773 9497 leader_election.cc:341] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.164044 11426 tablet.cc:1722] T ddb704c5128a4880ae1b89b4d4d1fcfd P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:46.167618 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fbe74a73dda4330af8814bbba0cfc70" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.173759 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae8348f77764a5e8787a33f657ca80d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.174283 9498 leader_election.cc:341] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.174342 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1204) took 1160 ms. Trace:
I20260928 14:50:46.174414 9498 leader_election.cc:302] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.174422 9815 rpcz_store.cc:276] 0928 14:50:45.013769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.041575 (+ 27806us) service_pool.cc:227] Handling call
0928 14:50:46.143784 (+1102209us) ts_tablet_manager.cc:1145] Deleting tablet 2014e5f360ee46b895ae0b0c621a6f8e
0928 14:50:46.143797 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.174324 (+ 30527us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101889}
W20260928 14:50:46.174782 9498 leader_election.cc:341] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.174872 9498 leader_election.cc:302] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.174787 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1206) took 1160 ms. Trace:
I20260928 14:50:46.175000 9815 rpcz_store.cc:276] 0928 14:50:45.013928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.045570 (+ 31642us) service_pool.cc:227] Handling call
0928 14:50:46.174685 (+1129115us) ts_tablet_manager.cc:1145] Deleting tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c
0928 14:50:46.174696 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.174773 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1128916}
I20260928 14:50:46.175303 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1212) took 1137 ms. Trace:
I20260928 14:50:46.175369 11303 raft_consensus.cc:2726] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.175524 11303 raft_consensus.cc:2726] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.175372 9815 rpcz_store.cc:276] 0928 14:50:45.038113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.050390 (+ 12277us) service_pool.cc:227] Handling call
0928 14:50:46.175209 (+1124819us) ts_tablet_manager.cc:1145] Deleting tablet 6e4f703cc19c453cbc46432a4430a204
0928 14:50:46.175218 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.175291 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1124655}
I20260928 14:50:46.175793 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1190) took 1163 ms. Trace:
I20260928 14:50:46.175871 9815 rpcz_store.cc:276] 0928 14:50:45.012538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.098577 (+ 86039us) service_pool.cc:227] Handling call
0928 14:50:46.175706 (+1077129us) ts_tablet_manager.cc:1145] Deleting tablet 0728defd0fb44c37bb8aa1e18825f3f4
0928 14:50:46.175715 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.175781 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076958}
W20260928 14:50:46.176211 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2014e5f360ee46b895ae0b0c621a6f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2014e5f360ee46b895ae0b0c621a6f8e already in progress: creating tablet
W20260928 14:50:46.176471 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c already in progress: creating tablet
I20260928 14:50:46.176733 9815 tablet_replica.cc:330] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.176915 9815 raft_consensus.cc:2229] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.177090 9815 raft_consensus.cc:2258] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.177634 9815 ts_tablet_manager.cc:1905] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.178912 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d478ac9011d46e0b24f73b829fd2bac consensus state has no leader
I20260928 14:50:46.180910 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 6a6a176464e84c94bb5cc4ba6016df12
I20260928 14:50:46.182029 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:46.182740 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 6a6a176464e84c94bb5cc4ba6016df12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6a176464e84c94bb5cc4ba6016df12 already in progress: creating tablet
W20260928 14:50:46.184087 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09981dbe345a40e5b1fbb06abf491ea9 consensus state has no leader
I20260928 14:50:46.185089 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.186987 8951 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_7684b6725e84453281f0ec575a8b7bca [id=94283cea61764b3aa25cbf7ec5c3e35a] alter complete (version 2)
I20260928 14:50:46.188009 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1a96ff77ef4349bcbda19788d63b44c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.188522 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a96ff77ef4349bcbda19788d63b44c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.190742 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_8332be7dfda0408285675aa527034cf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.191473 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8332be7dfda0408285675aa527034cf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.192426 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7993fc05acd649b492783050564153ac" } new_table_name: "default.Table_87d7eb8e06534c33a789862af0dbfc1f" modify_external_catalogs: true
I20260928 14:50:46.193146 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.193346 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.193549 9813 tablet_replica.cc:330] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.193732 9813 raft_consensus.cc:2229] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.193670 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_786543992e7b4bcd830f953e0323a919" } new_table_name: "default.Table_7657f85c0978492c808e16385624e658" modify_external_catalogs: true
I20260928 14:50:46.193873 9813 raft_consensus.cc:2258] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.194749 9813 ts_tablet_manager.cc:1905] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.194891 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6e4f703cc19c453cbc46432a4430a204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e4f703cc19c453cbc46432a4430a204 already in progress: creating tablet
W20260928 14:50:46.195083 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0728defd0fb44c37bb8aa1e18825f3f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0728defd0fb44c37bb8aa1e18825f3f4 already in progress: creating tablet
W20260928 14:50:46.195284 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 220eb184524b4cd58a4642dbbed5e9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 220eb184524b4cd58a4642dbbed5e9d8 already in progress: creating tablet
W20260928 14:50:46.195451 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2137c02d796a4290a8b160c57069fdd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2137c02d796a4290a8b160c57069fdd2 already in progress: creating tablet
W20260928 14:50:46.195639 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0904b4dbbbd2417a88cba0e67e5a31a4 already in progress: creating tablet
W20260928 14:50:46.195824 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d038f4cb0c48f3b4cc6ff66621bb2b already in progress: creating tablet
W20260928 14:50:46.196038 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4eca68f459834ce2983a27c21361eef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4eca68f459834ce2983a27c21361eef3 already in progress: creating tablet
I20260928 14:50:46.204842 9813 ts_tablet_manager.cc:1918] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.205049 9813 log.cc:1196] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/82a58b7387564863a2141a722003c5d1
I20260928 14:50:46.205639 9813 ts_tablet_manager.cc:1939] T 82a58b7387564863a2141a722003c5d1 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.205968 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6a176464e84c94bb5cc4ba6016df12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.209161 9815 ts_tablet_manager.cc:1918] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:46.211277 9815 log.cc:1196] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/3bef7b73d24a42979fcb7a2e47e92919
I20260928 14:50:46.211331 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c54cb0e8f2347d9b139c8766fb61ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.211592 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet af22f23ff3864620bfefb31b9e899036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.211659 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.211843 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.211993 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.212205 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a76f0a26d27b41dcabf3037845dfe4ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.214371 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a76f0a26d27b41dcabf3037845dfe4ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.216406 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_cb59a8d6db944b7c8f4194a31233e854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.217202 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb59a8d6db944b7c8f4194a31233e854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.217718 9814 ts_tablet_manager.cc:1918] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.217837 9814 log.cc:1196] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/cbb232c73f014351b796a86180ffb660
I20260928 14:50:46.222057 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 82a58b7387564863a2141a722003c5d1 (table default.Table_a7caeee85f464e589dd70456b01066c0 [id=169f04bd95084e7fa6a54584f803da19]) successfully deleted
I20260928 14:50:46.222525 9813 tablet_replica.cc:330] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.223285 9813 raft_consensus.cc:2229] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.223858 9813 raft_consensus.cc:2258] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.224574 9848 tablet_bootstrap.cc:492] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.224848 9848 ts_tablet_manager.cc:1397] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.019s
I20260928 14:50:46.225796 11404 raft_consensus.cc:482] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.225939 11404 raft_consensus.cc:504] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.226549 11404 leader_election.cc:288] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.226224 9848 raft_consensus.cc:348] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.226836 9848 raft_consensus.cc:374] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.226919 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.227025 9848 raft_consensus.cc:729] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.227236 9813 ts_tablet_manager.cc:1905] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.227101 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.227437 9497 leader_election.cc:341] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:46.227877 9498 leader_election.cc:341] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.228014 9498 leader_election.cc:302] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.227919 9848 consensus_queue.cc:260] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.228341 11404 raft_consensus.cc:2726] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.229030 9848 ts_tablet_manager.cc:1428] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:46.229712 9848 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.218104 9814 ts_tablet_manager.cc:1939] T cbb232c73f014351b796a86180ffb660 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.232203 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1123) took 2727 ms. Trace:
I20260928 14:50:46.232751 9814 rpcz_store.cc:276] 0928 14:50:43.504738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.506135 (+ 1397us) service_pool.cc:227] Handling call
0928 14:50:45.553960 (+2047825us) ts_tablet_manager.cc:1145] Deleting tablet cbb232c73f014351b796a86180ffb660
0928 14:50:45.553973 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.137574 (+583601us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.217642 (+ 80068us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.232186 (+ 14544us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047721}
I20260928 14:50:46.234272 9815 ts_tablet_manager.cc:1939] T 3bef7b73d24a42979fcb7a2e47e92919 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.235723 9814 tablet_replica.cc:330] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.236462 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:46.238750 11223 raft_consensus.cc:482] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.238862 11223 raft_consensus.cc:504] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.239338 11223 leader_election.cc:288] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.239930 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df12117111548beb5d570436e2d6de2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.240444 9220 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.241803 11404 raft_consensus.cc:482] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.241920 11404 raft_consensus.cc:504] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.242427 11404 leader_election.cc:288] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.242960 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ade6066d90547b6bb9be50799bf8d5f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.241567 11411 tablet.cc:1722] T 0868e5ce22874134a2f50e2404970bb8 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 14:50:46.244010 9498 leader_election.cc:341] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.245311 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ade6066d90547b6bb9be50799bf8d5f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.245806 9497 leader_election.cc:341] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.245903 9497 leader_election.cc:302] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.246244 11404 raft_consensus.cc:2726] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.247380 9814 raft_consensus.cc:2229] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.248072 9813 ts_tablet_manager.cc:1918] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.248245 9813 log.cc:1196] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/286f5e0fb1414305ab0a1b5df3ed4ff3
I20260928 14:50:46.248623 9813 ts_tablet_manager.cc:1939] T 286f5e0fb1414305ab0a1b5df3ed4ff3 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.249184 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 286f5e0fb1414305ab0a1b5df3ed4ff3 (table default.Table_8de99502a21e4bd898e0642bd72a7aaa [id=0b3548e3cc0e48ef849a2d02966f8158]) successfully deleted
I20260928 14:50:46.253645 9814 raft_consensus.cc:2258] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.254170 9814 ts_tablet_manager.cc:1905] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.266644 11404 raft_consensus.cc:482] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.266769 11404 raft_consensus.cc:504] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.267326 11404 leader_election.cc:288] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.267858 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4684ba575d9d45f3bb059a15efdd936d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.268353 9497 leader_election.cc:341] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.269173 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4684ba575d9d45f3bb059a15efdd936d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.270504 9498 leader_election.cc:341] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.270613 9498 leader_election.cc:302] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.270975 11404 raft_consensus.cc:2726] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.273577 9814 ts_tablet_manager.cc:1918] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.273972 9814 log.cc:1196] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2df12117111548beb5d570436e2d6de2
I20260928 14:50:46.274484 9814 ts_tablet_manager.cc:1939] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.275892 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1119) took 2771 ms. Trace:
I20260928 14:50:46.276151 9814 rpcz_store.cc:276] 0928 14:50:43.504323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.506430 (+ 2107us) service_pool.cc:227] Handling call
0928 14:50:46.235050 (+2728620us) ts_tablet_manager.cc:1145] Deleting tablet 2df12117111548beb5d570436e2d6de2
0928 14:50:46.235063 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.257212 (+ 22149us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.273471 (+ 16259us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.275871 (+ 2400us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6039,"tablet-delete.queue_time_us":2728498}
I20260928 14:50:46.277154 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1126) took 2676 ms. Trace:
I20260928 14:50:46.280598 9814 rpcz_store.cc:276] 0928 14:50:43.601091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.601171 (+ 80us) service_pool.cc:227] Handling call
0928 14:50:46.277016 (+2675845us) ts_tablet_manager.cc:1145] Deleting tablet 19a668806adc4975bebb4ebb1a9d3c82
0928 14:50:46.277028 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.277139 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2675675}
I20260928 14:50:46.281198 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1125) took 2680 ms. Trace:
I20260928 14:50:46.281695 9814 rpcz_store.cc:276] 0928 14:50:43.600965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.604844 (+ 3879us) service_pool.cc:227] Handling call
0928 14:50:46.281094 (+2676250us) ts_tablet_manager.cc:1145] Deleting tablet a5eb8907be064167a3739715d24c94e9
0928 14:50:46.281104 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.281185 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2676065}
I20260928 14:50:46.282217 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1128) took 2559 ms. Trace:
I20260928 14:50:46.282600 9814 rpcz_store.cc:276] 0928 14:50:43.723106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.723202 (+ 96us) service_pool.cc:227] Handling call
0928 14:50:46.282122 (+2558920us) ts_tablet_manager.cc:1145] Deleting tablet 6f73568a67cb401388beaa266a0324fc
0928 14:50:46.282132 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.282203 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2558756}
I20260928 14:50:46.283239 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1129) took 2557 ms. Trace:
I20260928 14:50:46.283600 9814 rpcz_store.cc:276] 0928 14:50:43.725454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.725506 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:46.283146 (+2557640us) ts_tablet_manager.cc:1145] Deleting tablet 5d8e4357c3d5487fa76e1e49c6cb7547
0928 14:50:46.283155 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.283225 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2557473}
W20260928 14:50:46.283885 9219 leader_election.cc:341] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7376f56883dc4032b120cc4494fa8936
I20260928 14:50:46.284132 9219 leader_election.cc:302] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.284288 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1127) took 2562 ms. Trace:
I20260928 14:50:46.284682 9814 rpcz_store.cc:276] 0928 14:50:43.721505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.727304 (+ 5799us) service_pool.cc:227] Handling call
0928 14:50:46.284195 (+2556891us) ts_tablet_manager.cc:1145] Deleting tablet d604978c5289471a854c9b286d137f61
0928 14:50:46.284204 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.284274 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2556740}
I20260928 14:50:46.284773 11223 raft_consensus.cc:2726] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.285281 9814 tablet_replica.cc:330] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.285686 9814 raft_consensus.cc:2229] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.286075 9814 raft_consensus.cc:2258] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.286734 9814 ts_tablet_manager.cc:1905] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.291602 9815 tablet_replica.cc:330] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.233268 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet cbb232c73f014351b796a86180ffb660 (table default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]) successfully deleted
W20260928 14:50:46.296415 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 63148.2us
I20260928 14:50:46.297115 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]) successfully deleted
I20260928 14:50:46.297633 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2df12117111548beb5d570436e2d6de2 (table default.Table_19caea08036943b0b17c5e53d8c486b3 [id=b5e9a91ec4124a81a3410ab71fb084bb]) successfully deleted
W20260928 14:50:46.297920 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 19a668806adc4975bebb4ebb1a9d3c82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19a668806adc4975bebb4ebb1a9d3c82 already in progress: creating tablet
W20260928 14:50:46.298141 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a5eb8907be064167a3739715d24c94e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5eb8907be064167a3739715d24c94e9 already in progress: creating tablet
W20260928 14:50:46.298311 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6f73568a67cb401388beaa266a0324fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f73568a67cb401388beaa266a0324fc already in progress: creating tablet
W20260928 14:50:46.298465 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d8e4357c3d5487fa76e1e49c6cb7547 already in progress: creating tablet
W20260928 14:50:46.298593 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d604978c5289471a854c9b286d137f61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604978c5289471a854c9b286d137f61 already in progress: creating tablet
I20260928 14:50:46.301072 9848 tablet_bootstrap.cc:654] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.305632 9815 raft_consensus.cc:2229] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.305866 9815 raft_consensus.cc:2258] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.306674 9815 ts_tablet_manager.cc:1905] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.309098 9814 ts_tablet_manager.cc:1918] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.309464 9425 raft_consensus.cc:3037] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.310007 9814 log.cc:1196] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e5ac853c5b6f4f9cb9de91e6aa448c75
I20260928 14:50:46.310468 9814 ts_tablet_manager.cc:1939] T e5ac853c5b6f4f9cb9de91e6aa448c75 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.311123 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1130) took 2571 ms. Trace:
I20260928 14:50:46.311133 11377 raft_consensus.cc:482] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.311241 11377 raft_consensus.cc:504] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.311818 11377 leader_election.cc:288] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.311625 9814 rpcz_store.cc:276] 0928 14:50:43.739369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.741576 (+ 2207us) service_pool.cc:227] Handling call
0928 14:50:46.285241 (+2543665us) ts_tablet_manager.cc:1145] Deleting tablet e5ac853c5b6f4f9cb9de91e6aa448c75
0928 14:50:46.285252 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.296957 (+ 11705us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.309021 (+ 12064us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.311106 (+ 2085us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2543509}
I20260928 14:50:46.312351 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (table default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]) successfully deleted
I20260928 14:50:46.312404 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:46.313043 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1131) took 2547 ms. Trace:
I20260928 14:50:46.313205 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c81b682dea493fac8665d8ccff7199" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.313241 9814 rpcz_store.cc:276] 0928 14:50:43.765289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.765693 (+ 404us) service_pool.cc:227] Handling call
0928 14:50:46.312694 (+2547001us) ts_tablet_manager.cc:1145] Deleting tablet 71ec7763cd5e4578919ce5824eea1329
0928 14:50:46.312704 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.312787 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2546842}
I20260928 14:50:46.313704 9360 leader_election.cc:302] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:46.313911 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 71ec7763cd5e4578919ce5824eea1329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ec7763cd5e4578919ce5824eea1329 already in progress: creating tablet
I20260928 14:50:46.314198 9814 tablet_replica.cc:330] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.314500 11377 raft_consensus.cc:2726] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.314559 9814 raft_consensus.cc:2229] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.315004 9814 raft_consensus.cc:2258] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.317327 9814 ts_tablet_manager.cc:1905] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.324466 9814 ts_tablet_manager.cc:1918] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.328986 9848 tablet_bootstrap.cc:492] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.329114 9848 ts_tablet_manager.cc:1397] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.100s user 0.005s sys 0.000s
I20260928 14:50:46.329252 9424 raft_consensus.cc:3037] T 55c81b682dea493fac8665d8ccff7199 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.330253 9848 raft_consensus.cc:348] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.336021 9848 raft_consensus.cc:374] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.336750 9848 raft_consensus.cc:729] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.337718 9848 consensus_queue.cc:260] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.337970 9814 log.cc:1196] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9cb3cc5b42524a4399d0bcf21c851fd8
I20260928 14:50:46.338407 9814 ts_tablet_manager.cc:1939] T 9cb3cc5b42524a4399d0bcf21c851fd8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.339267 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1132) took 2570 ms. Trace:
I20260928 14:50:46.339722 9814 rpcz_store.cc:276] 0928 14:50:43.768742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.768924 (+ 182us) service_pool.cc:227] Handling call
0928 14:50:46.314156 (+2545232us) ts_tablet_manager.cc:1145] Deleting tablet 9cb3cc5b42524a4399d0bcf21c851fd8
0928 14:50:46.314166 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.321762 (+ 7596us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.324395 (+ 2633us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.339250 (+ 14855us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3,"tablet-delete.queue_time_us":2545085}
I20260928 14:50:46.340075 9848 ts_tablet_manager.cc:1428] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260928 14:50:46.340415 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (table default.Table_27c8c6bf92104baba58d5f721c298c16 [id=44b6b5a0e8a4438c97dd07f6c86ffef6]) successfully deleted
I20260928 14:50:46.340804 9814 tablet_replica.cc:330] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.341158 9814 raft_consensus.cc:2229] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.341564 9814 raft_consensus.cc:2258] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.342233 9814 ts_tablet_manager.cc:1905] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.339916 9219 leader_election.cc:302] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.344208 11228 raft_consensus.cc:2781] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:46.344316 11228 raft_consensus.cc:686] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:46.344503 11228 consensus_queue.cc:237] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.340693 9848 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:46.350318 9219 leader_election.cc:341] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 30d197a8ba8848d98ba0f03b2e83d3f6
I20260928 14:50:46.350466 9219 leader_election.cc:302] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.350656 11228 raft_consensus.cc:2726] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.357362 9848 tablet_bootstrap.cc:654] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.358805 9815 ts_tablet_manager.cc:1918] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:46.358946 9815 log.cc:1196] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/7aa9167742a94a0ab586e15205a0ccdc
I20260928 14:50:46.359738 9815 ts_tablet_manager.cc:1939] T 7aa9167742a94a0ab586e15205a0ccdc P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.360466 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a092daf652f54ff792d60a1edd7da165"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.360991 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a092daf652f54ff792d60a1edd7da165 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.361853 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:46.362057 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
W20260928 14:50:46.363343 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d0dc1a1900846bca0041da5bb918acd consensus state has no leader
I20260928 14:50:46.364445 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_985a3dd0ae1844b5896f4cffa47a0fd8" } modify_external_catalogs: true
I20260928 14:50:46.364614 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_985a3dd0ae1844b5896f4cffa47a0fd8" } modify_external_catalogs: true
I20260928 14:50:46.365566 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2dca633ce1cb4d73be5555582d483a78" } modify_external_catalogs: true
I20260928 14:50:46.365710 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_2dca633ce1cb4d73be5555582d483a78" } modify_external_catalogs: true
W20260928 14:50:46.366029 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6f09bae9c9a40c9a94823a92706a65d consensus state has no leader
I20260928 14:50:46.366325 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d7270bcdf2fd41f59e502b5bbe93cd19" } modify_external_catalogs: true
I20260928 14:50:46.366461 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d7270bcdf2fd41f59e502b5bbe93cd19" } modify_external_catalogs: true
I20260928 14:50:46.366438 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e0f6421a3947442ea2ee9829ccece5e0" } new_table_name: "default.Table_44495e0b3b1a458dafb4e564b0b91873" modify_external_catalogs: true
I20260928 14:50:46.368292 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 82a58b7387564863a2141a722003c5d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.368484 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b8584ba1914c3390aee99baaee289e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:25 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.368629 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d94bf844904306b84695e452d62ebd with delete_type TABLET_DATA_DELETED (replaced by tablet 028100ff68ad408db9266317f590d693) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.368665 9813 tablet_replica.cc:330] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.368825 9813 raft_consensus.cc:2229] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.368966 9813 raft_consensus.cc:2258] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:46.369872 8940 catalog_manager.cc:4808] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 82a58b7387564863a2141a722003c5d1 because the tablet was not found. No further retry: Not found: Tablet not found: 82a58b7387564863a2141a722003c5d1
I20260928 14:50:46.369911 9855 tablet_bootstrap.cc:492] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.370043 9855 ts_tablet_manager.cc:1397] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.240s user 0.006s sys 0.008s
I20260928 14:50:46.370831 9813 ts_tablet_manager.cc:1905] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.370859 9855 raft_consensus.cc:348] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.371059 9855 raft_consensus.cc:374] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.371115 9855 raft_consensus.cc:729] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.371308 9855 consensus_queue.cc:260] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.371832 9855 ts_tablet_manager.cc:1428] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.373065 9814 ts_tablet_manager.cc:1918] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.373728 9814 log.cc:1196] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:46.374166 9814 ts_tablet_manager.cc:1939] T d96492abf8cf459a992dd1d7b0226b57 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.373449 9219 leader_election.cc:302] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.377722 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1133) took 2608 ms. Trace:
I20260928 14:50:46.377764 11228 raft_consensus.cc:2781] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:46.378324 11228 raft_consensus.cc:482] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:46.378408 11228 raft_consensus.cc:3037] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.378420 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet eae5af64cea44e7f86358edae40caa99 (table default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb]). Expected version 1 got 0
I20260928 14:50:46.378242 9814 rpcz_store.cc:276] 0928 14:50:43.768848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.772379 (+ 3531us) service_pool.cc:227] Handling call
0928 14:50:46.340759 (+2568380us) ts_tablet_manager.cc:1145] Deleting tablet d96492abf8cf459a992dd1d7b0226b57
0928 14:50:46.340771 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.356919 (+ 16148us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.372984 (+ 16065us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.377704 (+ 4720us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568217}
I20260928 14:50:46.378615 8951 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 2 got 0
I20260928 14:50:46.379112 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d96492abf8cf459a992dd1d7b0226b57 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:46.379426 9814 tablet_replica.cc:330] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.379436 9813 ts_tablet_manager.cc:1918] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.379727 9813 log.cc:1196] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/41b8584ba1914c3390aee99baaee289e
I20260928 14:50:46.379900 9814 raft_consensus.cc:2229] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.379774 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3ab56e590dcf4109b0ba3832aaa72493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.380321 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ab56e590dcf4109b0ba3832aaa72493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.380409 9813 ts_tablet_manager.cc:1939] T 41b8584ba1914c3390aee99baaee289e P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.380369 9814 raft_consensus.cc:2258] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.381026 9814 ts_tablet_manager.cc:1905] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.381208 9813 tablet_replica.cc:330] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.381500 11228 raft_consensus.cc:504] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.382115 11228 leader_election.cc:288] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.382936 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:46.383556 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 41b8584ba1914c3390aee99baaee289e (table default.Table_8555813545314aaebb0761b7f5dc260c [id=d2b41d700c944d71b8d4e44cf09276ec]) successfully deleted
I20260928 14:50:46.383406 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet cbb232c73f014351b796a86180ffb660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:46.384217 9220 leader_election.cc:341] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.384550 9813 raft_consensus.cc:2229] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.384842 9813 raft_consensus.cc:2258] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.386129 9813 ts_tablet_manager.cc:1905] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.386250 9219 leader_election.cc:341] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 6d193edcfa684b8795b084f3106903c5
I20260928 14:50:46.386385 9219 leader_election.cc:302] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.386623 11223 raft_consensus.cc:2726] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:46.388402 9219 consensus_peers.cc:487] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a08d91a06ca4effbc8fc4e83d88fe93. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.394232 11426 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:46.394410 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet cacb6cd51f3b4f238813e764818767c2 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:46.394778 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b17faf5198e048b2824aea3308070fa8 consensus state has no leader
I20260928 14:50:46.395139 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_25bfa6420cde48e992b706d92a31d90e" } modify_external_catalogs: true
I20260928 14:50:46.395294 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_25bfa6420cde48e992b706d92a31d90e" } modify_external_catalogs: true
I20260928 14:50:46.395749 11303 raft_consensus.cc:482] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.395859 11303 raft_consensus.cc:504] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.396366 11303 leader_election.cc:288] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.396875 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3abf8936d34eaba6d60245727738dc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.397380 9497 leader_election.cc:341] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.397925 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3abf8936d34eaba6d60245727738dc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.398806 9498 leader_election.cc:341] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.398895 9498 leader_election.cc:302] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.402477 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_89c1bc2e746043ccaa50688a9cf8d737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.402971 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89c1bc2e746043ccaa50688a9cf8d737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.403955 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 66096599d4c5458db2af10eb9bac947b (table default.Table_873b3a81bf8744d58006a5de41eecf57 [id=8950fbd3e79c4d9eb9d51a3294b3f824]). Expected version 3 got 0
I20260928 14:50:46.406075 9253 tablet_service.cc:1467] Processing CreateTablet for tablet a360e7e4c16746438f117c8e5ff60c19 (DEFAULT_TABLE table=default.Table_55e2dd0b086b49a09f8873ab4180b5e3 [id=3c2e1387322743b1b9cb6aba038456b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.406529 11404 raft_consensus.cc:2726] T 9b3abf8936d34eaba6d60245727738dc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.407050 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8ecaaab9b90044d8a46972af10da0676" } new_table_name: "default.Table_bc9b9b5dcc76432399c8cbb4ca77e163" modify_external_catalogs: true
I20260928 14:50:46.407745 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 69239e1cc64f40e59f14c3716437de54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.407938 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ade6066d90547b6bb9be50799bf8d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:44 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.408093 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d08466aa7d54f12b137986258a6d174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.408469 9388 tablet_service.cc:1467] Processing CreateTablet for tablet a360e7e4c16746438f117c8e5ff60c19 (DEFAULT_TABLE table=default.Table_55e2dd0b086b49a09f8873ab4180b5e3 [id=3c2e1387322743b1b9cb6aba038456b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.408838 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a360e7e4c16746438f117c8e5ff60c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.410295 9851 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.410456 9851 ts_tablet_manager.cc:1397] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.278s user 0.041s sys 0.009s
I20260928 14:50:46.411070 9851 raft_consensus.cc:348] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.411952 9855 tablet_bootstrap.cc:492] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.412815 9851 raft_consensus.cc:374] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.412930 9851 raft_consensus.cc:729] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.413152 9851 consensus_queue.cc:260] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.413857 9851 ts_tablet_manager.cc:1428] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:46.414142 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a360e7e4c16746438f117c8e5ff60c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.409451 8955 catalog_manager.cc:5495] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:46.414685 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:46.418665 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 24f53d04326f4e639be23564563034e0
I20260928 14:50:46.419047 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 2871c2000c9f41f9ba8145ed0c3ee508
I20260928 14:50:46.419369 8950 catalog_manager.cc:6565] ReplaceTablet: tablet 2871c2000c9f41f9ba8145ed0c3ee508 deleted and replaced by tablet ba3c51e7f3874390b9e91cd4eb024e6e
I20260928 14:50:46.419652 9851 tablet_bootstrap.cc:492] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.420071 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 22e642af72ff4f5285f8bc4e6ed36401
I20260928 14:50:46.421440 9851 tablet_bootstrap.cc:654] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.421682 9814 ts_tablet_manager.cc:1918] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.422444 9814 log.cc:1196] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/148e81f8add349f2b233862a7049e54c
I20260928 14:50:46.422772 9814 ts_tablet_manager.cc:1939] T 148e81f8add349f2b233862a7049e54c P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.423520 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f53d04326f4e639be23564563034e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.423708 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 with delete_type TABLET_DATA_DELETED (replaced by tablet ba3c51e7f3874390b9e91cd4eb024e6e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.423866 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1134) took 2584 ms. Trace:
I20260928 14:50:46.423974 9814 rpcz_store.cc:276] 0928 14:50:43.839623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.839673 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:46.379386 (+2539713us) ts_tablet_manager.cc:1145] Deleting tablet 148e81f8add349f2b233862a7049e54c
0928 14:50:46.379397 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.385678 (+ 6281us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.421608 (+ 35930us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.423851 (+ 2243us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2505281}
I20260928 14:50:46.424153 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f53d04326f4e639be23564563034e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.424924 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 with delete_type TABLET_DATA_DELETED (replaced by tablet ba3c51e7f3874390b9e91cd4eb024e6e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.425032 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.425225 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f53d04326f4e639be23564563034e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.425313 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet 2871c2000c9f41f9ba8145ed0c3ee508 with delete_type TABLET_DATA_DELETED (replaced by tablet ba3c51e7f3874390b9e91cd4eb024e6e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.425552 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.426008 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 148e81f8add349f2b233862a7049e54c (table default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]) successfully deleted
I20260928 14:50:46.426028 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e642af72ff4f5285f8bc4e6ed36401 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.426309 9814 tablet_replica.cc:330] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.426508 9814 raft_consensus.cc:2229] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:46.426879 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6e60e487cf1f4b219f698d44e4fdb1b6" } new_table_name: "default.Table_10a3944740d347fc8cb11224ea69cada" modify_external_catalogs: true
I20260928 14:50:46.427169 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08bce102125416fbcf446f12243ebe9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:46.427242 9814 raft_consensus.cc:2258] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.427345 9569 raft_consensus.cc:3037] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.427802 9814 ts_tablet_manager.cc:1905] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.430258 9569 raft_consensus.cc:2454] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:46.430424 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd00b9377b245a29d2a6735248112bc with delete_type TABLET_DATA_DELETED (replaced by tablet c69091fb32fc47a6a4648f1b4b11356f) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.430536 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 4fdc5e3f83924f4cae8d30be9dcce152
I20260928 14:50:46.431466 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.431666 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.431808 11371 raft_consensus.cc:482] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.431913 11371 raft_consensus.cc:504] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.432323 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fdc5e3f83924f4cae8d30be9dcce152 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.432590 11371 leader_election.cc:288] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.432643 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f02d0e8cb13d4d7b9340bf625a4fa4c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.432744 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af22f23ff3864620bfefb31b9e899036" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.433187 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f02d0e8cb13d4d7b9340bf625a4fa4c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:46.433192 9220 leader_election.cc:341] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.433795 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_141501ce8d6e48f3a7c7fa5542dfe488"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.434290 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_141501ce8d6e48f3a7c7fa5542dfe488 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.435925 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_61cbc1c34ee849ca9d0e63c4919bfcfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.436405 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61cbc1c34ee849ca9d0e63c4919bfcfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.438714 9851 tablet_bootstrap.cc:492] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.438819 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_33d213a97ea349d6ab97a84fd1571e6d [id=e00f618e9273435db59f9445f6485b89]) successfully deleted
I20260928 14:50:46.438856 9851 ts_tablet_manager.cc:1397] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260928 14:50:46.439515 9851 raft_consensus.cc:348] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.439719 9851 raft_consensus.cc:374] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.439790 9851 raft_consensus.cc:729] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.439942 9815 tablet_replica.cc:330] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.439973 9851 consensus_queue.cc:260] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.440165 9815 raft_consensus.cc:2229] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.440330 9815 raft_consensus.cc:2258] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.440615 9851 ts_tablet_manager.cc:1428] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.440874 9851 tablet_bootstrap.cc:492] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.441622 9815 ts_tablet_manager.cc:1905] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.444226 9851 tablet_bootstrap.cc:654] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.444768 9848 tablet_bootstrap.cc:492] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.444921 9848 ts_tablet_manager.cc:1397] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.001s
I20260928 14:50:46.445621 9848 raft_consensus.cc:348] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.445828 9848 raft_consensus.cc:374] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.445982 9848 raft_consensus.cc:729] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.446347 9848 consensus_queue.cc:260] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.448711 9848 ts_tablet_manager.cc:1428] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260928 14:50:46.449855 9848 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.453209 9814 ts_tablet_manager.cc:1918] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:46.454200 9814 log.cc:1196] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/82b9dad76ac94a03811e4793e0234aad
I20260928 14:50:46.454385 9815 ts_tablet_manager.cc:1918] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:46.454541 9815 log.cc:1196] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/2c50f7410dd549f399449487556f813d
I20260928 14:50:46.454591 9814 ts_tablet_manager.cc:1939] T 82b9dad76ac94a03811e4793e0234aad P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.454874 9815 ts_tablet_manager.cc:1939] T 2c50f7410dd549f399449487556f813d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.455856 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]) successfully deleted
I20260928 14:50:46.456658 9813 ts_tablet_manager.cc:1918] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:46.457777 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ba96eb0f6c0141ee96e30496cbb19edc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba96eb0f6c0141ee96e30496cbb19edc already in progress: creating tablet
I20260928 14:50:46.457929 9424 raft_consensus.cc:3037] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.458182 9813 log.cc:1196] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/a0d94bf844904306b84695e452d62ebd
I20260928 14:50:46.459329 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1136) took 2548 ms. Trace:
I20260928 14:50:46.459407 9814 rpcz_store.cc:276] 0928 14:50:43.911008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.911052 (+ 44us) service_pool.cc:227] Handling call
0928 14:50:46.426260 (+2515208us) ts_tablet_manager.cc:1145] Deleting tablet 82b9dad76ac94a03811e4793e0234aad
0928 14:50:46.426271 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.446377 (+ 20106us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.453138 (+ 6761us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.459310 (+ 6172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515020}
W20260928 14:50:46.459813 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ce64a75bc55a4496bcd96070290a324c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce64a75bc55a4496bcd96070290a324c already in progress: creating tablet
I20260928 14:50:46.459846 9815 tablet_replica.cc:330] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.459975 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 82b9dad76ac94a03811e4793e0234aad (table default.Table_b9ca5b8e7dfb44ce97e6f0fb97848f04 [id=69ab51b75b6644a8abb75963384f382e]) successfully deleted
I20260928 14:50:46.460021 9815 raft_consensus.cc:2229] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.460520 9815 raft_consensus.cc:2258] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.461282 9815 ts_tablet_manager.cc:1905] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.462610 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b39c67a1cf4c4a97af85aaf0484835f8
I20260928 14:50:46.463223 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet cacb6cd51f3b4f238813e764818767c2
I20260928 14:50:46.463594 8949 catalog_manager.cc:6565] ReplaceTablet: tablet cacb6cd51f3b4f238813e764818767c2 deleted and replaced by tablet 16f38e7ca6b644fd8173ff5b7ee61c3e
I20260928 14:50:46.463637 9813 ts_tablet_manager.cc:1939] T a0d94bf844904306b84695e452d62ebd P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.464285 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fb2feb8adf57477ab915eea1d980d3e6
I20260928 14:50:46.464762 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:46.464862 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54b58ab7cd1d495c985d3e383159fe64 consensus state has no leader
I20260928 14:50:46.464944 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet cacb6cd51f3b4f238813e764818767c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 16f38e7ca6b644fd8173ff5b7ee61c3e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.466054 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.466450 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.467494 9813 tablet_replica.cc:330] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.469570 9813 raft_consensus.cc:2229] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.470834 9848 tablet_bootstrap.cc:654] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.470808 9813 raft_consensus.cc:2258] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.471961 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.472180 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet a0d94bf844904306b84695e452d62ebd (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
I20260928 14:50:46.472466 9814 tablet_replica.cc:330] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.476486 9814 raft_consensus.cc:2229] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.478209 9814 raft_consensus.cc:2258] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.478276 9813 ts_tablet_manager.cc:1905] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.481330 11223 raft_consensus.cc:482] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.481449 11223 raft_consensus.cc:504] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.482029 11223 leader_election.cc:288] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.482788 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52993ae8b63d4fbaa8cf38720af3dea5" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.483289 9220 leader_election.cc:341] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.488588 9814 ts_tablet_manager.cc:1905] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.503962 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet cacb6cd51f3b4f238813e764818767c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 16f38e7ca6b644fd8173ff5b7ee61c3e) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:46.507637 9219 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2df12117111548beb5d570436e2d6de2
I20260928 14:50:46.513835 9219 leader_election.cc:302] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.515292 9848 tablet_bootstrap.cc:492] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.516079 9855 tablet_bootstrap.cc:654] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.516907 11223 raft_consensus.cc:482] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae832871bd1142f7af10c084115ffc12)
I20260928 14:50:46.465416 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet b39c67a1cf4c4a97af85aaf0484835f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.466070 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet cacb6cd51f3b4f238813e764818767c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 16f38e7ca6b644fd8173ff5b7ee61c3e) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.517438 11223 raft_consensus.cc:504] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } }
I20260928 14:50:46.466423 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2feb8adf57477ab915eea1d980d3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.478724 11411 tablet.cc:1717] T 4f54c1b1f9054e1c9adfda720784e5a8 P 658e483a10314e8d93c2f6e9084f2a91: Skipping requested alter to schema version 3, tablet already version 3
I20260928 14:50:46.479550 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:46.518101 11223 leader_election.cc:288] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:46.518815 9219 raft_consensus.cc:2670] T 2df12117111548beb5d570436e2d6de2 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:46.519094 9220 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Not found: Tablet not found: d27a357d905e463ba9507f74e575acb1
I20260928 14:50:46.506098 11453 raft_consensus.cc:482] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.507990 9533 tablet_service.cc:1467] Processing CreateTablet for tablet a360e7e4c16746438f117c8e5ff60c19 (DEFAULT_TABLE table=default.Table_55e2dd0b086b49a09f8873ab4180b5e3 [id=3c2e1387322743b1b9cb6aba038456b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.519929 11453 raft_consensus.cc:504] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.520186 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a360e7e4c16746438f117c8e5ff60c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.520973 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69239e1cc64f40e59f14c3716437de54" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.521369 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 0d77597df00a4e8388a5bc07ac5a3baf (DEFAULT_TABLE table=default.Table_b767d88818724383a745af686bee65e8 [id=bd84e160f2ca465894cbc7a14c08a39f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:46.521427 9498 leader_election.cc:341] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.521564 11453 leader_election.cc:288] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.521710 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d77597df00a4e8388a5bc07ac5a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.521693 11453 raft_consensus.cc:482] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.521783 11453 raft_consensus.cc:504] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:46.521914 9219 consensus_peers.cc:487] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba0d51f1c2664e0b8c6acb7847eff7cc. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.522534 9287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aff7eb9a7ff4ed79305806c30c30627" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.522984 9497 leader_election.cc:341] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.523929 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aff7eb9a7ff4ed79305806c30c30627" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.524427 9498 leader_election.cc:341] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.524518 9498 leader_election.cc:302] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.524665 11456 tablet.cc:1722] T e13976317a32495ab377654b738667ca P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:46.524801 11453 leader_election.cc:288] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.525007 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69239e1cc64f40e59f14c3716437de54" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.525971 9497 leader_election.cc:341] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.526065 9497 leader_election.cc:302] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.526083 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 0d77597df00a4e8388a5bc07ac5a3baf (DEFAULT_TABLE table=default.Table_b767d88818724383a745af686bee65e8 [id=bd84e160f2ca465894cbc7a14c08a39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.526449 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d77597df00a4e8388a5bc07ac5a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:46.529704 9219 consensus_peers.cc:487] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aa9167742a94a0ab586e15205a0ccdc. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.529780 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 028100ff68ad408db9266317f590d693 (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.529860 9219 leader_election.cc:302] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.530114 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028100ff68ad408db9266317f590d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.534765 11404 raft_consensus.cc:2726] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.534854 11303 raft_consensus.cc:2726] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.540030 9815 ts_tablet_manager.cc:1918] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:46.540134 9815 log.cc:1196] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/a0d94bf844904306b84695e452d62ebd
I20260928 14:50:46.541510 9815 ts_tablet_manager.cc:1939] T a0d94bf844904306b84695e452d62ebd P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.542934 9815 tablet_replica.cc:330] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.544556 9815 raft_consensus.cc:2229] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.544970 9815 raft_consensus.cc:2258] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.547104 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet a0d94bf844904306b84695e452d62ebd (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
W20260928 14:50:46.549657 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb9e66f2b273470e88e97ece175d6065 consensus state has no leader
I20260928 14:50:46.552057 11411 tablet.cc:1722] T eae5af64cea44e7f86358edae40caa99 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:46.557085 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b22c3f9578a464a96be0bac6127e56d with delete_type TABLET_DATA_DELETED (replaced by tablet b8738a1591f644758f44fc720fd694a3) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.565976 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1fb3ee1e2b4ce5951b687393f2483c (DEFAULT_TABLE table=default.Table_5cce8a07a9ba4dfb839e1317e79122f2 [id=d4382650b60f4c1790234fa902dcc106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.566632 9815 ts_tablet_manager.cc:1905] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.566768 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1fb3ee1e2b4ce5951b687393f2483c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.566704 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 028100ff68ad408db9266317f590d693 (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.567040 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028100ff68ad408db9266317f590d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.567698 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_81f61ff9b7bb4fa8a0f6ce39df0e521b" } new_table_name: "default.Table_f8c9e8e4cfac46c9a2197e7c2ace169c" modify_external_catalogs: true
I20260928 14:50:46.569034 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f4d3dbaeb1f84920827d26b8973ddc73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.569572 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4d3dbaeb1f84920827d26b8973ddc73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.570607 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f8c9069e1e21484586c327e9d56a966a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.571017 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8c9069e1e21484586c327e9d56a966a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.576123 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_836c57f02277490ab989a2438b10304c" } new_table_name: "default.Table_9ebe8428644f42098aedbac01fec7cad" modify_external_catalogs: true
I20260928 14:50:46.577311 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.577791 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:46.578886 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 531ebf7e1f6c4ed385f77e5360384b16 consensus state has no leader
I20260928 14:50:46.580396 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_821a2620e0a049108c3a745a86f6f553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.580904 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_821a2620e0a049108c3a745a86f6f553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.582420 11223 raft_consensus.cc:2781] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:46.582559 11223 raft_consensus.cc:686] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:46.582796 11223 consensus_queue.cc:237] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.525327 9848 ts_tablet_manager.cc:1397] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.076s user 0.009s sys 0.000s
W20260928 14:50:46.590073 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f1317707bc6427080e37ef098e11c9a consensus state has no leader
I20260928 14:50:46.529093 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 0d77597df00a4e8388a5bc07ac5a3baf (DEFAULT_TABLE table=default.Table_b767d88818724383a745af686bee65e8 [id=bd84e160f2ca465894cbc7a14c08a39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.540803 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet f28a74dc0afe4f20b47139a703550ef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:26 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.566280 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1fb3ee1e2b4ce5951b687393f2483c (DEFAULT_TABLE table=default.Table_5cce8a07a9ba4dfb839e1317e79122f2 [id=d4382650b60f4c1790234fa902dcc106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.566293 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 028100ff68ad408db9266317f590d693 (DEFAULT_TABLE table=default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.590909 8950 master_service.cc:946] ReplaceTablet: received request to replace tablet f81dfe4d10424288b8b450c62d10a92e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:46.592185 9848 raft_consensus.cc:348] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.592518 9848 raft_consensus.cc:374] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.592628 9848 raft_consensus.cc:729] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.592885 9848 consensus_queue.cc:260] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.593458 9848 ts_tablet_manager.cc:1428] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:46.595988 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_3800704533234fe283c61d7769b32809"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.596305 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet e13976317a32495ab377654b738667ca (table default.Table_1e632aeda14542fe8c699a2695560792 [id=9e86de8b573545cf94ae1fb95f2893c2]). Expected version 2 got 0
W20260928 14:50:46.596486 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3800704533234fe283c61d7769b32809 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.596570 9855 tablet_bootstrap.cc:492] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:46.596700 9855 ts_tablet_manager.cc:1397] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.185s user 0.002s sys 0.001s
W20260928 14:50:46.596702 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 66850.7us
I20260928 14:50:46.600695 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_40809d57eacb44dea6a88cd21516512a" } new_table_name: "default.Table_a9d77bb008eb4861aef800cd1ef8e2d6" modify_external_catalogs: true
I20260928 14:50:46.603096 9855 raft_consensus.cc:348] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.603331 9855 raft_consensus.cc:374] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.603400 9855 raft_consensus.cc:729] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.604305 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0b0b0c911845433ab88161b3e5a54baa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.604750 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b0b0c911845433ab88161b3e5a54baa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.603578 9855 consensus_queue.cc:260] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.605329 9855 ts_tablet_manager.cc:1428] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260928 14:50:46.606516 9219 leader_election.cc:341] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: af22f23ff3864620bfefb31b9e899036
I20260928 14:50:46.607924 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1fb3ee1e2b4ce5951b687393f2483c (DEFAULT_TABLE table=default.Table_5cce8a07a9ba4dfb839e1317e79122f2 [id=d4382650b60f4c1790234fa902dcc106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:46.609313 9815 ts_tablet_manager.cc:1918] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.609470 9815 log.cc:1196] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/43c887b7c4e8434a9342d49145fde3ae
I20260928 14:50:46.609589 11458 raft_consensus.cc:482] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.609853 9815 ts_tablet_manager.cc:1939] T 43c887b7c4e8434a9342d49145fde3ae P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.609779 11458 raft_consensus.cc:504] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.610414 11458 leader_election.cc:288] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.610558 9219 leader_election.cc:302] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.611249 9855 tablet_bootstrap.cc:492] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:46.611454 11371 raft_consensus.cc:2726] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:46.612289 9219 leader_election.cc:341] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:46.613600 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1fb3ee1e2b4ce5951b687393f2483c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.566490 11461 tablet.cc:1722] T eae5af64cea44e7f86358edae40caa99 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:46.612643 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d08466aa7d54f12b137986258a6d174" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.618471 9497 leader_election.cc:341] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.604265 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b256211679481eb0e0309c56ff60c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:27 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.618695 9848 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.610785 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d08466aa7d54f12b137986258a6d174" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.619163 9498 leader_election.cc:341] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.619256 9498 leader_election.cc:302] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.620208 9219 leader_election.cc:302] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.620855 11371 raft_consensus.cc:2726] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.621258 9813 ts_tablet_manager.cc:1918] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.621678 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d77597df00a4e8388a5bc07ac5a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.621803 9813 log.cc:1196] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/cbb232c73f014351b796a86180ffb660
I20260928 14:50:46.622159 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1fb3ee1e2b4ce5951b687393f2483c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.622623 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 028100ff68ad408db9266317f590d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:46.613346 9851 tablet_bootstrap.cc:492] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.623229 9851 ts_tablet_manager.cc:1397] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.182s user 0.011s sys 0.019s
I20260928 14:50:46.623875 9851 raft_consensus.cc:348] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.624054 9851 raft_consensus.cc:374] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.624096 9851 raft_consensus.cc:729] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.624270 9851 consensus_queue.cc:260] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.624965 9851 ts_tablet_manager.cc:1428] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:46.625196 9851 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.626394 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_51ff7a6d884645c1974704ec54c878c2" } modify_external_catalogs: true
I20260928 14:50:46.626430 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_06c05f309788430c9a874dbbb85b3ae9" } modify_external_catalogs: true
I20260928 14:50:46.626657 11458 raft_consensus.cc:2726] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.626947 9813 ts_tablet_manager.cc:1939] T cbb232c73f014351b796a86180ffb660 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.629212 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet cbb232c73f014351b796a86180ffb660 (table default.Table_910b553832a74282801d23da9050185b [id=d69dc3d7022a4bebb6bece13d9a746a6]) successfully deleted
I20260928 14:50:46.630388 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 43c887b7c4e8434a9342d49145fde3ae (table default.Table_f437d450119b40f5af9c5e4f167cd36e [id=db8c31df807442d9b6ee3bb32c0c6417]) successfully deleted
W20260928 14:50:46.631248 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 2871c2000c9f41f9ba8145ed0c3ee508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2871c2000c9f41f9ba8145ed0c3ee508 already in progress: creating tablet
I20260928 14:50:46.631440 9815 tablet_replica.cc:330] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.632858 9851 tablet_bootstrap.cc:654] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.632954 9815 raft_consensus.cc:2229] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:46.633374 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 22e642af72ff4f5285f8bc4e6ed36401 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22e642af72ff4f5285f8bc4e6ed36401 already in progress: creating tablet
I20260928 14:50:46.632869 9814 ts_tablet_manager.cc:1918] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.633777 9815 raft_consensus.cc:2258] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.634323 9848 tablet_bootstrap.cc:654] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.634455 9814 log.cc:1196] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/aaacc1f839914859b23ae755042e02d8
W20260928 14:50:46.635375 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 24f53d04326f4e639be23564563034e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24f53d04326f4e639be23564563034e0 already in progress: creating tablet
I20260928 14:50:46.635851 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_278b8100c5df42a6985befad34ddc048" } modify_external_catalogs: true
W20260928 14:50:46.637108 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 4fdc5e3f83924f4cae8d30be9dcce152 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fdc5e3f83924f4cae8d30be9dcce152 already in progress: creating tablet
I20260928 14:50:46.637319 9815 ts_tablet_manager.cc:1905] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.637693 9814 ts_tablet_manager.cc:1939] T aaacc1f839914859b23ae755042e02d8 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:46.638738 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b39c67a1cf4c4a97af85aaf0484835f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39c67a1cf4c4a97af85aaf0484835f8 already in progress: creating tablet
W20260928 14:50:46.640478 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fb2feb8adf57477ab915eea1d980d3e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb2feb8adf57477ab915eea1d980d3e6 already in progress: creating tablet
I20260928 14:50:46.640110 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1135) took 2728 ms. Trace:
W20260928 14:50:46.641899 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet cacb6cd51f3b4f238813e764818767c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cacb6cd51f3b4f238813e764818767c2 already in progress: creating tablet
I20260928 14:50:46.641145 9814 rpcz_store.cc:276] 0928 14:50:43.910877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.911285 (+ 408us) service_pool.cc:227] Handling call
0928 14:50:46.462231 (+2550946us) ts_tablet_manager.cc:1145] Deleting tablet aaacc1f839914859b23ae755042e02d8
0928 14:50:46.472119 (+ 9888us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.527529 (+ 55410us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.632441 (+104912us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.639804 (+ 7363us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550825}
I20260928 14:50:46.642735 9813 tablet_replica.cc:330] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.643146 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet aaacc1f839914859b23ae755042e02d8 (table default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]) successfully deleted
I20260928 14:50:46.643545 9814 tablet_replica.cc:330] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.643625 9813 raft_consensus.cc:2229] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.644415 9814 raft_consensus.cc:2229] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:46.644356 9813 raft_consensus.cc:2258] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.646096 9814 raft_consensus.cc:2258] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.647030 9813 ts_tablet_manager.cc:1905] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.648468 9814 ts_tablet_manager.cc:1905] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.653389 8950 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_ae66aaf2db624c129f3b5cb1709326e1 [id=d656efb4270c4f649d1e21a248de2bbb] alter complete (version 1)
W20260928 14:50:46.662144 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c6f09bae9c9a40c9a94823a92706a65d (table default.Table_7657f85c0978492c808e16385624e658 [id=2063b7d702654b4896dda7dff94920b7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c6f09bae9c9a40c9a94823a92706a65d consensus state has no leader
I20260928 14:50:46.664350 9848 tablet_bootstrap.cc:492] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.664588 9848 ts_tablet_manager.cc:1397] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260928 14:50:46.666049 9848 raft_consensus.cc:348] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.666582 9848 raft_consensus.cc:374] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.666780 9848 raft_consensus.cc:729] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.667173 9848 consensus_queue.cc:260] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.669260 9848 ts_tablet_manager.cc:1428] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 14:50:46.670953 9848 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.671604 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f23435e718764568affacdb5f1a5fa0b" } new_table_name: "default.Table_0a271d1007e54688a974d799c6ca3a63" modify_external_catalogs: true
I20260928 14:50:46.672825 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c9bfad9c3b884d388ca4743438a34c0d" } modify_external_catalogs: true
I20260928 14:50:46.614002 11460 tablet.cc:1722] T eae5af64cea44e7f86358edae40caa99 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:46.682922 9848 tablet_bootstrap.cc:654] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.689641 9813 ts_tablet_manager.cc:1918] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.690110 9813 log.cc:1196] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/f28a74dc0afe4f20b47139a703550ef6
I20260928 14:50:46.691283 9813 ts_tablet_manager.cc:1939] T f28a74dc0afe4f20b47139a703550ef6 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.692062 9814 ts_tablet_manager.cc:1918] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:46.692787 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet f28a74dc0afe4f20b47139a703550ef6 (table default.Table_158e9f6008914923b2f3ad53d5817d59 [id=4137840e815c48aabef6e814491e4dd0]) successfully deleted
I20260928 14:50:46.693048 9814 log.cc:1196] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8a08d91a06ca4effbc8fc4e83d88fe93
I20260928 14:50:46.693586 9813 tablet_replica.cc:330] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.694587 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_06c05f309788430c9a874dbbb85b3ae9" } modify_external_catalogs: true
I20260928 14:50:46.694747 11223 raft_consensus.cc:482] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.694490 9813 raft_consensus.cc:2229] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.694924 11223 raft_consensus.cc:504] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.695088 9814 ts_tablet_manager.cc:1939] T 8a08d91a06ca4effbc8fc4e83d88fe93 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.695508 9813 raft_consensus.cc:2258] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.695827 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_278b8100c5df42a6985befad34ddc048" } modify_external_catalogs: true
I20260928 14:50:46.695853 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b92039b9a484a768efa3714b58248ef" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.695994 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e25b5e7f69e4250a518fe72c07045d9 consensus state has no leader
W20260928 14:50:46.696338 9220 leader_election.cc:341] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.696354 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_44495e0b3b1a458dafb4e564b0b91873" } modify_external_catalogs: true
I20260928 14:50:46.696571 11223 leader_election.cc:288] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.696501 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_44495e0b3b1a458dafb4e564b0b91873" } modify_external_catalogs: true
I20260928 14:50:46.697578 9815 ts_tablet_manager.cc:1918] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.697707 9815 log.cc:1196] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d34a235b38aa4e9ba328a7f542342653
I20260928 14:50:46.697979 9815 ts_tablet_manager.cc:1939] T d34a235b38aa4e9ba328a7f542342653 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.698477 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet d34a235b38aa4e9ba328a7f542342653 (table default.Table_795852c44f3e445fb688726c11fb5c42 [id=e27157f2f6c142498522224ade73f572]) successfully deleted
I20260928 14:50:46.698854 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_51ff7a6d884645c1974704ec54c878c2" } modify_external_catalogs: true
I20260928 14:50:46.702230 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.702931 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 48f1d934435241529be3b4300ef4aa58
W20260928 14:50:46.702967 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4d48886de3194e898da13b5d546ca9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d48886de3194e898da13b5d546ca9d8 already in progress: creating tablet
I20260928 14:50:46.703830 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1d934435241529be3b4300ef4aa58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:46.703907 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e29b60b66bce4f328c10560112c0d28c consensus state has no leader
I20260928 14:50:46.704164 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1d934435241529be3b4300ef4aa58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.704499 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 293ba34b7a6c49e790861431646bb405
I20260928 14:50:46.704677 8951 catalog_manager.cc:5495] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:46.705118 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
I20260928 14:50:46.705005 9813 ts_tablet_manager.cc:1905] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.707274 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f1d934435241529be3b4300ef4aa58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.707641 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 293ba34b7a6c49e790861431646bb405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.708009 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 293ba34b7a6c49e790861431646bb405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.708319 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 293ba34b7a6c49e790861431646bb405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.708752 9815 tablet_replica.cc:330] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.708964 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1137) took 2762 ms. Trace:
I20260928 14:50:46.709975 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet ba43a88f7aa94597ab76a47869e463cd
I20260928 14:50:46.711057 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet ba43a88f7aa94597ab76a47869e463cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.711483 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet ba43a88f7aa94597ab76a47869e463cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.711728 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet ba43a88f7aa94597ab76a47869e463cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.709493 9814 rpcz_store.cc:276] 0928 14:50:43.946525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.946571 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:46.643397 (+2696826us) ts_tablet_manager.cc:1145] Deleting tablet 8a08d91a06ca4effbc8fc4e83d88fe93
0928 14:50:46.643412 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.676193 (+ 32781us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.691771 (+ 15578us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.708941 (+ 17170us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2664115}
I20260928 14:50:46.709167 9815 raft_consensus.cc:2229] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.712263 9815 raft_consensus.cc:2258] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.712648 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8a08d91a06ca4effbc8fc4e83d88fe93 (table default.Table_17150629add64106b091e64cc5d8a03b [id=17805847e4ae4164b7bff5e42ceb782e]) successfully deleted
I20260928 14:50:46.712780 9815 ts_tablet_manager.cc:1905] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.713207 9814 tablet_replica.cc:330] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.713711 9814 raft_consensus.cc:2229] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.714113 9814 raft_consensus.cc:2258] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.714952 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b17faf5198e048b2824aea3308070fa8
I20260928 14:50:46.715588 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c9bfad9c3b884d388ca4743438a34c0d" } modify_external_catalogs: true
I20260928 14:50:46.716029 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet b17faf5198e048b2824aea3308070fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.716298 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet b17faf5198e048b2824aea3308070fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.716516 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:39 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.716326 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet b17faf5198e048b2824aea3308070fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.718076 9848 tablet_bootstrap.cc:492] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.718333 9848 ts_tablet_manager.cc:1397] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.004s
W20260928 14:50:46.718715 9219 consensus_peers.cc:487] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0d94bf844904306b84695e452d62ebd. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.720150 9848 raft_consensus.cc:348] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.720593 9848 raft_consensus.cc:374] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.720764 9848 raft_consensus.cc:729] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:46.720912 9219 leader_election.cc:341] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d27a357d905e463ba9507f74e575acb1
I20260928 14:50:46.721041 9219 leader_election.cc:302] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:46.721204 9219 raft_consensus.cc:2670] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 14:50:46.721222 9848 consensus_queue.cc:260] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.723217 9848 ts_tablet_manager.cc:1428] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 14:50:46.724284 9848 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.726331 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:46.726979 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8a9430a9410f41cc9c3858755a710a99
I20260928 14:50:46.728004 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9430a9410f41cc9c3858755a710a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.728487 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9430a9410f41cc9c3858755a710a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.729043 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9430a9410f41cc9c3858755a710a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.729256 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e3a9f292618469c8d84da18059419b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 64ca2326a46e41cb8a0830bee45ba79e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.729813 9814 ts_tablet_manager.cc:1905] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.733018 9219 leader_election.cc:341] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2b92039b9a484a768efa3714b58248ef
I20260928 14:50:46.734959 9219 leader_election.cc:302] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.738718 9848 tablet_bootstrap.cc:654] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.739002 11223 raft_consensus.cc:2726] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.740723 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ecf600acee5f4ac5abaa25dd47418b19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.741379 9815 ts_tablet_manager.cc:1918] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.741485 9815 log.cc:1196] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/4684ba575d9d45f3bb059a15efdd936d
I20260928 14:50:46.741770 9815 ts_tablet_manager.cc:1939] T 4684ba575d9d45f3bb059a15efdd936d P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:46.741379 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecf600acee5f4ac5abaa25dd47418b19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.742588 9815 tablet_replica.cc:330] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.742694 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 4684ba575d9d45f3bb059a15efdd936d (table default.Table_b80c8683b20345bc9ade4e5fedccadb0 [id=6d30455519bb46d8a147dbd77e2a1537]) successfully deleted
I20260928 14:50:46.742781 9815 raft_consensus.cc:2229] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.742913 9815 raft_consensus.cc:2258] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.743404 9815 ts_tablet_manager.cc:1905] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.745360 11458 raft_consensus.cc:482] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.745476 11458 raft_consensus.cc:504] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.746043 11458 leader_election.cc:288] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.747169 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6fed86d9eda45cab2083fca73825383" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.747371 9220 consensus_peers.cc:487] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c50f7410dd549f399449487556f813d. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.748085 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6fed86d9eda45cab2083fca73825383" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.748629 9497 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:46.749001 9498 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.749097 9498 leader_election.cc:302] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.750025 11458 raft_consensus.cc:2726] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.750944 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e9daf3dcd2ea41469f8e89a3f87ea208" } new_table_name: "default.Table_9567727fc2bc4d1b8fe0359617739ffd" modify_external_catalogs: true
I20260928 14:50:46.751564 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_19e3b64975594b399bb53a0ea6789975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.752089 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19e3b64975594b399bb53a0ea6789975 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.754912 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1e5eb50d61054346a2fc6a9ba4ee3ca6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.754961 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c475aca8beed4eba9f29365eb5fc8b10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.755359 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e5eb50d61054346a2fc6a9ba4ee3ca6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:46.755429 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c475aca8beed4eba9f29365eb5fc8b10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.757383 9813 ts_tablet_manager.cc:1918] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.758337 9813 log.cc:1196] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/24b256211679481eb0e0309c56ff60c6
I20260928 14:50:46.759449 11458 raft_consensus.cc:482] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.759569 11458 raft_consensus.cc:504] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.760105 11458 leader_election.cc:288] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.760924 9813 ts_tablet_manager.cc:1939] T 24b256211679481eb0e0309c56ff60c6 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.761322 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8237f7d97304a98889bde6817358eda" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.761510 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8237f7d97304a98889bde6817358eda" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.761899 9498 leader_election.cc:341] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:46.762032 9497 leader_election.cc:341] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.762108 9497 leader_election.cc:302] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.762555 11458 raft_consensus.cc:2726] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.763612 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 24b256211679481eb0e0309c56ff60c6 (table default.Table_0f58133fc26b412d9986ff78538de0b5 [id=3dd630a811df4a3dae93d0174dae6d5f]) successfully deleted
W20260928 14:50:46.765506 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 48f1d934435241529be3b4300ef4aa58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48f1d934435241529be3b4300ef4aa58 already in progress: creating tablet
W20260928 14:50:46.767168 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 293ba34b7a6c49e790861431646bb405 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ba34b7a6c49e790861431646bb405 already in progress: creating tablet
I20260928 14:50:46.767787 9851 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.767916 9851 ts_tablet_manager.cc:1397] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.143s user 0.012s sys 0.012s
I20260928 14:50:46.768635 9851 raft_consensus.cc:348] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.768833 9851 raft_consensus.cc:374] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.768903 9851 raft_consensus.cc:729] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.769145 9851 consensus_queue.cc:260] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:46.769656 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet ba43a88f7aa94597ab76a47869e463cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba43a88f7aa94597ab76a47869e463cd already in progress: creating tablet
I20260928 14:50:46.769986 9813 tablet_replica.cc:330] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.770354 9813 raft_consensus.cc:2229] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.770939 9814 ts_tablet_manager.cc:1918] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:46.780247 9815 ts_tablet_manager.cc:1918] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.781142 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3499650ce231436095c708ac28e8970d" } new_table_name: "default.Table_be87de61868140509f40026cac7ad8a7" modify_external_catalogs: true
I20260928 14:50:46.781785 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0659f81357de42b29d4b17dd6646da41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.782315 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0659f81357de42b29d4b17dd6646da41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.786546 9855 tablet_bootstrap.cc:654] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.787029 9815 log.cc:1196] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/1eaafbd52e464862ae0f0d44ffae58cf
I20260928 14:50:46.787917 11458 raft_consensus.cc:482] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.774936 11377 raft_consensus.cc:482] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.789182 11377 raft_consensus.cc:504] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.789203 9813 raft_consensus.cc:2258] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.789925 11377 leader_election.cc:288] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.774323 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 66772fac8b3747f0983562195abcc64e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.774833 9851 ts_tablet_manager.cc:1428] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260928 14:50:46.790688 9851 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.791134 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.791533 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bef0b52d178f4baeae621da769f6d518" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:46.791805 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de77b0bec60a4ebbb0a1b6f779eaaf70 consensus state has no leader
I20260928 14:50:46.793198 11223 raft_consensus.cc:482] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.793326 11223 raft_consensus.cc:504] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.793557 9851 tablet_bootstrap.cc:654] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.793916 11223 leader_election.cc:288] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.794637 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d1076de0cb444aebb34e69cd6d644dc5" } new_table_name: "default.Table_0dbd09e0567a4882b75ace0a5fa81d25" modify_external_catalogs: true
I20260928 14:50:46.795948 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6d9a1b754f5e47bba1ed6cb4b33851f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.796406 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d9a1b754f5e47bba1ed6cb4b33851f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.799449 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2df71ab27d7e4f568604ebbeffbff6c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.799969 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2df71ab27d7e4f568604ebbeffbff6c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.801121 11454 raft_consensus.cc:482] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.802075 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9908b80bb25c42bc9a2cf59e024c375d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.803731 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9908b80bb25c42bc9a2cf59e024c375d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.804831 9813 ts_tablet_manager.cc:1905] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.805053 9814 log.cc:1196] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/d27a357d905e463ba9507f74e575acb1
I20260928 14:50:46.805790 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5cb7ed2d61594e3f8f89fad9dc558779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.806028 9814 ts_tablet_manager.cc:1939] T d27a357d905e463ba9507f74e575acb1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:46.806190 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cb7ed2d61594e3f8f89fad9dc558779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:46.807777 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet affea6f5d2df43238f47fd1110b64acc consensus state has no leader
I20260928 14:50:46.807725 9848 tablet_bootstrap.cc:492] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.811873 9848 ts_tablet_manager.cc:1397] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.088s user 0.008s sys 0.003s
I20260928 14:50:46.816077 9848 raft_consensus.cc:348] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.815546 9851 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.816519 11223 raft_consensus.cc:482] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.816648 9851 ts_tablet_manager.cc:1397] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.008s
I20260928 14:50:46.816648 11223 raft_consensus.cc:504] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.817330 11223 leader_election.cc:288] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.817366 9851 raft_consensus.cc:348] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.817571 9851 raft_consensus.cc:374] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.817625 9851 raft_consensus.cc:729] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.817802 9851 consensus_queue.cc:260] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.818408 9851 ts_tablet_manager.cc:1428] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:46.818707 9851 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.820320 9851 tablet_bootstrap.cc:654] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.822676 9848 raft_consensus.cc:374] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.822825 9848 raft_consensus.cc:729] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.823102 9848 consensus_queue.cc:260] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.812557 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1138) took 2858 ms. Trace:
I20260928 14:50:46.823804 9814 rpcz_store.cc:276] 0928 14:50:43.954240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:43.954288 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:46.713127 (+2758839us) ts_tablet_manager.cc:1145] Deleting tablet d27a357d905e463ba9507f74e575acb1
0928 14:50:46.713138 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.749194 (+ 36056us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.770849 (+ 21655us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.812536 (+ 41687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2733738}
I20260928 14:50:46.824033 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:46.824399 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet d27a357d905e463ba9507f74e575acb1 (table default.Table_db313c82c68e436bbccf67e69c6c10cf [id=64aa6ea04e1749faaa914cd83971de41]) successfully deleted
I20260928 14:50:46.824855 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1140) took 2698 ms. Trace:
I20260928 14:50:46.824993 9814 rpcz_store.cc:276] 0928 14:50:44.126246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.126298 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:46.824713 (+2698415us) ts_tablet_manager.cc:1145] Deleting tablet 080159d2e65a4550861f4c63fb22d02e
0928 14:50:46.824724 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.824838 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2698218}
W20260928 14:50:46.825979 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 080159d2e65a4550861f4c63fb22d02e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 080159d2e65a4550861f4c63fb22d02e already in progress: creating tablet
I20260928 14:50:46.798164 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:46.826395 9569 raft_consensus.cc:2454] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:46.827189 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1141) took 2697 ms. Trace:
I20260928 14:50:46.827706 9848 ts_tablet_manager.cc:1428] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260928 14:50:46.829190 8951 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:46.833806 11228 raft_consensus.cc:482] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.835532 11228 raft_consensus.cc:504] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.835790 9848 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.835464 9814 rpcz_store.cc:276] 0928 14:50:44.130228 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.130313 (+ 85us) service_pool.cc:227] Handling call
0928 14:50:46.827083 (+2696770us) ts_tablet_manager.cc:1145] Deleting tablet 287a1ca845fe440da98bf68aafa0e49c
0928 14:50:46.827093 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.827172 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2696594}
I20260928 14:50:46.836117 11228 leader_election.cc:288] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:46.836457 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 287a1ca845fe440da98bf68aafa0e49c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 287a1ca845fe440da98bf68aafa0e49c already in progress: creating tablet
I20260928 14:50:46.836611 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_7684b6725e84453281f0ec575a8b7bca [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 2 got 0
I20260928 14:50:46.838539 9848 tablet_bootstrap.cc:654] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.839383 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1142) took 2708 ms. Trace:
I20260928 14:50:46.839516 9814 rpcz_store.cc:276] 0928 14:50:44.131266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.131311 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:46.836136 (+2704825us) ts_tablet_manager.cc:1145] Deleting tablet 0f81e272545349678c7824ba5520ec8e
0928 14:50:46.839274 (+ 3138us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.839367 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704673}
I20260928 14:50:46.840004 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1143) took 2707 ms. Trace:
W20260928 14:50:46.840070 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
I20260928 14:50:46.840129 9814 rpcz_store.cc:276] 0928 14:50:44.132392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.132434 (+ 42us) service_pool.cc:227] Handling call
0928 14:50:46.839908 (+2707474us) ts_tablet_manager.cc:1145] Deleting tablet 0f81e272545349678c7824ba5520ec8e
0928 14:50:46.839918 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.839991 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707330}
W20260928 14:50:46.840626 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0f81e272545349678c7824ba5520ec8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f81e272545349678c7824ba5520ec8e already in progress: creating tablet
I20260928 14:50:46.841007 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1147) took 2669 ms. Trace:
I20260928 14:50:46.801265 11454 raft_consensus.cc:504] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.843081 11454 leader_election.cc:288] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.844164 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:46.846041 9814 rpcz_store.cc:276] 0928 14:50:44.171484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.171533 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:46.840913 (+2669380us) ts_tablet_manager.cc:1145] Deleting tablet 7341dac419f2443594ea9ef9c65f2daa
0928 14:50:46.840923 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.840992 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2669171}
W20260928 14:50:46.846443 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7341dac419f2443594ea9ef9c65f2daa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7341dac419f2443594ea9ef9c65f2daa already in progress: creating tablet
W20260928 14:50:46.846493 9497 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.846907 8950 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_7684b6725e84453281f0ec575a8b7bca [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 2 got 0
I20260928 14:50:46.788033 11458 raft_consensus.cc:504] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.847445 11458 leader_election.cc:288] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.848281 9814 tablet_replica.cc:330] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.848467 9814 raft_consensus.cc:2229] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.848608 9814 raft_consensus.cc:2258] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.849119 9814 ts_tablet_manager.cc:1905] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.850276 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d72c3c622ca0439686a7f13ab74f3abf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:46.850890 9497 leader_election.cc:341] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.853547 9848 tablet_bootstrap.cc:492] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.853552 9851 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.853667 9851 ts_tablet_manager.cc:1397] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260928 14:50:46.853667 9848 ts_tablet_manager.cc:1397] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260928 14:50:46.854358 9848 raft_consensus.cc:348] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.854358 9851 raft_consensus.cc:348] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.854552 9848 raft_consensus.cc:374] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.854602 9848 raft_consensus.cc:729] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.854687 9851 raft_consensus.cc:374] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.854792 9851 raft_consensus.cc:729] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.854768 9848 consensus_queue.cc:260] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.855057 9851 consensus_queue.cc:260] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.855283 9848 ts_tablet_manager.cc:1428] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.855665 9851 ts_tablet_manager.cc:1428] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.857363 9848 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.857730 9851 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.859650 9851 tablet_bootstrap.cc:654] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.843734 9813 ts_tablet_manager.cc:1918] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.849025 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.860041 9813 log.cc:1196] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/3f17eb03f5ed4cb581c29fc0d8619ff2
W20260928 14:50:46.860323 9498 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.860455 9498 leader_election.cc:302] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.860563 9813 ts_tablet_manager.cc:1939] T 3f17eb03f5ed4cb581c29fc0d8619ff2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.860775 11458 raft_consensus.cc:2726] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.851168 9360 leader_election.cc:302] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:46.849244 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d72c3c622ca0439686a7f13ab74f3abf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.861372 11377 raft_consensus.cc:2726] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.861654 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 3f17eb03f5ed4cb581c29fc0d8619ff2 (table default.Table_5eb84b168008483d9cd4ee38dca692f0 [id=5791a3cbbee640ea977d9b031bcc5bf6]) successfully deleted
W20260928 14:50:46.861858 9498 leader_election.cc:341] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.861964 9498 leader_election.cc:302] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.862257 11458 raft_consensus.cc:2726] T d72c3c622ca0439686a7f13ab74f3abf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:46.863365 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b17faf5198e048b2824aea3308070fa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17faf5198e048b2824aea3308070fa8 already in progress: creating tablet
I20260928 14:50:46.863924 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac853c5b6f4f9cb9de91e6aa448c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:46.864588 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8a9430a9410f41cc9c3858755a710a99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9430a9410f41cc9c3858755a710a99 already in progress: creating tablet
I20260928 14:50:46.868013 9848 tablet_bootstrap.cc:654] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.869289 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fcc42af91c247b1b80059e95e3659cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.869575 9813 tablet_replica.cc:330] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.869799 9813 raft_consensus.cc:2229] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.869983 9813 raft_consensus.cc:2258] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.872203 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.874256 9813 ts_tablet_manager.cc:1905] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.874308 9219 leader_election.cc:302] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:46.875138 11228 raft_consensus.cc:2781] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:46.875221 11228 raft_consensus.cc:482] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:46.875283 11228 raft_consensus.cc:3037] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.876215 9815 ts_tablet_manager.cc:1939] T 1eaafbd52e464862ae0f0d44ffae58cf P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.877080 9815 tablet_replica.cc:330] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.877269 9815 raft_consensus.cc:2229] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.877382 9815 raft_consensus.cc:2258] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.877758 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 1eaafbd52e464862ae0f0d44ffae58cf (table default.Table_b3fa664a13f240a8ab876df02ff31cd3 [id=33d37caf528641b1866b37e9cfc8b723]) successfully deleted
I20260928 14:50:46.877918 11228 raft_consensus.cc:504] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.878496 9814 ts_tablet_manager.cc:1918] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.879379 9815 ts_tablet_manager.cc:1905] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.879977 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b22c3f9578a464a96be0bac6127e56d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.883430 9813 ts_tablet_manager.cc:1918] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:46.878793 9219 consensus_peers.cc:487] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c50f7410dd549f399449487556f813d. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:46.884174 9814 log.cc:1196] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/83705b3cf3e746f4b0aca9c2c8bd2f2f
W20260928 14:50:46.884266 9219 leader_election.cc:341] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 76ad7685ece44665896f687697bddccf
I20260928 14:50:46.884438 9814 ts_tablet_manager.cc:1939] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:46.884491 9219 leader_election.cc:341] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1b22c3f9578a464a96be0bac6127e56d
I20260928 14:50:46.879087 11228 leader_election.cc:288] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:46.884055 9851 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.884836 9851 ts_tablet_manager.cc:1397] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
I20260928 14:50:46.885293 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:46.885455 9569 raft_consensus.cc:3037] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.885452 9851 raft_consensus.cc:348] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.885721 9851 raft_consensus.cc:374] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.885807 9851 raft_consensus.cc:729] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.886014 9851 consensus_queue.cc:260] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.886175 9815 ts_tablet_manager.cc:1918] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.886263 9815 log.cc:1196] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/43f761337edf4a0f9e5dcda0ae28cffd
I20260928 14:50:46.886520 9815 ts_tablet_manager.cc:1939] T 43f761337edf4a0f9e5dcda0ae28cffd P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:46.886591 9851 ts_tablet_manager.cc:1428] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:46.886837 9851 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.887789 9569 raft_consensus.cc:2454] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:46.888461 9851 tablet_bootstrap.cc:654] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.893061 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1152) took 2651 ms. Trace:
I20260928 14:50:46.893144 9814 rpcz_store.cc:276] 0928 14:50:44.241780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.241843 (+ 63us) service_pool.cc:227] Handling call
0928 14:50:46.848238 (+2606395us) ts_tablet_manager.cc:1145] Deleting tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f
0928 14:50:46.848250 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.865606 (+ 17356us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.878391 (+ 12785us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.893042 (+ 14651us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2606185}
W20260928 14:50:46.893335 9220 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.893469 9814 tablet_replica.cc:330] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:46.893626 9220 leader_election.cc:341] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.893725 9220 leader_election.cc:302] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.890443 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ad7685ece44665896f687697bddccf" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:46.892617 11377 raft_consensus.cc:482] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.893990 11377 raft_consensus.cc:504] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.894318 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
I20260928 14:50:46.894557 11377 leader_election.cc:288] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:46.892882 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:46.893767 9813 log.cc:1196] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/1e3a9f292618469c8d84da18059419b0
I20260928 14:50:46.894977 9813 ts_tablet_manager.cc:1939] T 1e3a9f292618469c8d84da18059419b0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.895334 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 43f761337edf4a0f9e5dcda0ae28cffd (table default.Table_59caae98d16342cc8ea4b5b3e2f8fb76 [id=233b20f184344782ac0a084128931942]) successfully deleted
I20260928 14:50:46.895438 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 1e3a9f292618469c8d84da18059419b0 (table default.Table_c4b70ee941964fe2b328f7eaae2cebc1 [id=1a11d90df9164fd9a0860eb32d906d15]) successfully deleted
I20260928 14:50:46.895684 9813 tablet_replica.cc:330] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:46.895754 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.895887 9813 raft_consensus.cc:2229] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.896004 9813 raft_consensus.cc:2258] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.896060 11371 raft_consensus.cc:2726] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:46.896346 9360 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: e5ac853c5b6f4f9cb9de91e6aa448c75
W20260928 14:50:46.896798 9360 leader_election.cc:341] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e5ac853c5b6f4f9cb9de91e6aa448c75
I20260928 14:50:46.896859 9813 ts_tablet_manager.cc:1905] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.896903 9360 leader_election.cc:302] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
W20260928 14:50:46.897042 9360 raft_consensus.cc:2670] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 14:50:46.897047 9220 leader_election.cc:341] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.897135 9220 leader_election.cc:302] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:46.897132 9219 leader_election.cc:302] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:46.897593 11228 raft_consensus.cc:2726] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:46.897737 11228 raft_consensus.cc:2781] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:46.897820 11228 raft_consensus.cc:686] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:46.897994 11228 consensus_queue.cc:237] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.898149 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8a8e9d4c48a54a77bbb629d2a35e4931" } new_table_name: "default.Table_42cb31693363474d9d47d8229abd6c4b" modify_external_catalogs: true
W20260928 14:50:46.899392 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 6a6a176464e84c94bb5cc4ba6016df12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6a176464e84c94bb5cc4ba6016df12 already in progress: creating tablet
W20260928 14:50:46.902429 9220 leader_election.cc:341] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:46.903559 9815 tablet_replica.cc:330] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:46.903739 9815 raft_consensus.cc:2229] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.903880 9815 raft_consensus.cc:2258] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.904328 9815 ts_tablet_manager.cc:1905] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.908375 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fd673ea8aa19429c98194c13ed814ae8" } modify_external_catalogs: true
I20260928 14:50:46.908430 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f8c9069e1e21484586c327e9d56a966a" } modify_external_catalogs: true
I20260928 14:50:46.908532 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_fd673ea8aa19429c98194c13ed814ae8" } modify_external_catalogs: true
I20260928 14:50:46.908596 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f8c9069e1e21484586c327e9d56a966a" } modify_external_catalogs: true
I20260928 14:50:46.909741 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c045d82b1980402990bbb2d9b475ce5f" } new_table_name: "default.Table_f547625ebb034a01af4f4396984ea904" modify_external_catalogs: true
I20260928 14:50:46.893649 9814 raft_consensus.cc:2229] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:46.910355 9814 raft_consensus.cc:2258] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.910372 9813 ts_tablet_manager.cc:1918] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.910463 9813 log.cc:1196] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/e5ac853c5b6f4f9cb9de91e6aa448c75
I20260928 14:50:46.910950 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_5d170acaccec431ea5615b6d6a5b1dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.911278 9814 ts_tablet_manager.cc:1905] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:46.911479 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d170acaccec431ea5615b6d6a5b1dc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.912403 9813 ts_tablet_manager.cc:1939] T e5ac853c5b6f4f9cb9de91e6aa448c75 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:46.912516 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ec53a95de3d2420e8fb0c19d712a61aa" } modify_external_catalogs: true
I20260928 14:50:46.912644 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ec53a95de3d2420e8fb0c19d712a61aa" } modify_external_catalogs: true
I20260928 14:50:46.913403 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet e5ac853c5b6f4f9cb9de91e6aa448c75 (table default.Table_eb915b10e70840468170d6c85ffae469 [id=09111653e7f6471e8db5eff01775240b]) successfully deleted
I20260928 14:50:46.917044 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84f0368ec01a49b3a10843d57546a5fe" } modify_external_catalogs: true
I20260928 14:50:46.917203 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84f0368ec01a49b3a10843d57546a5fe" } modify_external_catalogs: true
I20260928 14:50:46.920397 8948 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet e99d3794c6374984b15a0400d599f6fb
W20260928 14:50:46.920709 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ae8348f77764a5e8787a33f657ca80d consensus state has no leader
W20260928 14:50:46.908607 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a0117aff69403e816ff37592db935f consensus state has no leader
I20260928 14:50:46.926373 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b6fed86d9eda45cab2083fca73825383
I20260928 14:50:46.927121 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet b6fed86d9eda45cab2083fca73825383 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.927631 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet b6fed86d9eda45cab2083fca73825383 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:46.927682 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b6fed86d9eda45cab2083fca73825383 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6fed86d9eda45cab2083fca73825383 already in progress: creating tablet
I20260928 14:50:46.928521 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet b6fed86d9eda45cab2083fca73825383 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.928851 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_63d0876c753e4babab324808f06e208f" } modify_external_catalogs: true
I20260928 14:50:46.928994 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_63d0876c753e4babab324808f06e208f" } modify_external_catalogs: true
I20260928 14:50:46.933084 8949 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 89431a1fcc8144c3b58e30d1d5fa9635
I20260928 14:50:46.934974 9851 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.935312 9851 ts_tablet_manager.cc:1397] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.049s user 0.015s sys 0.013s
I20260928 14:50:46.935801 9848 tablet_bootstrap.cc:492] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:46.936012 9848 ts_tablet_manager.cc:1397] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.002s
I20260928 14:50:46.936075 9851 raft_consensus.cc:348] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.936302 9851 raft_consensus.cc:374] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.936405 9851 raft_consensus.cc:729] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.936645 9851 consensus_queue.cc:260] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.937227 9851 ts_tablet_manager.cc:1428] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:46.937295 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet be0ef95fd8b54b2ab140a77a74c75c5c
I20260928 14:50:46.938211 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.938462 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.938635 9851 tablet_bootstrap.cc:492] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:46.939122 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet be0ef95fd8b54b2ab140a77a74c75c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be0ef95fd8b54b2ab140a77a74c75c5c already in progress: creating tablet
I20260928 14:50:46.939612 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet be0ef95fd8b54b2ab140a77a74c75c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.940285 9851 tablet_bootstrap.cc:654] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.942947 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet fb7f3aeffb2a4a9683b728e17aa28d9d
I20260928 14:50:46.943461 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:46.944429 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:46.945278 11460 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260928 14:50:46.945478 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet fb7f3aeffb2a4a9683b728e17aa28d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7f3aeffb2a4a9683b728e17aa28d9d already in progress: creating tablet
I20260928 14:50:46.945902 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7f3aeffb2a4a9683b728e17aa28d9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:46.946945 11456 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 14:50:46.951596 9851 tablet_bootstrap.cc:492] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:46.951715 9422 raft_consensus.cc:3037] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:46.951774 9851 ts_tablet_manager.cc:1397] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260928 14:50:46.952579 9851 raft_consensus.cc:348] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.952838 9851 raft_consensus.cc:374] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.952934 9851 raft_consensus.cc:729] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.953225 9851 consensus_queue.cc:260] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.953863 9851 ts_tablet_manager.cc:1428] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:46.954190 9851 tablet_bootstrap.cc:492] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:46.961076 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c7e20b9cfeb940d89fd784f8f893b26a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.961232 8955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_9567727fc2bc4d1b8fe0359617739ffd [id=38a18331beae4386a199edd7e5491230] alter complete (version 4)
W20260928 14:50:46.961623 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7e20b9cfeb940d89fd784f8f893b26a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.964469 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b0615b2e32d0400ea74a88f979b33a0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:46.940279 9848 raft_consensus.cc:348] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:46.964871 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0615b2e32d0400ea74a88f979b33a0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.965449 9848 raft_consensus.cc:374] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:46.966127 9848 raft_consensus.cc:729] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:46.964382 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ae33cb6de9e7435eb8bf7f71d4fd502a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.968870 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae33cb6de9e7435eb8bf7f71d4fd502a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.968621 9848 consensus_queue.cc:260] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.974102 9848 ts_tablet_manager.cc:1428] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.038s user 0.001s sys 0.002s
I20260928 14:50:46.975167 9848 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:46.979862 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_353dfdf4c71244adbe9a2d5216999d10" } new_table_name: "default.Table_1fb16696d49647c6a28a765c25c34010" modify_external_catalogs: true
I20260928 14:50:46.980507 9851 tablet_bootstrap.cc:654] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.982993 11223 raft_consensus.cc:482] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:46.985062 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70952c6421154da6837d089b6443695f consensus state has no leader
I20260928 14:50:46.986070 9814 ts_tablet_manager.cc:1918] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:46.986239 9814 log.cc:1196] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/ba0d51f1c2664e0b8c6acb7847eff7cc
I20260928 14:50:46.986624 9814 ts_tablet_manager.cc:1939] T ba0d51f1c2664e0b8c6acb7847eff7cc P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:46.986941 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1153) took 2744 ms. Trace:
I20260928 14:50:46.987066 9814 rpcz_store.cc:276] 0928 14:50:44.242384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.242434 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:46.893432 (+2650998us) ts_tablet_manager.cc:1145] Deleting tablet ba0d51f1c2664e0b8c6acb7847eff7cc
0928 14:50:46.893442 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.948330 (+ 54888us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.985981 (+ 37651us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.986926 (+ 945us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2650824}
I20260928 14:50:46.987581 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet ba0d51f1c2664e0b8c6acb7847eff7cc (table default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]) successfully deleted
I20260928 14:50:46.987926 9814 tablet_replica.cc:330] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:46.987891 9848 tablet_bootstrap.cc:654] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:46.988132 9814 raft_consensus.cc:2229] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:46.988333 9814 raft_consensus.cc:2258] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:46.988834 9814 ts_tablet_manager.cc:1905] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:46.989507 8955 master_service.cc:946] ReplaceTablet: received request to replace tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:46.995464 9814 ts_tablet_manager.cc:1918] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:46.995867 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_418b08bd5d904c26a7bcaab5e001e951"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:46.996388 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_418b08bd5d904c26a7bcaab5e001e951 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:46.997822 11458 raft_consensus.cc:482] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:46.997952 11458 raft_consensus.cc:504] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:46.998512 11458 leader_election.cc:288] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:46.999147 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd00b9377b245a29d2a6735248112bc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:46.999760 9498 leader_election.cc:341] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.001040 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9e9af23f6e3c4796b91d32916ea5ea6c" } new_table_name: "default.Table_6259ead6675a4e1c9f26b7e7626d863f" modify_external_catalogs: true
W20260928 14:50:47.007104 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cd69130e0d34defbdce5edc925f7277 consensus state has no leader
I20260928 14:50:47.009469 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_017b6b7a57314fbf9d1cf208963e0f12" } new_table_name: "default.Table_7916bc36965447d084793a43b16c2707" modify_external_catalogs: true
I20260928 14:50:47.009415 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a239d341814249fbb930541b906daa2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.010113 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a239d341814249fbb930541b906daa2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.012027 11411 tablet.cc:1722] T b61fa4c4cff54e55b6e640d1b6376236 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260928 14:50:47.014231 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72099e766c574246b38acb34ee369d2e consensus state has no leader
I20260928 14:50:47.015820 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b420ef1d93fa4866b52a1349c88b5880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.016278 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b420ef1d93fa4866b52a1349c88b5880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.019188 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_656ab0d209744b68a38ca823493c2777"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.019739 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_656ab0d209744b68a38ca823493c2777 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.021296 11458 raft_consensus.cc:482] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.021432 11458 raft_consensus.cc:504] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.022315 9848 tablet_bootstrap.cc:492] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.022428 11458 leader_election.cc:288] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.022451 9848 ts_tablet_manager.cc:1397] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.002s
I20260928 14:50:47.023034 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66096599d4c5458db2af10eb9bac947b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.023346 9848 raft_consensus.cc:348] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.023566 9848 raft_consensus.cc:374] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.023617 9848 raft_consensus.cc:729] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:47.023785 9498 leader_election.cc:341] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.023926 9848 consensus_queue.cc:260] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.025116 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dc898131e89843239e49e12bc33e2f16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.025727 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc898131e89843239e49e12bc33e2f16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.027954 9848 ts_tablet_manager.cc:1428] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:47.028277 9848 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.034874 9815 ts_tablet_manager.cc:1918] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.035013 9815 log.cc:1196] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/69239e1cc64f40e59f14c3716437de54
I20260928 14:50:47.035336 9815 ts_tablet_manager.cc:1939] T 69239e1cc64f40e59f14c3716437de54 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.035532 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9cffef22d0c94e28aac3909d4c77759a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.036334 9815 tablet_replica.cc:330] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.036536 9815 raft_consensus.cc:2229] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.036690 9815 raft_consensus.cc:2258] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.037175 9815 ts_tablet_manager.cc:1905] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:47.038328 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cffef22d0c94e28aac3909d4c77759a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.036264 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 69239e1cc64f40e59f14c3716437de54 (table default.Table_aa976d19165445859cf0a1d3b9c21d13 [id=cb81b545941c499795b85f3eabbd8dff]) successfully deleted
I20260928 14:50:47.042003 9848 tablet_bootstrap.cc:654] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.045964 9855 tablet_bootstrap.cc:492] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.046172 9855 ts_tablet_manager.cc:1397] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.435s user 0.009s sys 0.010s
I20260928 14:50:47.046962 9855 raft_consensus.cc:348] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.047235 9855 raft_consensus.cc:374] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.047359 9855 raft_consensus.cc:729] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.047684 9855 consensus_queue.cc:260] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.053929 9848 tablet_bootstrap.cc:492] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.054131 9848 ts_tablet_manager.cc:1397] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.002s
I20260928 14:50:47.054939 9848 raft_consensus.cc:348] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.055244 9848 raft_consensus.cc:374] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.055349 9848 raft_consensus.cc:729] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.055656 9848 consensus_queue.cc:260] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.056419 9848 ts_tablet_manager.cc:1428] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:47.056767 9848 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.057657 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 504c0f61d8844bd18062a3b40cd6f8ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.057698 11458 raft_consensus.cc:482] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.057844 11458 raft_consensus.cc:504] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:46.999092 9285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd00b9377b245a29d2a6735248112bc" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.011137 11223 raft_consensus.cc:504] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.023975 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66096599d4c5458db2af10eb9bac947b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.058382 9814 log.cc:1196] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/edf76b53ded84392a39c73d7e653615d
I20260928 14:50:47.058419 11458 leader_election.cc:288] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.058593 11223 leader_election.cc:288] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.058704 9814 ts_tablet_manager.cc:1939] T edf76b53ded84392a39c73d7e653615d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.059007 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1169) took 2580 ms. Trace:
I20260928 14:50:47.059098 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9eadbe04d484ebfa57cd9d5f9e1cd5b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.059082 9814 rpcz_store.cc:276] 0928 14:50:44.478135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.478184 (+ 49us) service_pool.cc:227] Handling call
0928 14:50:46.987883 (+2509699us) ts_tablet_manager.cc:1145] Deleting tablet edf76b53ded84392a39c73d7e653615d
0928 14:50:46.987896 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:46.992851 (+ 4955us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:46.995392 (+ 2541us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.058991 (+ 63599us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17920,"tablet-delete.queue_time_us":2509543}
I20260928 14:50:47.059378 9814 tablet_replica.cc:330] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.059543 9814 raft_consensus.cc:2229] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:47.059578 9497 leader_election.cc:341] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.059695 9814 raft_consensus.cc:2258] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.059744 9497 leader_election.cc:302] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:47.060115 9497 leader_election.cc:341] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.060194 9848 tablet_bootstrap.cc:654] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.060348 9497 leader_election.cc:302] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.060925 11454 raft_consensus.cc:2726] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.061180 11454 raft_consensus.cc:2726] T 66096599d4c5458db2af10eb9bac947b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:47.061733 9498 leader_election.cc:341] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.061900 9814 ts_tablet_manager.cc:1905] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.062918 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet edf76b53ded84392a39c73d7e653615d (table default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]) successfully deleted
W20260928 14:50:47.063213 9219 leader_election.cc:341] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: f39c1da071164342aea8eab263d4eebb
I20260928 14:50:47.063272 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9eadbe04d484ebfa57cd9d5f9e1cd5b" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:47.063787 9497 leader_election.cc:341] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.063887 9497 leader_election.cc:302] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.064180 11458 raft_consensus.cc:2726] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.064337 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f39c1da071164342aea8eab263d4eebb" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.065073 9220 leader_election.cc:341] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.065191 9220 leader_election.cc:302] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.065589 11223 raft_consensus.cc:2726] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.071693 11469 raft_consensus.cc:482] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.071822 11469 raft_consensus.cc:504] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.072429 11469 leader_election.cc:288] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:47.073554 9360 leader_election.cc:341] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: bc47ae6fbfca4fc0b0b053d0134a49d0
W20260928 14:50:47.074129 9360 leader_election.cc:341] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:47.074229 9360 leader_election.cc:302] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.074656 11469 raft_consensus.cc:2726] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.075377 9814 ts_tablet_manager.cc:1918] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.078094 11469 raft_consensus.cc:482] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.078217 11469 raft_consensus.cc:504] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.078725 11469 leader_election.cc:288] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
W20260928 14:50:47.079782 9360 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 2df12117111548beb5d570436e2d6de2
W20260928 14:50:47.080335 9360 leader_election.cc:341] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2df12117111548beb5d570436e2d6de2
I20260928 14:50:47.080449 9360 leader_election.cc:302] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.080789 11469 raft_consensus.cc:2726] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.083025 9814 log.cc:1196] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/42b9f78ecb674ae691d407615680ca56
I20260928 14:50:47.083496 9814 ts_tablet_manager.cc:1939] T 42b9f78ecb674ae691d407615680ca56 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.084542 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1170) took 2605 ms. Trace:
I20260928 14:50:47.085434 9848 tablet_bootstrap.cc:492] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.085464 9814 rpcz_store.cc:276] 0928 14:50:44.478678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.478766 (+ 88us) service_pool.cc:227] Handling call
0928 14:50:47.059335 (+2580569us) ts_tablet_manager.cc:1145] Deleting tablet 42b9f78ecb674ae691d407615680ca56
0928 14:50:47.059346 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.067509 (+ 8163us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.075301 (+ 7792us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.084524 (+ 9223us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2580341}
I20260928 14:50:47.085785 9848 ts_tablet_manager.cc:1397] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.008s
I20260928 14:50:47.086257 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 42b9f78ecb674ae691d407615680ca56 (table default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]) successfully deleted
I20260928 14:50:47.086844 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1151) took 2845 ms. Trace:
I20260928 14:50:47.087257 9814 rpcz_store.cc:276] 0928 14:50:44.241473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.519973 (+278500us) service_pool.cc:227] Handling call
0928 14:50:47.086754 (+2566781us) ts_tablet_manager.cc:1145] Deleting tablet ba0d51f1c2664e0b8c6acb7847eff7cc
0928 14:50:47.086765 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.086827 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2566590}
I20260928 14:50:47.088347 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1172) took 2517 ms. Trace:
I20260928 14:50:47.088053 9848 raft_consensus.cc:348] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.088562 9848 raft_consensus.cc:374] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.088685 9814 rpcz_store.cc:276] 0928 14:50:44.571202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.595879 (+ 24677us) service_pool.cc:227] Handling call
0928 14:50:47.088242 (+2492363us) ts_tablet_manager.cc:1145] Deleting tablet 1f42b0c58c5745b088e519844f09e67b
0928 14:50:47.088252 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.088331 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2492146}
I20260928 14:50:47.088722 9848 raft_consensus.cc:729] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:47.089283 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1f42b0c58c5745b088e519844f09e67b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f42b0c58c5745b088e519844f09e67b already in progress: creating tablet
I20260928 14:50:47.089697 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1173) took 2487 ms. Trace:
I20260928 14:50:47.089375 9848 consensus_queue.cc:260] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.090112 9851 tablet_bootstrap.cc:492] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.090241 9851 ts_tablet_manager.cc:1397] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.136s user 0.012s sys 0.024s
I20260928 14:50:47.090082 9814 rpcz_store.cc:276] 0928 14:50:44.601946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.602024 (+ 78us) service_pool.cc:227] Handling call
0928 14:50:47.089593 (+2487569us) ts_tablet_manager.cc:1145] Deleting tablet d9655e6b8d164d7e8d7143b629b945a7
0928 14:50:47.089600 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.089681 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2487116}
W20260928 14:50:47.090611 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d9655e6b8d164d7e8d7143b629b945a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9655e6b8d164d7e8d7143b629b945a7 already in progress: creating tablet
I20260928 14:50:47.090749 9848 ts_tablet_manager.cc:1428] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260928 14:50:47.090922 9814 tablet_replica.cc:330] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.091092 9814 raft_consensus.cc:2229] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.091005 9851 raft_consensus.cc:348] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.091190 9851 raft_consensus.cc:374] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.091217 9814 raft_consensus.cc:2258] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.091248 9851 raft_consensus.cc:729] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.091136 9848 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.091447 9851 consensus_queue.cc:260] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.091665 9814 ts_tablet_manager.cc:1905] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.091909 9851 ts_tablet_manager.cc:1428] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.092455 9851 tablet_bootstrap.cc:492] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.093784 9851 tablet_bootstrap.cc:654] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.096832 9848 tablet_bootstrap.cc:654] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.101740 9848 tablet_bootstrap.cc:492] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.102017 11456 tablet.cc:1722] T ddb704c5128a4880ae1b89b4d4d1fcfd P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:47.104773 9855 ts_tablet_manager.cc:1428] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.058s user 0.001s sys 0.001s
I20260928 14:50:47.108747 9814 ts_tablet_manager.cc:1918] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.108841 9814 log.cc:1196] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/622a7af04be44ddebc1af16fcc6325ae
I20260928 14:50:47.109073 9814 ts_tablet_manager.cc:1939] T 622a7af04be44ddebc1af16fcc6325ae P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.109755 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1181) took 2414 ms. Trace:
I20260928 14:50:47.109834 9814 rpcz_store.cc:276] 0928 14:50:44.694960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.696828 (+ 1868us) service_pool.cc:227] Handling call
0928 14:50:47.090884 (+2394056us) ts_tablet_manager.cc:1145] Deleting tablet 622a7af04be44ddebc1af16fcc6325ae
0928 14:50:47.090894 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.094406 (+ 3512us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.108668 (+ 14262us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.109737 (+ 1069us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2337244}
I20260928 14:50:47.110093 9814 tablet_replica.cc:330] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.111409 8955 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet ddb704c5128a4880ae1b89b4d4d1fcfd (table default.Table_7684b6725e84453281f0ec575a8b7bca [id=94283cea61764b3aa25cbf7ec5c3e35a]). Expected version 2 got 0
I20260928 14:50:47.111766 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 622a7af04be44ddebc1af16fcc6325ae (table default.Table_28471d752bd8446eb00cba5559e560f2 [id=f5ad8b4a8b20466ebd2410f788f02694]) successfully deleted
I20260928 14:50:47.112159 9814 raft_consensus.cc:2229] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.112351 9814 raft_consensus.cc:2258] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.112704 9855 tablet_bootstrap.cc:492] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.112922 9814 ts_tablet_manager.cc:1905] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.116806 9855 tablet_bootstrap.cc:654] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.118356 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df12117111548beb5d570436e2d6de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.118965 9813 tablet_replica.cc:330] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.119160 9813 raft_consensus.cc:2229] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.119297 9813 raft_consensus.cc:2258] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.120086 9813 ts_tablet_manager.cc:1905] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.120349 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet ba0d51f1c2664e0b8c6acb7847eff7cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.120962 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ae6fbfca4fc0b0b053d0134a49d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.121589 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet d96492abf8cf459a992dd1d7b0226b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.124410 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a0f0a244b6ba408d913cec35fdead9db" } new_table_name: "default.Table_d14014ff4a6c4eadaf258a45e65b09b2" modify_external_catalogs: true
I20260928 14:50:47.125174 9851 tablet_bootstrap.cc:492] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.125293 9851 ts_tablet_manager.cc:1397] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20260928 14:50:47.125679 9848 ts_tablet_manager.cc:1397] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260928 14:50:47.126396 9848 raft_consensus.cc:348] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.127398 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_35bed516887d44ccb8b35dae4b50f062" } new_table_name: "default.Table_b7be75ca96434082812ba760c0927f0c" modify_external_catalogs: true
I20260928 14:50:47.127835 9813 ts_tablet_manager.cc:1918] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.127969 9813 log.cc:1196] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2df12117111548beb5d570436e2d6de2
I20260928 14:50:47.128547 9813 ts_tablet_manager.cc:1939] T 2df12117111548beb5d570436e2d6de2 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.124424 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4efa6fc9e7894476b38331ffd75744e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.129016 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4efa6fc9e7894476b38331ffd75744e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.129209 9813 tablet_replica.cc:330] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.129498 9813 raft_consensus.cc:2229] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.129791 9813 raft_consensus.cc:2258] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.130096 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_072f1034d9cd45109148c223b46617a5" } modify_external_catalogs: true
I20260928 14:50:47.130247 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_072f1034d9cd45109148c223b46617a5" } modify_external_catalogs: true
I20260928 14:50:47.131117 9813 ts_tablet_manager.cc:1905] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.134156 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2df12117111548beb5d570436e2d6de2 (table default.Table_19caea08036943b0b17c5e53d8c486b3 [id=b5e9a91ec4124a81a3410ab71fb084bb]) successfully deleted
I20260928 14:50:47.134349 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84c246878fa24a1ca4ac14c7ca79efea" } modify_external_catalogs: true
I20260928 14:50:47.134505 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_84c246878fa24a1ca4ac14c7ca79efea" } modify_external_catalogs: true
W20260928 14:50:47.136053 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8f6de1135234f58aa2e534efead2880 consensus state has no leader
I20260928 14:50:47.133847 9848 raft_consensus.cc:374] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.136675 9848 raft_consensus.cc:729] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.138177 9851 raft_consensus.cc:348] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.138381 9851 raft_consensus.cc:374] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.138726 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92faa3134f2b4070889eed0ea66a492c" } modify_external_catalogs: true
I20260928 14:50:47.138885 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92faa3134f2b4070889eed0ea66a492c" } modify_external_catalogs: true
W20260928 14:50:47.140921 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bda4f5da7a6b4a4e867d4e260a274d2a consensus state has no leader
I20260928 14:50:47.136866 9848 consensus_queue.cc:260] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.143551 9848 ts_tablet_manager.cc:1428] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260928 14:50:47.138440 9851 raft_consensus.cc:729] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:47.142495 9220 consensus_peers.cc:487] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:47.144573 9848 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.145148 9424 raft_consensus.cc:3037] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.145108 9851 consensus_queue.cc:260] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.146378 9851 ts_tablet_manager.cc:1428] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260928 14:50:47.146664 9851 tablet_bootstrap.cc:492] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.147629 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b8211c873b2414c94798169f73502c2) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.147921 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7eb610e21f4c41a2becd456b5bbe9946" } modify_external_catalogs: true
I20260928 14:50:47.148070 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7eb610e21f4c41a2becd456b5bbe9946" } modify_external_catalogs: true
I20260928 14:50:47.148267 9851 tablet_bootstrap.cc:654] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.148738 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_20eb3a4cb9204173930667e149a18ecb" } modify_external_catalogs: true
I20260928 14:50:47.148890 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_20eb3a4cb9204173930667e149a18ecb" } modify_external_catalogs: true
I20260928 14:50:47.160403 9814 ts_tablet_manager.cc:1918] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.160563 9814 log.cc:1196] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7376f56883dc4032b120cc4494fa8936
I20260928 14:50:47.160887 9814 ts_tablet_manager.cc:1939] T 7376f56883dc4032b120cc4494fa8936 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.160934 9855 tablet_bootstrap.cc:492] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.161052 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:47.161113 9855 ts_tablet_manager.cc:1397] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.002s
I20260928 14:50:47.161604 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1182) took 2466 ms. Trace:
I20260928 14:50:47.161759 9814 rpcz_store.cc:276] 0928 14:50:44.695049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.696958 (+ 1909us) service_pool.cc:227] Handling call
0928 14:50:47.110057 (+2413099us) ts_tablet_manager.cc:1145] Deleting tablet 7376f56883dc4032b120cc4494fa8936
0928 14:50:47.110067 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.155672 (+ 45605us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.160307 (+ 4635us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.161587 (+ 1280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2356357}
I20260928 14:50:47.162272 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1183) took 2467 ms. Trace:
I20260928 14:50:47.162292 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7376f56883dc4032b120cc4494fa8936 (table default.Table_d14014ff4a6c4eadaf258a45e65b09b2 [id=fee7478c31d54663aa41d4e1ce00a6ed]) successfully deleted
I20260928 14:50:47.162406 9814 rpcz_store.cc:276] 0928 14:50:44.695185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.697054 (+ 1869us) service_pool.cc:227] Handling call
0928 14:50:47.162161 (+2465107us) ts_tablet_manager.cc:1145] Deleting tablet 6ade6066d90547b6bb9be50799bf8d5f
0928 14:50:47.162173 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.162258 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408411}
I20260928 14:50:47.162808 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1189) took 2353 ms. Trace:
W20260928 14:50:47.162902 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6ade6066d90547b6bb9be50799bf8d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ade6066d90547b6bb9be50799bf8d5f already in progress: creating tablet
I20260928 14:50:47.162932 9814 rpcz_store.cc:276] 0928 14:50:44.809290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.809331 (+ 41us) service_pool.cc:227] Handling call
0928 14:50:47.162710 (+2353379us) ts_tablet_manager.cc:1145] Deleting tablet 0728defd0fb44c37bb8aa1e18825f3f4
0928 14:50:47.162720 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.162793 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2353210}
I20260928 14:50:47.163221 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1201) took 2313 ms. Trace:
W20260928 14:50:47.163316 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0728defd0fb44c37bb8aa1e18825f3f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0728defd0fb44c37bb8aa1e18825f3f4 already in progress: creating tablet
I20260928 14:50:47.163319 9814 rpcz_store.cc:276] 0928 14:50:44.849589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.849634 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:47.163130 (+2313496us) ts_tablet_manager.cc:1145] Deleting tablet 05342bec2afe44d3a6e21e19a16091a4
0928 14:50:47.163139 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.163207 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2313343}
I20260928 14:50:47.163627 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1202) took 2312 ms. Trace:
W20260928 14:50:47.163723 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 05342bec2afe44d3a6e21e19a16091a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05342bec2afe44d3a6e21e19a16091a4 already in progress: creating tablet
I20260928 14:50:47.163763 9814 rpcz_store.cc:276] 0928 14:50:44.850770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.850812 (+ 42us) service_pool.cc:227] Handling call
0928 14:50:47.163530 (+2312718us) ts_tablet_manager.cc:1145] Deleting tablet b339b4e3cfbd40c1a35a4c6083926869
0928 14:50:47.163539 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.163615 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2312573}
W20260928 14:50:47.164160 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b339b4e3cfbd40c1a35a4c6083926869 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b339b4e3cfbd40c1a35a4c6083926869 already in progress: creating tablet
I20260928 14:50:47.164459 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1204) took 2210 ms. Trace:
I20260928 14:50:47.164561 9814 rpcz_store.cc:276] 0928 14:50:44.953844 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.953908 (+ 64us) service_pool.cc:227] Handling call
0928 14:50:47.164372 (+2210464us) ts_tablet_manager.cc:1145] Deleting tablet 2014e5f360ee46b895ae0b0c621a6f8e
0928 14:50:47.164381 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.164445 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210143}
W20260928 14:50:47.164949 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2014e5f360ee46b895ae0b0c621a6f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2014e5f360ee46b895ae0b0c621a6f8e already in progress: creating tablet
I20260928 14:50:47.165215 9814 tablet_replica.cc:330] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.165419 9814 raft_consensus.cc:2229] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.165591 9814 raft_consensus.cc:2258] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.166087 9814 ts_tablet_manager.cc:1905] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.166107 9815 ts_tablet_manager.cc:1918] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.166350 9815 log.cc:1196] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/6ade6066d90547b6bb9be50799bf8d5f
I20260928 14:50:47.166811 9815 ts_tablet_manager.cc:1939] T 6ade6066d90547b6bb9be50799bf8d5f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.168490 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6c8e66901e6e453085b42e3a7274bbdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.169059 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c8e66901e6e453085b42e3a7274bbdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.171665 11458 raft_consensus.cc:482] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.171813 11458 raft_consensus.cc:504] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.172390 11458 leader_election.cc:288] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.172887 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:47.173408 9497 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.174008 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.174526 9498 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.174659 11228 consensus_queue.cc:1035] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:47.174721 9498 leader_election.cc:302] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.175208 11458 raft_consensus.cc:2726] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.175591 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f0adc71d3809448c921b182cbe7be0a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.176090 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0adc71d3809448c921b182cbe7be0a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.186400 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_d315c68077734c4cb748f734ece08e9b" } new_table_name: "default.Table_dbfd7328a9af4234a24a02dcba076cde" modify_external_catalogs: true
I20260928 14:50:47.189101 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ef589de9756d4a71a55a6beeb91a9638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.189603 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef589de9756d4a71a55a6beeb91a9638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.189590 9855 raft_consensus.cc:348] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.189806 9855 raft_consensus.cc:374] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.189877 9855 raft_consensus.cc:729] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.190115 9855 consensus_queue.cc:260] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.190646 9855 ts_tablet_manager.cc:1428] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.029s user 0.001s sys 0.000s
I20260928 14:50:47.190732 11469 raft_consensus.cc:482] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.190841 11469 raft_consensus.cc:504] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.190963 9855 tablet_bootstrap.cc:492] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.191340 11469 leader_election.cc:288] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:47.192617 9360 leader_election.cc:341] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: d96492abf8cf459a992dd1d7b0226b57
W20260928 14:50:47.192973 9360 leader_election.cc:341] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:47.193055 9360 leader_election.cc:302] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.193385 11469 raft_consensus.cc:2726] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.194121 9848 tablet_bootstrap.cc:654] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.196960 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92bf219c9c074585968764e134375172 consensus state has no leader
I20260928 14:50:47.206367 9851 tablet_bootstrap.cc:492] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.206550 9851 ts_tablet_manager.cc:1397] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.002s
I20260928 14:50:47.207335 9851 raft_consensus.cc:348] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.207595 9851 raft_consensus.cc:374] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.207633 8946 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:47.207772 9851 raft_consensus.cc:729] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.208484 11228 raft_consensus.cc:482] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.208578 9851 consensus_queue.cc:260] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.208599 11228 raft_consensus.cc:504] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.209430 11228 leader_election.cc:288] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.210147 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_dd9786bbfc614618932b01eecc57b575"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.210660 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd9786bbfc614618932b01eecc57b575 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:47.212898 9219 leader_election.cc:341] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 9f2c5afbdeda4ddfb82124031135e6cb
I20260928 14:50:47.214923 8952 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:47.218048 9851 ts_tablet_manager.cc:1428] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260928 14:50:47.219048 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:47.220922 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_24223101f6054757a0e18eaec7b32802" } new_table_name: "default.Table_edd3450406d74b4792bac23f80065ace" modify_external_catalogs: true
I20260928 14:50:47.223084 9851 tablet_bootstrap.cc:492] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.223558 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:47.224514 9851 tablet_bootstrap.cc:654] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.225788 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c2b58c2fedfe482aa60fc8268d18df36" } new_table_name: "default.Table_377ed20602374b098a989b3168965db1" modify_external_catalogs: true
I20260928 14:50:47.230999 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_86f0f4bd53e04e22989845f367f3bd90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.231485 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86f0f4bd53e04e22989845f367f3bd90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.232843 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2c5afbdeda4ddfb82124031135e6cb" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.233824 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 39091da7a6fb4aceadd3434bd304c268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:38 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.234351 11469 raft_consensus.cc:482] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.234472 11469 raft_consensus.cc:504] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:47.233421 9220 leader_election.cc:341] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.234843 9220 leader_election.cc:302] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.234973 11469 leader_election.cc:288] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.235203 11228 raft_consensus.cc:2726] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:47.236403 9360 leader_election.cc:341] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 83705b3cf3e746f4b0aca9c2c8bd2f2f
W20260928 14:50:47.236562 9360 leader_election.cc:341] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:47.236621 9360 leader_election.cc:302] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.237087 11469 raft_consensus.cc:2726] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.237560 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6c4fdd9cb2d642be81fc146a1994dce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.238009 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c4fdd9cb2d642be81fc146a1994dce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:47.241678 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35b9aa8b2fb64528af024a86c9e29e57 consensus state has no leader
I20260928 14:50:47.242024 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_59cfabba7ef24617ac07ed3158699d74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.242441 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59cfabba7ef24617ac07ed3158699d74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.247638 9851 tablet_bootstrap.cc:492] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.247808 9851 ts_tablet_manager.cc:1397] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.005s
I20260928 14:50:47.248646 9851 raft_consensus.cc:348] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.248996 9851 raft_consensus.cc:374] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.249105 9851 raft_consensus.cc:729] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.249380 9851 consensus_queue.cc:260] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.250402 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b6854864679c4e3e97698d1c59b9cc58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.250837 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6854864679c4e3e97698d1c59b9cc58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.261683 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_11be47a99ffa4016815da97700aa17f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.262081 9813 ts_tablet_manager.cc:1918] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:47.262145 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11be47a99ffa4016815da97700aa17f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.262198 9813 log.cc:1196] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/ba0d51f1c2664e0b8c6acb7847eff7cc
I20260928 14:50:47.263896 9813 ts_tablet_manager.cc:1939] T ba0d51f1c2664e0b8c6acb7847eff7cc P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.266181 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet ba0d51f1c2664e0b8c6acb7847eff7cc (table default.Table_8d74997e24e947b09eae991bafdc55ae [id=6c2e51755e5f47798479fdcb7eb20d16]) successfully deleted
I20260928 14:50:47.267715 9851 ts_tablet_manager.cc:1428] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260928 14:50:47.268215 9851 tablet_bootstrap.cc:492] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.269564 9813 tablet_replica.cc:330] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.274019 9851 tablet_bootstrap.cc:654] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.276314 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4325f2f6dec94231b3972ff9e247e80d consensus state has no leader
W20260928 14:50:47.281255 11493 log.cc:924] Time spent T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260928 14:50:47.282917 9814 ts_tablet_manager.cc:1918] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.283110 9814 log.cc:1196] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:47.283443 9814 ts_tablet_manager.cc:1939] T 62d6975813b744fb80dcc432cec61cb4 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.284171 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1205) took 2328 ms. Trace:
I20260928 14:50:47.286059 9814 rpcz_store.cc:276] 0928 14:50:44.955594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.955655 (+ 61us) service_pool.cc:227] Handling call
0928 14:50:47.165178 (+2209523us) ts_tablet_manager.cc:1145] Deleting tablet 62d6975813b744fb80dcc432cec61cb4
0928 14:50:47.165188 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.203214 (+ 38026us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.282820 (+ 79606us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.284152 (+ 1332us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209305}
I20260928 14:50:47.286638 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1209) took 2317 ms. Trace:
I20260928 14:50:47.286803 9814 rpcz_store.cc:276] 0928 14:50:44.969151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.969219 (+ 68us) service_pool.cc:227] Handling call
0928 14:50:47.286518 (+2317299us) ts_tablet_manager.cc:1145] Deleting tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c
0928 14:50:47.286528 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.286620 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2316985}
I20260928 14:50:47.287146 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 62d6975813b744fb80dcc432cec61cb4 (table default.Table_7f5b6959a73a41c09b4f8e8383ec2f2c [id=63833e63efa7423e9eabe903f17d5996]) successfully deleted
I20260928 14:50:47.287263 9814 tablet_replica.cc:330] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:47.287420 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20cb8d9f99dd4d3e93d3e4405d0f6a3c already in progress: creating tablet
I20260928 14:50:47.287446 9814 raft_consensus.cc:2229] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.287573 9814 raft_consensus.cc:2258] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.288053 9814 ts_tablet_manager.cc:1905] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.291898 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 6ade6066d90547b6bb9be50799bf8d5f (table default.Table_6bbca659342d47fa879bd3441a38f962 [id=c3661daf210e487da61f9890001cf516]) successfully deleted
I20260928 14:50:47.294394 11458 raft_consensus.cc:482] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.294512 11458 raft_consensus.cc:504] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.295035 11458 leader_election.cc:288] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.295696 9814 ts_tablet_manager.cc:1918] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.295842 9814 log.cc:1196] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/30d197a8ba8848d98ba0f03b2e83d3f6
I20260928 14:50:47.295940 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.296222 9814 ts_tablet_manager.cc:1939] T 30d197a8ba8848d98ba0f03b2e83d3f6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
W20260928 14:50:47.296603 9497 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.296962 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1203) took 2344 ms. Trace:
I20260928 14:50:47.296916 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.297091 9814 rpcz_store.cc:276] 0928 14:50:44.952222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:44.993649 (+ 41427us) service_pool.cc:227] Handling call
0928 14:50:47.287223 (+2293574us) ts_tablet_manager.cc:1145] Deleting tablet 30d197a8ba8848d98ba0f03b2e83d3f6
0928 14:50:47.287234 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.292973 (+ 5739us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.295612 (+ 2639us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.296946 (+ 1334us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293309}
W20260928 14:50:47.297482 9498 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.297597 9498 leader_election.cc:302] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.297737 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1215) took 2259 ms. Trace:
I20260928 14:50:47.297807 9814 rpcz_store.cc:276] 0928 14:50:45.037839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.046191 (+ 8352us) service_pool.cc:227] Handling call
0928 14:50:47.297489 (+2251298us) ts_tablet_manager.cc:1145] Deleting tablet 6e4f703cc19c453cbc46432a4430a204
0928 14:50:47.297499 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.297721 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2251138}
I20260928 14:50:47.298022 11228 raft_consensus.cc:482] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.298206 9814 tablet_replica.cc:330] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.298130 11228 raft_consensus.cc:504] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.298406 9814 raft_consensus.cc:2229] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.298525 9814 raft_consensus.cc:2258] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:47.299547 9219 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 66772fac8b3747f0983562195abcc64e
I20260928 14:50:47.299642 9814 ts_tablet_manager.cc:1905] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.299818 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66772fac8b3747f0983562195abcc64e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.300272 9220 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.300377 9220 leader_election.cc:302] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.300575 11371 raft_consensus.cc:2726] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.300827 11458 raft_consensus.cc:2726] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.305338 9814 ts_tablet_manager.cc:1918] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.305423 9814 log.cc:1196] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/5a6755b697134b8e90e457b554b9599c
I20260928 14:50:47.305694 9814 ts_tablet_manager.cc:1939] T 5a6755b697134b8e90e457b554b9599c P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.305827 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 30d197a8ba8848d98ba0f03b2e83d3f6 (table default.Table_2378f0131076405ab6f9ad2247f22c2b [id=74dcef243b8f4685bef322f403a2ebd2]) successfully deleted
W20260928 14:50:47.306067 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6e4f703cc19c453cbc46432a4430a204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e4f703cc19c453cbc46432a4430a204 already in progress: creating tablet
I20260928 14:50:47.298657 11228 leader_election.cc:288] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.308127 8946 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:47.311877 9815 tablet_replica.cc:330] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.312075 9815 raft_consensus.cc:2229] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.312211 9815 raft_consensus.cc:2258] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.312819 9815 ts_tablet_manager.cc:1905] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.317230 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1216) took 2278 ms. Trace:
I20260928 14:50:47.317370 9814 rpcz_store.cc:276] 0928 14:50:45.038519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.049603 (+ 11084us) service_pool.cc:227] Handling call
0928 14:50:47.298172 (+2248569us) ts_tablet_manager.cc:1145] Deleting tablet 5a6755b697134b8e90e457b554b9599c
0928 14:50:47.298182 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.302834 (+ 4652us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.305275 (+ 2441us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.317207 (+ 11932us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2248416}
I20260928 14:50:47.317842 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 5a6755b697134b8e90e457b554b9599c (table default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]) successfully deleted
I20260928 14:50:47.318240 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1224) took 2110 ms. Trace:
I20260928 14:50:47.318365 9814 rpcz_store.cc:276] 0928 14:50:45.207533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.207780 (+ 247us) service_pool.cc:227] Handling call
0928 14:50:47.318125 (+2110345us) ts_tablet_manager.cc:1145] Deleting tablet 220eb184524b4cd58a4642dbbed5e9d8
0928 14:50:47.318135 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.318222 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2110096}
W20260928 14:50:47.318811 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 220eb184524b4cd58a4642dbbed5e9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 220eb184524b4cd58a4642dbbed5e9d8 already in progress: creating tablet
I20260928 14:50:47.319180 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1229) took 2101 ms. Trace:
I20260928 14:50:47.319293 9814 rpcz_store.cc:276] 0928 14:50:45.218158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.218209 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:47.319081 (+2100872us) ts_tablet_manager.cc:1145] Deleting tablet 2137c02d796a4290a8b160c57069fdd2
0928 14:50:47.319091 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.319164 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2100668}
W20260928 14:50:47.319713 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2137c02d796a4290a8b160c57069fdd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2137c02d796a4290a8b160c57069fdd2 already in progress: creating tablet
I20260928 14:50:47.320182 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1237) took 1957 ms. Trace:
I20260928 14:50:47.320300 9814 rpcz_store.cc:276] 0928 14:50:45.362504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.362550 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:47.320087 (+1957537us) ts_tablet_manager.cc:1145] Deleting tablet 0904b4dbbbd2417a88cba0e67e5a31a4
0928 14:50:47.320097 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.320166 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1957341}
W20260928 14:50:47.320868 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 0904b4dbbbd2417a88cba0e67e5a31a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0904b4dbbbd2417a88cba0e67e5a31a4 already in progress: creating tablet
I20260928 14:50:47.321249 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1238) took 1955 ms. Trace:
I20260928 14:50:47.321384 9851 tablet_bootstrap.cc:492] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.321518 9851 ts_tablet_manager.cc:1397] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.001s
I20260928 14:50:47.322032 8950 catalog_manager.cc:5495] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:47.322312 9813 raft_consensus.cc:2229] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.322284 9851 raft_consensus.cc:348] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.322464 9851 raft_consensus.cc:374] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.322463 9813 raft_consensus.cc:2258] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.322510 9851 raft_consensus.cc:729] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.322685 9851 consensus_queue.cc:260] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.323220 9851 ts_tablet_manager.cc:1428] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:47.321355 9814 rpcz_store.cc:276] 0928 14:50:45.366280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.366412 (+ 132us) service_pool.cc:227] Handling call
0928 14:50:47.321119 (+1954707us) ts_tablet_manager.cc:1145] Deleting tablet 87d038f4cb0c48f3b4cc6ff66621bb2b
0928 14:50:47.321161 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.321233 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954519}
I20260928 14:50:47.323660 9851 tablet_bootstrap.cc:492] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.323611 9813 ts_tablet_manager.cc:1905] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.325098 9851 tablet_bootstrap.cc:654] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.325847 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1240) took 1753 ms. Trace:
I20260928 14:50:47.325919 9814 rpcz_store.cc:276] 0928 14:50:45.572097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.572149 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:47.323467 (+1751318us) ts_tablet_manager.cc:1145] Deleting tablet 4eca68f459834ce2983a27c21361eef3
0928 14:50:47.325747 (+ 2280us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.325830 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1724412}
I20260928 14:50:47.326170 9814 tablet_replica.cc:330] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.326329 9814 raft_consensus.cc:2229] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.326479 9814 raft_consensus.cc:2258] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.326908 9814 ts_tablet_manager.cc:1905] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.328871 9815 ts_tablet_manager.cc:1918] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.328971 9815 log.cc:1196] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5d08466aa7d54f12b137986258a6d174
I20260928 14:50:47.329214 9815 ts_tablet_manager.cc:1939] T 5d08466aa7d54f12b137986258a6d174 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.331818 11458 raft_consensus.cc:482] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.331933 11458 raft_consensus.cc:504] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.332206 9814 ts_tablet_manager.cc:1918] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:47.332515 11458 leader_election.cc:288] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.333140 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.333401 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 87d038f4cb0c48f3b4cc6ff66621bb2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d038f4cb0c48f3b4cc6ff66621bb2b already in progress: creating tablet
W20260928 14:50:47.333655 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4eca68f459834ce2983a27c21361eef3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4eca68f459834ce2983a27c21361eef3 already in progress: creating tablet
W20260928 14:50:47.333731 9498 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.340018 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b1e0f6176c744afc8e6250bfbdc9ba66" } new_table_name: "default.Table_624442986eaf4cd494c92fc63c517001" modify_external_catalogs: true
I20260928 14:50:47.341123 8946 master_service.cc:946] ReplaceTablet: received request to replace tablet 24f53d04326f4e639be23564563034e0 from {username='slave'} at 127.0.0.1:59208
W20260928 14:50:47.346103 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9c8417487b3473dab516b5359e15bb9 consensus state has no leader
I20260928 14:50:47.348783 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1d6cb51e302f48d7829c53826ac9934c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.349273 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d6cb51e302f48d7829c53826ac9934c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.350457 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ad01b16b05e54931a25a012cda7fd249" } new_table_name: "default.Table_54fbbac441174538b6147a3e3feeefe9" modify_external_catalogs: true
W20260928 14:50:47.357695 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5f30a4a4fca48818a7a89ad91e71393 consensus state has no leader
I20260928 14:50:47.334300 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.343379 11228 raft_consensus.cc:482] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:47.365861 9497 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.365976 9497 leader_election.cc:302] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.365917 11228 raft_consensus.cc:504] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.366324 11458 raft_consensus.cc:2726] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.332293 9814 log.cc:1196] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3bef7b73d24a42979fcb7a2e47e92919
I20260928 14:50:47.366487 11228 leader_election.cc:288] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.366868 9814 ts_tablet_manager.cc:1939] T 3bef7b73d24a42979fcb7a2e47e92919 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.367015 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c54cb0e8f2347d9b139c8766fb61ab1" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.367568 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1241) took 1770 ms. Trace:
I20260928 14:50:47.367661 9814 rpcz_store.cc:276] 0928 14:50:45.596705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.596838 (+ 133us) service_pool.cc:227] Handling call
0928 14:50:47.326121 (+1729283us) ts_tablet_manager.cc:1145] Deleting tablet 3bef7b73d24a42979fcb7a2e47e92919
0928 14:50:47.326142 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.329615 (+ 3473us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.332125 (+ 2510us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.367550 (+ 35425us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1727015}
I20260928 14:50:47.368279 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3aa61fb67d494d8ab7dec29dbc5b61cc
I20260928 14:50:47.369028 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:47.369824 9220 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.370270 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3bef7b73d24a42979fcb7a2e47e92919 (table default.Table_405df45dc13a4ff084c15b99fcf01e2d [id=3c4d98ba9d9c40018d5ed6bb792c4b98]) successfully deleted
I20260928 14:50:47.370735 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.371129 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:47.373277 9219 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1c54cb0e8f2347d9b139c8766fb61ab1
I20260928 14:50:47.373374 9219 leader_election.cc:302] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.373873 11228 raft_consensus.cc:2726] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.378872 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3d263b3af1ef402b95affbfcd2aa7ed0
I20260928 14:50:47.379954 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.380817 9814 tablet_replica.cc:330] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.381294 9814 raft_consensus.cc:2229] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:47.381748 9814 raft_consensus.cc:2258] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.382304 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 89431db9b37d4d13a25cb736f67129bd
I20260928 14:50:47.382644 9814 ts_tablet_manager.cc:1905] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.383464 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 89431db9b37d4d13a25cb736f67129bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.385403 9815 tablet_replica.cc:330] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.385743 9815 raft_consensus.cc:2229] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.385954 9815 raft_consensus.cc:2258] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.386047 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5d08466aa7d54f12b137986258a6d174 (table default.Table_13cca1a2e79e4301b51736b5837ed4e7 [id=aede97bb521e444299de23f07bf2f10e]) successfully deleted
W20260928 14:50:47.386220 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 24f53d04326f4e639be23564563034e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24f53d04326f4e639be23564563034e0 already in progress: creating tablet
W20260928 14:50:47.386355 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 2871c2000c9f41f9ba8145ed0c3ee508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2871c2000c9f41f9ba8145ed0c3ee508 already in progress: creating tablet
W20260928 14:50:47.386475 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 22e642af72ff4f5285f8bc4e6ed36401 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22e642af72ff4f5285f8bc4e6ed36401 already in progress: creating tablet
I20260928 14:50:47.386719 9815 ts_tablet_manager.cc:1905] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.387008 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b5725df8a2fe4126b251c6d6008d8e5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.387226 9533 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:47.387492 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5725df8a2fe4126b251c6d6008d8e5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.388218 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.388218 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 89431db9b37d4d13a25cb736f67129bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.388455 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 89431db9b37d4d13a25cb736f67129bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.388499 11228 raft_consensus.cc:482] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.388593 11228 raft_consensus.cc:504] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.389074 11228 leader_election.cc:288] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.389348 9848 tablet_bootstrap.cc:492] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.389467 9848 ts_tablet_manager.cc:1397] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.245s user 0.053s sys 0.081s
W20260928 14:50:47.389865 9219 leader_election.cc:341] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 4744deca899b4e6caa57f70ce1df8a8d
I20260928 14:50:47.390136 11458 raft_consensus.cc:482] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.390089 9848 raft_consensus.cc:348] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.390285 9848 raft_consensus.cc:374] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.390332 9848 raft_consensus.cc:729] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.390241 11458 raft_consensus.cc:504] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.390504 9848 consensus_queue.cc:260] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.390769 11458 leader_election.cc:288] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.393693 9848 ts_tablet_manager.cc:1428] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:47.393940 9848 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.394132 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.394469 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:47.394757 9498 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.395176 9848 tablet_bootstrap.cc:654] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.395582 9497 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.395699 9497 leader_election.cc:302] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.396028 11458 raft_consensus.cc:2726] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.398119 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet aaacc1f839914859b23ae755042e02d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:34 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.398663 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4744deca899b4e6caa57f70ce1df8a8d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.398798 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1e5f82ac6fba495687756de9850b7f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.399188 9220 leader_election.cc:341] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:47.399286 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e5f82ac6fba495687756de9850b7f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.399284 9220 leader_election.cc:302] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.401104 11223 raft_consensus.cc:2726] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.402545 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_405df45dc13a4ff084c15b99fcf01e2d" } new_table_name: "default.Table_8672b6ac755c46008bf3291794a146ed" modify_external_catalogs: true
I20260928 14:50:47.403832 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_ac66409422f84d7dba7e34649494aba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.404265 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac66409422f84d7dba7e34649494aba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.404642 9848 tablet_bootstrap.cc:492] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.404744 9848 ts_tablet_manager.cc:1397] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20260928 14:50:47.405345 9848 raft_consensus.cc:348] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.405539 9848 raft_consensus.cc:374] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.405584 9848 raft_consensus.cc:729] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.406386 9851 tablet_bootstrap.cc:492] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.406487 9851 ts_tablet_manager.cc:1397] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.083s user 0.006s sys 0.024s
I20260928 14:50:47.407401 9851 raft_consensus.cc:348] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.407618 9851 raft_consensus.cc:374] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.407687 9851 raft_consensus.cc:729] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.407868 9851 consensus_queue.cc:260] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.408545 9851 ts_tablet_manager.cc:1428] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.408825 9851 tablet_bootstrap.cc:492] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.410771 9851 tablet_bootstrap.cc:654] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.405831 9848 consensus_queue.cc:260] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.412371 9848 ts_tablet_manager.cc:1428] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:47.412639 9848 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.413995 9814 ts_tablet_manager.cc:1918] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 14:50:47.414024 9848 tablet_bootstrap.cc:654] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.414131 9814 log.cc:1196] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7aa9167742a94a0ab586e15205a0ccdc
I20260928 14:50:47.414487 9814 ts_tablet_manager.cc:1939] T 7aa9167742a94a0ab586e15205a0ccdc P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.415181 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1243) took 1763 ms. Trace:
I20260928 14:50:47.415295 9814 rpcz_store.cc:276] 0928 14:50:45.651709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.651762 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:47.368084 (+1716322us) ts_tablet_manager.cc:1145] Deleting tablet 7aa9167742a94a0ab586e15205a0ccdc
0928 14:50:47.376325 (+ 8241us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.392249 (+ 15924us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.413899 (+ 21650us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.415151 (+ 1252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1716069}
I20260928 14:50:47.415704 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7aa9167742a94a0ab586e15205a0ccdc (table default.Table_33d213a97ea349d6ab97a84fd1571e6d [id=e00f618e9273435db59f9445f6485b89]) successfully deleted
I20260928 14:50:47.415992 9814 tablet_replica.cc:330] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.418758 9814 raft_consensus.cc:2229] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:47.419822 9813 ts_tablet_manager.cc:1918] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.419997 9813 log.cc:1196] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/bc47ae6fbfca4fc0b0b053d0134a49d0
I20260928 14:50:47.420182 9848 tablet_bootstrap.cc:492] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.420329 9848 ts_tablet_manager.cc:1397] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260928 14:50:47.420490 9813 ts_tablet_manager.cc:1939] T bc47ae6fbfca4fc0b0b053d0134a49d0 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.421012 9848 raft_consensus.cc:348] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.421203 9848 raft_consensus.cc:374] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.421262 9848 raft_consensus.cc:729] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.421427 9848 consensus_queue.cc:260] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.423054 9851 tablet_bootstrap.cc:492] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.423202 9851 ts_tablet_manager.cc:1397] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260928 14:50:47.423954 9851 raft_consensus.cc:348] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.424358 9851 raft_consensus.cc:374] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.424431 9851 raft_consensus.cc:729] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.424610 9851 consensus_queue.cc:260] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.425068 9851 ts_tablet_manager.cc:1428] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.425447 9814 raft_consensus.cc:2258] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.425503 9848 ts_tablet_manager.cc:1428] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260928 14:50:47.426008 9848 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.427994 9848 tablet_bootstrap.cc:654] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.425792 9851 tablet_bootstrap.cc:492] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.433770 9814 ts_tablet_manager.cc:1905] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.434880 9851 tablet_bootstrap.cc:654] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.435825 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_15d64ced631d4320b048b959d33ffc95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.436355 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15d64ced631d4320b048b959d33ffc95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.441650 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.442914 11223 raft_consensus.cc:482] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.443034 11223 raft_consensus.cc:504] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.443549 11223 leader_election.cc:288] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:47.444397 9219 leader_election.cc:341] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 2ebd54cdc07549e5b7cb179f4ab3aa9f
I20260928 14:50:47.444895 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebd54cdc07549e5b7cb179f4ab3aa9f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.445267 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_f7b29b2be4fe487ca26ef324590e0a87" } new_table_name: "default.Table_2cfd34ce8e1f4748878841834950ad7e" modify_external_catalogs: true
W20260928 14:50:47.445382 9220 leader_election.cc:341] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.445482 9220 leader_election.cc:302] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.445899 11223 raft_consensus.cc:2726] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.447290 9851 tablet_bootstrap.cc:492] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.447368 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb3cc5b42524a4399d0bcf21c851fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.447404 9851 ts_tablet_manager.cc:1397] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20260928 14:50:47.448315 9851 raft_consensus.cc:348] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.448498 9851 raft_consensus.cc:374] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.448550 9851 raft_consensus.cc:729] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.449131 9851 consensus_queue.cc:260] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.449682 9851 ts_tablet_manager.cc:1428] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:47.449929 9851 tablet_bootstrap.cc:492] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:47.450902 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8c263399eaa479b88f24e74d85618aa consensus state has no leader
I20260928 14:50:47.451828 9851 tablet_bootstrap.cc:654] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.458164 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet bc47ae6fbfca4fc0b0b053d0134a49d0 (table default.Table_6e3dd5704ce1494096b9810b983fc8a9 [id=49157f905fed4cf8936325e4fcb30ae3]) successfully deleted
I20260928 14:50:47.458462 9813 tablet_replica.cc:330] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.458745 9813 raft_consensus.cc:2229] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.458962 9813 raft_consensus.cc:2258] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.459940 9813 ts_tablet_manager.cc:1905] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.464965 9848 tablet_bootstrap.cc:492] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.465111 9848 ts_tablet_manager.cc:1397] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.007s
I20260928 14:50:47.466410 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d4d3fae1326a4235b6726c1a426933b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.466741 9848 raft_consensus.cc:348] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.466918 9848 raft_consensus.cc:374] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:47.466917 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4d3fae1326a4235b6726c1a426933b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.466958 9848 raft_consensus.cc:729] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.467114 9848 consensus_queue.cc:260] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.467556 9848 ts_tablet_manager.cc:1428] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:47.467829 9848 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.468353 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_81003e03666547ae85a4f991627f4342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.468866 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81003e03666547ae85a4f991627f4342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.469637 9848 tablet_bootstrap.cc:654] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.470547 9814 ts_tablet_manager.cc:1918] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260928 14:50:47.472849 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac3269b07250416d98493f5d33f59210 consensus state has no leader
I20260928 14:50:47.476239 9815 ts_tablet_manager.cc:1918] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.476467 9815 log.cc:1196] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/9dd00b9377b245a29d2a6735248112bc
I20260928 14:50:47.476616 9851 tablet_bootstrap.cc:492] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.476861 9851 ts_tablet_manager.cc:1397] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260928 14:50:47.477589 9851 raft_consensus.cc:348] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.477800 9851 raft_consensus.cc:374] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.477862 9851 raft_consensus.cc:729] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.478135 9851 consensus_queue.cc:260] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.478735 9851 ts_tablet_manager.cc:1428] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:47.478988 9851 tablet_bootstrap.cc:492] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.479977 9814 log.cc:1196] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2c50f7410dd549f399449487556f813d
I20260928 14:50:47.480423 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 148e81f8add349f2b233862a7049e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.481084 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6f880fe191e64e179c0759d9af7a04ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.481659 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f880fe191e64e179c0759d9af7a04ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.481729 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_68e8720b58b54dd3af381526ec156fa3" } new_table_name: "default.Table_f2ec775ba5484f158eabbe42a3c79913" modify_external_catalogs: true
I20260928 14:50:47.482945 9851 tablet_bootstrap.cc:654] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.483176 9815 ts_tablet_manager.cc:1939] T 9dd00b9377b245a29d2a6735248112bc P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.483978 9814 ts_tablet_manager.cc:1939] T 2c50f7410dd549f399449487556f813d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.484148 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a9c5bc4389eb4abcae54f80fa93ea23b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.484632 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9c5bc4389eb4abcae54f80fa93ea23b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.486150 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4787d935cdb34bb896342dfcc4554ff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.486624 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4787d935cdb34bb896342dfcc4554ff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.487869 9855 tablet_bootstrap.cc:654] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.490880 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1248) took 1579 ms. Trace:
I20260928 14:50:47.491003 9814 rpcz_store.cc:276] 0928 14:50:45.911821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.911874 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:47.415951 (+1504077us) ts_tablet_manager.cc:1145] Deleting tablet 2c50f7410dd549f399449487556f813d
0928 14:50:47.415962 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.458969 (+ 43007us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.470457 (+ 11488us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.490861 (+ 20404us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1503887}
I20260928 14:50:47.491549 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2c50f7410dd549f399449487556f813d (table default.Table_113bd4fb4dfe4daaad54e66560882085 [id=e7f9f23fc1bf4ff7b3b8680f3cc751de]) successfully deleted
I20260928 14:50:47.491753 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1249) took 1579 ms. Trace:
I20260928 14:50:47.491842 9814 rpcz_store.cc:276] 0928 14:50:45.912219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.912264 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:47.491614 (+1579350us) ts_tablet_manager.cc:1145] Deleting tablet ba96eb0f6c0141ee96e30496cbb19edc
0928 14:50:47.491624 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.491737 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1579206}
W20260928 14:50:47.492175 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ba96eb0f6c0141ee96e30496cbb19edc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba96eb0f6c0141ee96e30496cbb19edc already in progress: creating tablet
I20260928 14:50:47.490936 11458 raft_consensus.cc:482] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.493662 11458 raft_consensus.cc:504] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.494305 11458 leader_election.cc:288] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.494683 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.494885 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.495132 9497 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:47.495424 9498 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.495533 9498 leader_election.cc:302] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.495649 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1250) took 1583 ms. Trace:
I20260928 14:50:47.495733 9814 rpcz_store.cc:276] 0928 14:50:45.912541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.912578 (+ 37us) service_pool.cc:227] Handling call
0928 14:50:47.495547 (+1582969us) ts_tablet_manager.cc:1145] Deleting tablet ce64a75bc55a4496bcd96070290a324c
0928 14:50:47.495557 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.495634 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1582816}
I20260928 14:50:47.495949 11458 raft_consensus.cc:2726] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:47.496050 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ce64a75bc55a4496bcd96070290a324c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce64a75bc55a4496bcd96070290a324c already in progress: creating tablet
I20260928 14:50:47.496616 9814 tablet_replica.cc:330] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.496803 9814 raft_consensus.cc:2229] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.496940 9814 raft_consensus.cc:2258] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.497396 9814 ts_tablet_manager.cc:1905] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.509332 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e59b8e736b6d4644a78a6d7570746e18 (table default.Table_9aa2a15124ab40d682b1da19d1713074 [id=db3c037ac7784283bb5dc67c99a4b73c]). Expected version 1 got 0
I20260928 14:50:47.509588 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:47.510389 11469 raft_consensus.cc:482] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.510510 11469 raft_consensus.cc:504] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.511049 11469 leader_election.cc:288] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119), 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023)
I20260928 14:50:47.512128 9261 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a14c0b50cad4954b5dc5666689810ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:47.512257 9360 leader_election.cc:341] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:47.512277 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet f39c1da071164342aea8eab263d4eebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.512362 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 4744deca899b4e6caa57f70ce1df8a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.512437 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.512435 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af72ac7bedb4cd7aed28cffda867c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.512612 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa9167742a94a0ab586e15205a0ccdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:45 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:47.512687 9360 leader_election.cc:341] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:47.512748 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06859c8dcc41d99d29365aae350afa with delete_type TABLET_DATA_DELETED (replaced by tablet 7abafb4f6c6948a4a27a1862a61f4a80) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.512777 9360 leader_election.cc:302] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.514302 9814 ts_tablet_manager.cc:1918] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.515956 11469 raft_consensus.cc:2726] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.520689 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:47.522044 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet c51f5944c6534e9492594c39ae9796b2 with delete_type TABLET_DATA_DELETED (replaced by tablet b42be57c0eeb40c4b1b25c9a0d285655) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.525156 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 974d3dd678f8459f82fef7c2130fe349 (DEFAULT_TABLE table=default.Table_3800704533234fe283c61d7769b32809 [id=1d945dd61c8745d1aed053c1b69ecac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.525295 9814 log.cc:1196] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/6d193edcfa684b8795b084f3106903c5
I20260928 14:50:47.522457 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 846a96509f32416087ee4667458c367e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.522807 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a2f051a09e143b8bb0ba3be81406b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 167abd4bc50d43cb98d667be90ea278a) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.525098 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 974d3dd678f8459f82fef7c2130fe349 (DEFAULT_TABLE table=default.Table_3800704533234fe283c61d7769b32809 [id=1d945dd61c8745d1aed053c1b69ecac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.525511 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 974d3dd678f8459f82fef7c2130fe349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.525624 9814 ts_tablet_manager.cc:1939] T 6d193edcfa684b8795b084f3106903c5 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.525657 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 974d3dd678f8459f82fef7c2130fe349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.528685 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1268) took 1098 ms. Trace:
I20260928 14:50:47.528769 9815 rpcz_store.cc:276] 0928 14:50:46.430315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.430370 (+ 55us) service_pool.cc:227] Handling call
0928 14:50:47.385340 (+954970us) ts_tablet_manager.cc:1145] Deleting tablet 9dd00b9377b245a29d2a6735248112bc
0928 14:50:47.385351 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.438191 (+ 52840us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.476020 (+ 37829us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.528663 (+ 52643us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954783}
I20260928 14:50:47.529172 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1269) took 1097 ms. Trace:
I20260928 14:50:47.529189 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 9dd00b9377b245a29d2a6735248112bc (table default.Table_3de913f218814860a16fcc09f89fc8dc [id=2fbca25eb1d74b19a18659518d7a37f0]) successfully deleted
I20260928 14:50:47.529243 9815 rpcz_store.cc:276] 0928 14:50:46.431386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.431431 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:47.529044 (+1097613us) ts_tablet_manager.cc:1145] Deleting tablet 4fdc5e3f83924f4cae8d30be9dcce152
0928 14:50:47.529055 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.529156 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097464}
I20260928 14:50:47.529551 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1270) took 1064 ms. Trace:
I20260928 14:50:47.529613 9815 rpcz_store.cc:276] 0928 14:50:46.465240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.465367 (+ 127us) service_pool.cc:227] Handling call
0928 14:50:47.529440 (+1064073us) ts_tablet_manager.cc:1145] Deleting tablet b39c67a1cf4c4a97af85aaf0484835f8
0928 14:50:47.529449 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.529535 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011780}
W20260928 14:50:47.529652 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 4fdc5e3f83924f4cae8d30be9dcce152 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fdc5e3f83924f4cae8d30be9dcce152 already in progress: creating tablet
I20260928 14:50:47.529888 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1271) took 1064 ms. Trace:
I20260928 14:50:47.529950 9815 rpcz_store.cc:276] 0928 14:50:46.465346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.466024 (+ 678us) service_pool.cc:227] Handling call
0928 14:50:47.529801 (+1063777us) ts_tablet_manager.cc:1145] Deleting tablet cacb6cd51f3b4f238813e764818767c2
0928 14:50:47.529810 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.529875 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1012119}
W20260928 14:50:47.530002 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b39c67a1cf4c4a97af85aaf0484835f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39c67a1cf4c4a97af85aaf0484835f8 already in progress: creating tablet
I20260928 14:50:47.530210 9815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37336 (request call id 1272) took 1064 ms. Trace:
I20260928 14:50:47.530267 9815 rpcz_store.cc:276] 0928 14:50:46.465458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.466381 (+ 923us) service_pool.cc:227] Handling call
0928 14:50:47.530122 (+1063741us) ts_tablet_manager.cc:1145] Deleting tablet fb2feb8adf57477ab915eea1d980d3e6
0928 14:50:47.530130 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.530199 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1012382}
W20260928 14:50:47.530336 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet cacb6cd51f3b4f238813e764818767c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cacb6cd51f3b4f238813e764818767c2 already in progress: creating tablet
I20260928 14:50:47.530472 9815 tablet_replica.cc:330] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.530642 9815 raft_consensus.cc:2229] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.530776 9815 raft_consensus.cc:2258] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.531479 9815 ts_tablet_manager.cc:1905] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:47.531487 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fb2feb8adf57477ab915eea1d980d3e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb2feb8adf57477ab915eea1d980d3e6 already in progress: creating tablet
I20260928 14:50:47.538306 11228 raft_consensus.cc:482] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.538321 9848 tablet_bootstrap.cc:492] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.538425 11228 raft_consensus.cc:504] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.538520 9848 ts_tablet_manager.cc:1397] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.071s user 0.013s sys 0.040s
I20260928 14:50:47.538930 11228 leader_election.cc:288] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.539757 9848 raft_consensus.cc:348] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.540143 9848 raft_consensus.cc:374] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.540288 9848 raft_consensus.cc:729] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.540678 9848 consensus_queue.cc:260] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:47.541155 9219 leader_election.cc:341] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 846a96509f32416087ee4667458c367e
I20260928 14:50:47.540102 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846a96509f32416087ee4667458c367e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.541631 9848 ts_tablet_manager.cc:1428] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260928 14:50:47.541950 9220 leader_election.cc:341] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.542047 9220 leader_election.cc:302] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.542095 9848 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.542356 11498 raft_consensus.cc:2726] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.545498 9848 tablet_bootstrap.cc:654] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.549018 11498 consensus_queue.cc:1035] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:47.549587 9813 ts_tablet_manager.cc:1918] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.549726 9813 log.cc:1196] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d96492abf8cf459a992dd1d7b0226b57
I20260928 14:50:47.550035 9813 ts_tablet_manager.cc:1939] T d96492abf8cf459a992dd1d7b0226b57 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.550993 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d96492abf8cf459a992dd1d7b0226b57 (table default.Table_ca8c415e575244b4a42d5d0ca9dd5d53 [id=367147e7a6464487a38bf4d890ebefbc]) successfully deleted
I20260928 14:50:47.551322 9813 tablet_replica.cc:330] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.551515 9813 raft_consensus.cc:2229] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.551658 9813 raft_consensus.cc:2258] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.553305 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet b8237f7d97304a98889bde6817358eda from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:47.556556 11458 raft_consensus.cc:482] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.556676 11458 raft_consensus.cc:504] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.557193 11458 leader_election.cc:288] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.557693 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39091da7a6fb4aceadd3434bd304c268" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:47.558993 9497 leader_election.cc:341] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.562335 9855 tablet_bootstrap.cc:492] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.562453 9855 ts_tablet_manager.cc:1397] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.372s user 0.019s sys 0.003s
I20260928 14:50:47.563139 9855 raft_consensus.cc:348] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.563400 9855 raft_consensus.cc:374] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.563462 9855 raft_consensus.cc:729] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.563635 9855 consensus_queue.cc:260] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.564222 9855 ts_tablet_manager.cc:1428] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.564453 9855 tablet_bootstrap.cc:492] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.565603 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 974d3dd678f8459f82fef7c2130fe349 (DEFAULT_TABLE table=default.Table_3800704533234fe283c61d7769b32809 [id=1d945dd61c8745d1aed053c1b69ecac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.565948 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 974d3dd678f8459f82fef7c2130fe349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.566898 9855 tablet_bootstrap.cc:654] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.567138 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c124bbf1244745b78ecc7c99f373f265 consensus state has no leader
I20260928 14:50:47.567417 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_468a5a67d9d142899157a128521dd34a" } new_table_name: "default.Table_6b5b1ad677744d51b5be2baf87461889" modify_external_catalogs: true
I20260928 14:50:47.568156 9813 ts_tablet_manager.cc:1905] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.570623 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_ecb662da254a4311ae02dbe6dc348eb3" } new_table_name: "default.Table_5428f9159f704b41a295cdfa4c64fb81" modify_external_catalogs: true
I20260928 14:50:47.571249 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1c39903274b94d039d5579a95fe7b43f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.571713 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c39903274b94d039d5579a95fe7b43f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.557129 9848 tablet_bootstrap.cc:492] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.557703 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39091da7a6fb4aceadd3434bd304c268" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.576860 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2de0a4b814e8ca7437bb90a183b42 (DEFAULT_TABLE table=default.Table_61cbc1c34ee849ca9d0e63c4919bfcfc [id=6fef3ca72c914df58d038d234b18237a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:47.577258 9498 leader_election.cc:341] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.577304 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2de0a4b814e8ca7437bb90a183b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.577363 9498 leader_election.cc:302] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.577504 9815 ts_tablet_manager.cc:1918] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.577620 9815 log.cc:1196] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b9eadbe04d484ebfa57cd9d5f9e1cd5b
I20260928 14:50:47.577692 11458 raft_consensus.cc:2726] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.577874 9815 ts_tablet_manager.cc:1939] T b9eadbe04d484ebfa57cd9d5f9e1cd5b P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.577987 9848 ts_tablet_manager.cc:1397] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.005s
I20260928 14:50:47.578868 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1251) took 1653 ms. Trace:
I20260928 14:50:47.578963 9814 rpcz_store.cc:276] 0928 14:50:45.925248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.925293 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:47.496446 (+1571153us) ts_tablet_manager.cc:1145] Deleting tablet 6d193edcfa684b8795b084f3106903c5
0928 14:50:47.496455 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.500456 (+ 4001us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.514229 (+ 13773us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.546017 (+ 31788us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x615000289ea4. stack: 00007fdd1550c66e 00007fdd1550c430 00007fdd145935ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fdd20a43edd 00007fdd20a03de4 00007fdd21cea426 00007fdd246776e3 00007fdd246a9404 00007fdd2468a870 00007fdd2468a5fd 00000000009edb7c 00007fdd15552344 00007fdd1555591b
0928 14:50:47.578847 (+ 32830us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":45913344,"tablet-delete.queue_time_us":1571003}
I20260928 14:50:47.579285 9814 tablet_replica.cc:330] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.579452 9814 raft_consensus.cc:2229] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:47.579753 9814 raft_consensus.cc:2258] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.580250 9814 ts_tablet_manager.cc:1905] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.580758 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet edf76b53ded84392a39c73d7e653615d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:36 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.581035 9813 ts_tablet_manager.cc:1918] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.581121 9813 log.cc:1196] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/83705b3cf3e746f4b0aca9c2c8bd2f2f
I20260928 14:50:47.581375 9813 ts_tablet_manager.cc:1939] T 83705b3cf3e746f4b0aca9c2c8bd2f2f P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.581801 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 6d193edcfa684b8795b084f3106903c5 (table default.Table_7b0fb0bac48645b68ed77a4a2605c08b [id=02744da757694610abd1cde1b4d28fb6]) successfully deleted
I20260928 14:50:47.582196 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 83705b3cf3e746f4b0aca9c2c8bd2f2f (table default.Table_3f5f43e54bb54ec6a3baeaa43dffd6ba [id=e73aa0808e794d1188f57a6ba7b5e2d0]) successfully deleted
I20260928 14:50:47.582010 9848 raft_consensus.cc:348] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.582516 9848 raft_consensus.cc:374] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.582661 9848 raft_consensus.cc:729] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.583009 9848 consensus_queue.cc:260] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.583680 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_02540a2b82a6425d9b6a7d04ce13df5e" } modify_external_catalogs: true
I20260928 14:50:47.583877 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_02540a2b82a6425d9b6a7d04ce13df5e" } modify_external_catalogs: true
I20260928 14:50:47.584025 9848 ts_tablet_manager.cc:1428] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:47.584417 9848 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:47.585001 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa61fb67d494d8ab7dec29dbc5b61cc already in progress: creating tablet
I20260928 14:50:47.586807 9848 tablet_bootstrap.cc:654] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.589102 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d263b3af1ef402b95affbfcd2aa7ed0 already in progress: creating tablet
I20260928 14:50:47.592299 11498 raft_consensus.cc:482] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.592430 11498 raft_consensus.cc:504] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:47.592685 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 89431db9b37d4d13a25cb736f67129bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89431db9b37d4d13a25cb736f67129bd already in progress: creating tablet
I20260928 14:50:47.592988 11498 leader_election.cc:288] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.593288 9813 tablet_replica.cc:330] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.593488 9813 raft_consensus.cc:2229] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.593677 9813 raft_consensus.cc:2258] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:47.594192 9219 leader_election.cc:341] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7a2f051a09e143b8bb0ba3be81406b98
I20260928 14:50:47.594664 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a2f051a09e143b8bb0ba3be81406b98" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.595041 9813 ts_tablet_manager.cc:1905] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:47.595142 9220 leader_election.cc:341] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.595250 9220 leader_election.cc:302] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.595549 11498 raft_consensus.cc:2726] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.599237 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2de0a4b814e8ca7437bb90a183b42 (DEFAULT_TABLE table=default.Table_61cbc1c34ee849ca9d0e63c4919bfcfc [id=6fef3ca72c914df58d038d234b18237a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.599579 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2de0a4b814e8ca7437bb90a183b42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:47.601387 9220 consensus_peers.cc:487] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:47.594203 9814 ts_tablet_manager.cc:1918] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 14:50:47.601606 9814 log.cc:1196] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/a0d94bf844904306b84695e452d62ebd
I20260928 14:50:47.601985 9814 ts_tablet_manager.cc:1939] T a0d94bf844904306b84695e452d62ebd P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.602677 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1252) took 1677 ms. Trace:
I20260928 14:50:47.602759 9814 rpcz_store.cc:276] 0928 14:50:45.925584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:45.925632 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:47.579244 (+1653612us) ts_tablet_manager.cc:1145] Deleting tablet a0d94bf844904306b84695e452d62ebd
0928 14:50:47.579254 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.583485 (+ 4231us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.594082 (+ 10597us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.602658 (+ 8576us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1653474}
I20260928 14:50:47.603344 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1264) took 1572 ms. Trace:
I20260928 14:50:47.603422 9814 rpcz_store.cc:276] 0928 14:50:46.030810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.030890 (+ 80us) service_pool.cc:227] Handling call
0928 14:50:47.603230 (+1572340us) ts_tablet_manager.cc:1145] Deleting tablet 4d48886de3194e898da13b5d546ca9d8
0928 14:50:47.603242 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.603328 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1572137}
I20260928 14:50:47.603824 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1265) took 1422 ms. Trace:
I20260928 14:50:47.603893 9814 rpcz_store.cc:276] 0928 14:50:46.181396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.185032 (+ 3636us) service_pool.cc:227] Handling call
0928 14:50:47.603730 (+1418698us) ts_tablet_manager.cc:1145] Deleting tablet 6a6a176464e84c94bb5cc4ba6016df12
0928 14:50:47.603740 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.603811 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418498}
I20260928 14:50:47.604909 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92dcab49752f419c829f062d4491450f" } modify_external_catalogs: true
I20260928 14:50:47.605073 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_92dcab49752f419c829f062d4491450f" } modify_external_catalogs: true
I20260928 14:50:47.607563 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 42b9f78ecb674ae691d407615680ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.608165 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet a0d94bf844904306b84695e452d62ebd (table default.Table_36af68297033436da7f4857adf0b42ac [id=1877ed7db5c24007ba8dddadb6ff4970]) successfully deleted
W20260928 14:50:47.608357 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4d48886de3194e898da13b5d546ca9d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d48886de3194e898da13b5d546ca9d8 already in progress: creating tablet
W20260928 14:50:47.608553 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 6a6a176464e84c94bb5cc4ba6016df12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6a176464e84c94bb5cc4ba6016df12 already in progress: creating tablet
I20260928 14:50:47.608819 11498 raft_consensus.cc:482] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.608922 11498 raft_consensus.cc:504] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.609442 11498 leader_election.cc:288] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.610769 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.611340 9220 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.612569 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0be40c5bb8bc44b7a36723ee98a49249" } modify_external_catalogs: true
I20260928 14:50:47.612746 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0be40c5bb8bc44b7a36723ee98a49249" } modify_external_catalogs: true
I20260928 14:50:47.613667 9814 tablet_replica.cc:330] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.613905 9814 raft_consensus.cc:2229] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.614055 9814 raft_consensus.cc:2258] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.614575 9814 ts_tablet_manager.cc:1905] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.617098 9388 tablet_service.cc:1467] Processing CreateTablet for tablet ac36659c149540349a9d8f5bd4845c02 (DEFAULT_TABLE table=default.Table_141501ce8d6e48f3a7c7fa5542dfe488 [id=114d49f17d5a44f8a75b534ca547167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.617450 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac36659c149540349a9d8f5bd4845c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.617750 11498 raft_consensus.cc:482] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.617894 11498 raft_consensus.cc:504] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.618801 11498 leader_election.cc:288] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:47.623528 9219 leader_election.cc:341] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8fcc42af91c247b1b80059e95e3659cf
I20260928 14:50:47.623718 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 (DEFAULT_TABLE table=default.Table_3ab56e590dcf4109b0ba3832aaa72493 [id=0e42d0dd88e54443aa5f477bba945f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.624092 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546a0b9b92404b9db1e02cf3f77feda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.624214 9265 tablet_service.cc:1467] Processing CreateTablet for tablet ac36659c149540349a9d8f5bd4845c02 (DEFAULT_TABLE table=default.Table_141501ce8d6e48f3a7c7fa5542dfe488 [id=114d49f17d5a44f8a75b534ca547167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.624555 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac36659c149540349a9d8f5bd4845c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.624886 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fcc42af91c247b1b80059e95e3659cf" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.625789 9220 leader_election.cc:341] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.625936 9220 leader_election.cc:302] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.626328 11498 raft_consensus.cc:2726] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.609148 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 26b2de0a4b814e8ca7437bb90a183b42 (DEFAULT_TABLE table=default.Table_61cbc1c34ee849ca9d0e63c4919bfcfc [id=6fef3ca72c914df58d038d234b18237a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.629866 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b2de0a4b814e8ca7437bb90a183b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.630074 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b9eadbe04d484ebfa57cd9d5f9e1cd5b (table default.Table_2e1b9160eba94bbf9e2bc2bae293d177 [id=e86c3a2c8e854a01b2a335b1f05dc4cf]) successfully deleted
W20260928 14:50:47.630666 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 48f1d934435241529be3b4300ef4aa58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48f1d934435241529be3b4300ef4aa58 already in progress: creating tablet
W20260928 14:50:47.631172 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 293ba34b7a6c49e790861431646bb405 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ba34b7a6c49e790861431646bb405 already in progress: creating tablet
W20260928 14:50:47.631665 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet ba43a88f7aa94597ab76a47869e463cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba43a88f7aa94597ab76a47869e463cd already in progress: creating tablet
W20260928 14:50:47.632143 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet b17faf5198e048b2824aea3308070fa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17faf5198e048b2824aea3308070fa8 already in progress: creating tablet
W20260928 14:50:47.632649 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 8a9430a9410f41cc9c3858755a710a99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9430a9410f41cc9c3858755a710a99 already in progress: creating tablet
I20260928 14:50:47.632896 9815 tablet_replica.cc:330] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.633082 9815 raft_consensus.cc:2229] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.633234 9815 raft_consensus.cc:2258] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.633734 9815 ts_tablet_manager.cc:1905] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.610038 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:47.612825 9855 tablet_bootstrap.cc:492] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.622478 9533 tablet_service.cc:1467] Processing CreateTablet for tablet ac36659c149540349a9d8f5bd4845c02 (DEFAULT_TABLE table=default.Table_141501ce8d6e48f3a7c7fa5542dfe488 [id=114d49f17d5a44f8a75b534ca547167f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.634040 9569 raft_consensus.cc:2454] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:47.634204 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac36659c149540349a9d8f5bd4845c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.634928 9219 leader_election.cc:302] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.636854 11228 raft_consensus.cc:2781] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:47.636936 11228 raft_consensus.cc:482] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:47.636998 11228 raft_consensus.cc:3037] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.637979 9855 ts_tablet_manager.cc:1397] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.001s
I20260928 14:50:47.638115 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 (DEFAULT_TABLE table=default.Table_3ab56e590dcf4109b0ba3832aaa72493 [id=0e42d0dd88e54443aa5f477bba945f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.638598 9855 raft_consensus.cc:348] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.638789 9855 raft_consensus.cc:374] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.638836 9855 raft_consensus.cc:729] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.638998 9855 consensus_queue.cc:260] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.639320 11228 raft_consensus.cc:504] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.639484 9855 ts_tablet_manager.cc:1428] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:47.639866 11228 leader_election.cc:288] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.641561 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:47.641732 9569 raft_consensus.cc:3037] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.642827 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546a0b9b92404b9db1e02cf3f77feda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.644047 9569 raft_consensus.cc:2454] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:47.644770 9219 leader_election.cc:302] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:47.645390 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6b94b5aa24ff8a7fce8ba397e51e8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:47.646206 9220 leader_election.cc:341] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.646327 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 (DEFAULT_TABLE table=default.Table_3ab56e590dcf4109b0ba3832aaa72493 [id=0e42d0dd88e54443aa5f477bba945f7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.646534 11228 raft_consensus.cc:2781] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:47.646664 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546a0b9b92404b9db1e02cf3f77feda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.646829 11228 raft_consensus.cc:686] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:47.647248 11228 consensus_queue.cc:237] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.651069 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d4ff58de6c794b5ba7b44201800592d2
I20260928 14:50:47.653143 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
I20260928 14:50:47.655439 9855 tablet_bootstrap.cc:492] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.656136 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_bdb5e6bdf6c2409083a9005843fd5038"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.656726 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdb5e6bdf6c2409083a9005843fd5038 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.658649 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2e9567134a664658bb9e2dc94673889d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.659159 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e9567134a664658bb9e2dc94673889d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.659632 9855 tablet_bootstrap.cc:654] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.662056 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ff58de6c794b5ba7b44201800592d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.662273 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ff58de6c794b5ba7b44201800592d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.663082 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet d4ff58de6c794b5ba7b44201800592d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.664233 9851 tablet_bootstrap.cc:492] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.664371 9851 ts_tablet_manager.cc:1397] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.185s user 0.023s sys 0.007s
I20260928 14:50:47.665056 9851 raft_consensus.cc:348] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.665290 9851 raft_consensus.cc:374] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.672254 9851 raft_consensus.cc:729] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.672609 9851 consensus_queue.cc:260] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:47.673029 8942 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cb9e66f2b273470e88e97ece175d6065 (table default.Table_10a3944740d347fc8cb11224ea69cada [id=8ecccc88844646c0aa8774b07beb8b21], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cb9e66f2b273470e88e97ece175d6065 consensus state has no leader
I20260928 14:50:47.673722 9851 ts_tablet_manager.cc:1428] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260928 14:50:47.674487 9851 tablet_bootstrap.cc:492] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.678036 9851 tablet_bootstrap.cc:654] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.680676 9393 tablet_service.cc:1467] Processing CreateTablet for tablet a77103dc1919450eaaf7a915a97623e1 (DEFAULT_TABLE table=default.Table_cb59a8d6db944b7c8f4194a31233e854 [id=ff12522ce64e42459c56f0d23c880526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.682381 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77103dc1919450eaaf7a915a97623e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.684706 9250 tablet_service.cc:1467] Processing CreateTablet for tablet a77103dc1919450eaaf7a915a97623e1 (DEFAULT_TABLE table=default.Table_cb59a8d6db944b7c8f4194a31233e854 [id=ff12522ce64e42459c56f0d23c880526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.685643 9855 tablet_bootstrap.cc:492] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.686162 9855 ts_tablet_manager.cc:1397] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260928 14:50:47.686518 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77103dc1919450eaaf7a915a97623e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.688252 9855 raft_consensus.cc:348] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.689008 9855 raft_consensus.cc:374] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.689162 9851 tablet_bootstrap.cc:492] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.689316 9851 ts_tablet_manager.cc:1397] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260928 14:50:47.689221 9855 raft_consensus.cc:729] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.690069 9851 raft_consensus.cc:348] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.690299 9851 raft_consensus.cc:374] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.690380 9851 raft_consensus.cc:729] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.690652 9851 consensus_queue.cc:260] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.693413 9542 tablet_service.cc:1467] Processing CreateTablet for tablet a77103dc1919450eaaf7a915a97623e1 (DEFAULT_TABLE table=default.Table_cb59a8d6db944b7c8f4194a31233e854 [id=ff12522ce64e42459c56f0d23c880526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.693414 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e247758b36e14c57ad81f6a458c3ecf6 (DEFAULT_TABLE table=default.Table_8332be7dfda0408285675aa527034cf1 [id=61eaf1738c0b456aad7975d8af2dee15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.693770 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77103dc1919450eaaf7a915a97623e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.693783 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e247758b36e14c57ad81f6a458c3ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.689857 9855 consensus_queue.cc:260] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.695465 9855 ts_tablet_manager.cc:1428] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260928 14:50:47.696535 9855 tablet_bootstrap.cc:492] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.697958 9530 tablet_service.cc:1467] Processing CreateTablet for tablet e247758b36e14c57ad81f6a458c3ecf6 (DEFAULT_TABLE table=default.Table_8332be7dfda0408285675aa527034cf1 [id=61eaf1738c0b456aad7975d8af2dee15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.698272 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e247758b36e14c57ad81f6a458c3ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.699118 9851 ts_tablet_manager.cc:1428] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.010s user 0.000s sys 0.001s
I20260928 14:50:47.699079 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 454b3755607f4ad8be5e7afb1282292d (DEFAULT_TABLE table=default.Table_8ae5d3340f5844c1b3814fe86c95615f [id=11559cf5667944e7bcb72700011b9567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.699347 9851 tablet_bootstrap.cc:492] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.699476 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454b3755607f4ad8be5e7afb1282292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.700325 9855 tablet_bootstrap.cc:654] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.701511 9851 tablet_bootstrap.cc:654] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.702229 9848 tablet_bootstrap.cc:492] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.702383 9848 ts_tablet_manager.cc:1397] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.118s user 0.007s sys 0.040s
I20260928 14:50:47.703022 9848 raft_consensus.cc:348] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.703253 9848 raft_consensus.cc:374] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.703334 9848 raft_consensus.cc:729] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.703531 9848 consensus_queue.cc:260] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.704025 9848 ts_tablet_manager.cc:1428] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.705778 11498 raft_consensus.cc:482] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.705930 11498 raft_consensus.cc:504] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.706163 9848 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:47.707041 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
W20260928 14:50:47.707167 9219 leader_election.cc:341] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 4a14c0b50cad4954b5dc5666689810ba
I20260928 14:50:47.707461 11498 leader_election.cc:288] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.707554 9848 tablet_bootstrap.cc:654] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.708035 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a14c0b50cad4954b5dc5666689810ba" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.708441 11498 raft_consensus.cc:482] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.708557 11498 raft_consensus.cc:504] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.709800 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:47.709990 9567 raft_consensus.cc:2454] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:47.710326 9219 leader_election.cc:302] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:47.710547 11371 raft_consensus.cc:2781] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:47.710610 11371 raft_consensus.cc:482] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:47.710682 11371 raft_consensus.cc:3037] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.712903 9813 ts_tablet_manager.cc:1918] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.712999 9813 log.cc:1196] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/aaacc1f839914859b23ae755042e02d8
I20260928 14:50:47.713027 11371 raft_consensus.cc:504] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:47.713104 9220 leader_election.cc:341] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.713195 9220 leader_election.cc:302] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.713264 9813 ts_tablet_manager.cc:1939] T aaacc1f839914859b23ae755042e02d8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.713608 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.713990 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:47.714056 9813 tablet_replica.cc:330] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.714144 9567 raft_consensus.cc:3037] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.714254 9813 raft_consensus.cc:2229] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.714382 9813 raft_consensus.cc:2258] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.714334 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet aaacc1f839914859b23ae755042e02d8 (table default.Table_e4fdf91d5a91446caa0fb71fa8fbab00 [id=78d9f55012de4efeadd563fe4e70bf69]) successfully deleted
I20260928 14:50:47.714788 11223 raft_consensus.cc:2726] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.714756 9250 tablet_service.cc:1467] Processing CreateTablet for tablet e247758b36e14c57ad81f6a458c3ecf6 (DEFAULT_TABLE table=default.Table_8332be7dfda0408285675aa527034cf1 [id=61eaf1738c0b456aad7975d8af2dee15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.715085 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e247758b36e14c57ad81f6a458c3ecf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.715294 9813 ts_tablet_manager.cc:1905] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.715370 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:47.715701 9220 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.716336 9567 raft_consensus.cc:2454] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
W20260928 14:50:47.716384 9220 leader_election.cc:341] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.716697 9219 leader_election.cc:302] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.716915 11223 raft_consensus.cc:2781] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:47.713491 11371 leader_election.cc:288] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.718734 9814 ts_tablet_manager.cc:1918] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.718835 9814 log.cc:1196] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/1c54cb0e8f2347d9b139c8766fb61ab1
I20260928 14:50:47.718842 11498 leader_election.cc:288] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.719105 9814 ts_tablet_manager.cc:1939] T 1c54cb0e8f2347d9b139c8766fb61ab1 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.719384 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1269) took 1508 ms. Trace:
I20260928 14:50:47.719465 9814 rpcz_store.cc:276] 0928 14:50:46.211215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.211272 (+ 57us) service_pool.cc:227] Handling call
0928 14:50:47.613627 (+1402355us) ts_tablet_manager.cc:1145] Deleting tablet 1c54cb0e8f2347d9b139c8766fb61ab1
0928 14:50:47.613639 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.682153 (+ 68514us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.718650 (+ 36497us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.719368 (+ 718us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1402143}
I20260928 14:50:47.719764 9814 tablet_replica.cc:330] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.719947 9814 raft_consensus.cc:2229] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.720074 9814 raft_consensus.cc:2258] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.720569 9814 ts_tablet_manager.cc:1905] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.721093 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 1c54cb0e8f2347d9b139c8766fb61ab1 (table default.Table_455b19903e324720a3d1e2d9f4dc9718 [id=cc5e7eb9c7124567aeab82ebc8bf5050]) successfully deleted
I20260928 14:50:47.723939 9855 tablet_bootstrap.cc:492] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.724144 9855 ts_tablet_manager.cc:1397] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
I20260928 14:50:47.725035 9855 raft_consensus.cc:348] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.725374 9855 raft_consensus.cc:374] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.725487 9855 raft_consensus.cc:729] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.725692 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 454b3755607f4ad8be5e7afb1282292d (DEFAULT_TABLE table=default.Table_8ae5d3340f5844c1b3814fe86c95615f [id=11559cf5667944e7bcb72700011b9567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.726022 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454b3755607f4ad8be5e7afb1282292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.725821 9855 consensus_queue.cc:260] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.726740 9855 ts_tablet_manager.cc:1428] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:47.727123 9855 tablet_bootstrap.cc:492] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.729898 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e0c64096ca3c490a909131c92e0846a0
I20260928 14:50:47.732112 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 72cab768a1194a9c9ef3e3ab15d0f449 (table default.Table_6216d1a7c83244c0bd051eabe9b615c3 [id=c9890f73b6de4b249308da6ee13f2db1]). Expected version 1 got 0
W20260928 14:50:47.733793 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d5905e89144477eb0e9ca76665b6572 consensus state has no leader
I20260928 14:50:47.733880 11223 raft_consensus.cc:686] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:47.734089 11223 consensus_queue.cc:237] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.734138 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_44b3f5bdc0754ca6abbae36af06bcfca" } new_table_name: "default.Table_7b6410ea439e4abcb7ce95a28b279129" modify_external_catalogs: true
I20260928 14:50:47.734927 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet b8237f7d97304a98889bde6817358eda
I20260928 14:50:47.735411 9815 ts_tablet_manager.cc:1918] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.735502 9815 log.cc:1196] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b6fed86d9eda45cab2083fca73825383
I20260928 14:50:47.735764 9815 ts_tablet_manager.cc:1939] T b6fed86d9eda45cab2083fca73825383 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.737776 9851 tablet_bootstrap.cc:492] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.737883 9851 ts_tablet_manager.cc:1397] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20260928 14:50:47.738727 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b6fed86d9eda45cab2083fca73825383 (table default.Table_ec53a95de3d2420e8fb0c19d712a61aa [id=008ad045c52b4c9693af55fd79f5f22f]) successfully deleted
I20260928 14:50:47.738950 9855 tablet_bootstrap.cc:654] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.739785 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf7193095e54214a5b9241728239c8c with delete_type TABLET_DATA_DELETED (replaced by tablet 6cfe81624ecb41889dd2eeeaa5d0e771) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.740454 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c64096ca3c490a909131c92e0846a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.741621 11519 raft_consensus.cc:482] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.741823 11519 raft_consensus.cc:504] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.742429 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c64096ca3c490a909131c92e0846a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.742581 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet b8237f7d97304a98889bde6817358eda with delete_type TABLET_DATA_DELETED (replaced by tablet 5169a160d9344439b4feafa2956d6e4e) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.743103 8952 catalog_manager.cc:6565] ReplaceTablet: tablet b8237f7d97304a98889bde6817358eda deleted and replaced by tablet 5169a160d9344439b4feafa2956d6e4e
I20260928 14:50:47.743279 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06859c8dcc41d99d29365aae350afa" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.744257 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet b8237f7d97304a98889bde6817358eda with delete_type TABLET_DATA_DELETED (replaced by tablet 5169a160d9344439b4feafa2956d6e4e) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:47.744357 9220 leader_election.cc:341] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.745095 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
W20260928 14:50:47.745237 9219 leader_election.cc:341] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8a06859c8dcc41d99d29365aae350afa
I20260928 14:50:47.745338 9219 leader_election.cc:302] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.745398 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 71a94a7a6c81453c8e47149be3d6479e (table default.Table_c517262f67d747928c9dbb4b470f167c [id=01f39971be5e45b79aec08b7bbfdb1d7]). Expected version 2 got 0
I20260928 14:50:47.745872 11371 raft_consensus.cc:2726] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.747053 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_69dc3a6a9ade4bc3b50d2dc2dbb46e56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.747399 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet b8237f7d97304a98889bde6817358eda with delete_type TABLET_DATA_DELETED (replaced by tablet 5169a160d9344439b4feafa2956d6e4e) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.747536 11519 leader_election.cc:288] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:47.747949 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69dc3a6a9ade4bc3b50d2dc2dbb46e56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.749866 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_75304f55867447f7ada1e41743a14d80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.750386 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75304f55867447f7ada1e41743a14d80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.751434 9542 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c64096ca3c490a909131c92e0846a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.751678 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a6755b697134b8e90e457b554b9599c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.751873 9851 raft_consensus.cc:348] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.752053 9851 raft_consensus.cc:374] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.752795 9813 ts_tablet_manager.cc:1918] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.753611 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d69e4ad9554da9871800c8b392851c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:33 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.753460 9813 log.cc:1196] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/22d5fe7cbf4348e88fb6a6eaa70ba87b
I20260928 14:50:47.754233 9851 raft_consensus.cc:729] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.754794 9851 consensus_queue.cc:260] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.755496 9813 ts_tablet_manager.cc:1939] T 22d5fe7cbf4348e88fb6a6eaa70ba87b P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.756505 9851 ts_tablet_manager.cc:1428] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260928 14:50:47.756778 9851 tablet_bootstrap.cc:492] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.757423 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 22d5fe7cbf4348e88fb6a6eaa70ba87b (table default.Table_520e7cce9fb941bbb5019c3c73d1132f [id=fe9647ce21f24768ad3f7fdbaf19cf88]) successfully deleted
I20260928 14:50:47.758383 9813 tablet_replica.cc:330] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.759842 9813 raft_consensus.cc:2229] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.760668 9813 raft_consensus.cc:2258] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.764642 9815 tablet_replica.cc:330] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.764832 9815 raft_consensus.cc:2229] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.764964 9815 raft_consensus.cc:2258] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:47.764945 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet be0ef95fd8b54b2ab140a77a74c75c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be0ef95fd8b54b2ab140a77a74c75c5c already in progress: creating tablet
W20260928 14:50:47.765162 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet fb7f3aeffb2a4a9683b728e17aa28d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7f3aeffb2a4a9683b728e17aa28d9d already in progress: creating tablet
I20260928 14:50:47.764853 9813 ts_tablet_manager.cc:1905] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.765422 9815 ts_tablet_manager.cc:1905] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.767112 9851 tablet_bootstrap.cc:654] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.772708 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 454b3755607f4ad8be5e7afb1282292d (DEFAULT_TABLE table=default.Table_8ae5d3340f5844c1b3814fe86c95615f [id=11559cf5667944e7bcb72700011b9567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.773226 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454b3755607f4ad8be5e7afb1282292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.778229 9855 tablet_bootstrap.cc:492] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.778247 9851 tablet_bootstrap.cc:492] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.778349 9855 ts_tablet_manager.cc:1397] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.001s
I20260928 14:50:47.778364 9851 ts_tablet_manager.cc:1397] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260928 14:50:47.778960 9855 raft_consensus.cc:348] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.779017 9851 raft_consensus.cc:348] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.779160 9855 raft_consensus.cc:374] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.779209 9855 raft_consensus.cc:729] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.779217 9851 raft_consensus.cc:374] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.779271 9851 raft_consensus.cc:729] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.779386 9855 consensus_queue.cc:260] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.779455 9851 consensus_queue.cc:260] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.779886 9855 ts_tablet_manager.cc:1428] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:47.780982 9855 tablet_bootstrap.cc:492] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.782760 9855 tablet_bootstrap.cc:654] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.788475 9814 ts_tablet_manager.cc:1918] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.794687 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e2aae21b7ed2417dafd4cca54c53de33 (DEFAULT_TABLE table=default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917 [id=c4691c923d1f4496a69acd0eb6a319af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.794811 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 9efff5e27be64ba7bd8cae2033b2bf95 (DEFAULT_TABLE table=default.Table_1a96ff77ef4349bcbda19788d63b44c7 [id=1a0ef5fb72bb4324a98856ce0e84835b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.795056 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2aae21b7ed2417dafd4cca54c53de33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.795226 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efff5e27be64ba7bd8cae2033b2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.801222 9542 tablet_service.cc:1467] Processing CreateTablet for tablet e2aae21b7ed2417dafd4cca54c53de33 (DEFAULT_TABLE table=default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917 [id=c4691c923d1f4496a69acd0eb6a319af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.806085 9389 tablet_service.cc:1467] Processing CreateTablet for tablet c544dea48c6f440690ed603809e58355 (DEFAULT_TABLE table=default.Table_89c1bc2e746043ccaa50688a9cf8d737 [id=c6ee5255e5ef47c8bd9af53654f5b150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.806994 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2aae21b7ed2417dafd4cca54c53de33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.808743 9530 tablet_service.cc:1467] Processing CreateTablet for tablet c544dea48c6f440690ed603809e58355 (DEFAULT_TABLE table=default.Table_89c1bc2e746043ccaa50688a9cf8d737 [id=c6ee5255e5ef47c8bd9af53654f5b150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.809274 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c544dea48c6f440690ed603809e58355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.815546 9388 tablet_service.cc:1467] Processing CreateTablet for tablet ba3c51e7f3874390b9e91cd4eb024e6e (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.816063 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3c51e7f3874390b9e91cd4eb024e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.816116 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 398c9a44b8e24aec961e58038e403cc7 (DEFAULT_TABLE table=default.Table_f4d3dbaeb1f84920827d26b8973ddc73 [id=4b7b40901d914065be3319dc3f7fe39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.816450 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 398c9a44b8e24aec961e58038e403cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.816835 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 9efff5e27be64ba7bd8cae2033b2bf95 (DEFAULT_TABLE table=default.Table_1a96ff77ef4349bcbda19788d63b44c7 [id=1a0ef5fb72bb4324a98856ce0e84835b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.817178 9537 tablet_service.cc:1467] Processing CreateTablet for tablet ba3c51e7f3874390b9e91cd4eb024e6e (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.817451 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 8094e2e695224b0abf86430f5cf43b94 (DEFAULT_TABLE table=default.Table_db62e38a29e844bebcaaaf65d71237a7 [id=82eb37d367e3442aacf3435fcbd7e0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.817478 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 8094e2e695224b0abf86430f5cf43b94 (DEFAULT_TABLE table=default.Table_db62e38a29e844bebcaaaf65d71237a7 [id=82eb37d367e3442aacf3435fcbd7e0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.817771 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8094e2e695224b0abf86430f5cf43b94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:47.825654 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75e82d8412c94d088a4df05739bb3565 consensus state has no leader
I20260928 14:50:47.826283 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f8b1156c1b4b437c98c07070452ee260
I20260928 14:50:47.827108 9815 ts_tablet_manager.cc:1918] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.827231 9815 log.cc:1196] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/504c0f61d8844bd18062a3b40cd6f8ce
I20260928 14:50:47.827641 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b1156c1b4b437c98c07070452ee260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.827837 9814 log.cc:1196] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/af22f23ff3864620bfefb31b9e899036
I20260928 14:50:47.791071 9851 ts_tablet_manager.cc:1428] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 14:50:47.792953 9258 tablet_service.cc:1467] Processing CreateTablet for tablet c544dea48c6f440690ed603809e58355 (DEFAULT_TABLE table=default.Table_89c1bc2e746043ccaa50688a9cf8d737 [id=c6ee5255e5ef47c8bd9af53654f5b150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.828258 9814 ts_tablet_manager.cc:1939] T af22f23ff3864620bfefb31b9e899036 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.828332 9851 tablet_bootstrap.cc:492] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.794502 9250 tablet_service.cc:1467] Processing CreateTablet for tablet e2aae21b7ed2417dafd4cca54c53de33 (DEFAULT_TABLE table=default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917 [id=c4691c923d1f4496a69acd0eb6a319af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.801036 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:47.828984 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1270) took 1617 ms. Trace:
I20260928 14:50:47.829064 9814 rpcz_store.cc:276] 0928 14:50:46.211505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.211547 (+ 42us) service_pool.cc:227] Handling call
0928 14:50:47.719724 (+1508177us) ts_tablet_manager.cc:1145] Deleting tablet af22f23ff3864620bfefb31b9e899036
0928 14:50:47.719736 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.785508 (+ 65772us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.788401 (+ 2893us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.828963 (+ 40562us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507989}
I20260928 14:50:47.829424 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet af22f23ff3864620bfefb31b9e899036 (table default.Table_21a4bfb6f8964ad5937b0106fa65cc82 [id=811f5b04b17349319d6f50e6d01edafd]) successfully deleted
I20260928 14:50:47.829483 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 1195380515774c9f9e004d10db9d6907
I20260928 14:50:47.829758 9814 tablet_replica.cc:330] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.815137 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 9efff5e27be64ba7bd8cae2033b2bf95 (DEFAULT_TABLE table=default.Table_1a96ff77ef4349bcbda19788d63b44c7 [id=1a0ef5fb72bb4324a98856ce0e84835b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.815485 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ba3c51e7f3874390b9e91cd4eb024e6e (DEFAULT_TABLE table=default.Table_04368bfd9f374ed4b7935788ee68abe7 [id=6cbca9862a2f4bb582ffa397d9d0ad88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.829941 9814 raft_consensus.cc:2229] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.830092 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c544dea48c6f440690ed603809e58355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.816116 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 8094e2e695224b0abf86430f5cf43b94 (DEFAULT_TABLE table=default.Table_db62e38a29e844bebcaaaf65d71237a7 [id=82eb37d367e3442aacf3435fcbd7e0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.830299 9815 ts_tablet_manager.cc:1939] T 504c0f61d8844bd18062a3b40cd6f8ce P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.830365 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 1195380515774c9f9e004d10db9d6907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.830423 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8094e2e695224b0abf86430f5cf43b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.830583 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efff5e27be64ba7bd8cae2033b2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.827576 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b1156c1b4b437c98c07070452ee260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.830102 9814 raft_consensus.cc:2258] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.830821 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3c51e7f3874390b9e91cd4eb024e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.831059 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 1195380515774c9f9e004d10db9d6907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.831254 9814 ts_tablet_manager.cc:1905] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.833225 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b1156c1b4b437c98c07070452ee260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.835253 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 1195380515774c9f9e004d10db9d6907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.841214 11228 raft_consensus.cc:482] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.841357 11228 raft_consensus.cc:504] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.841961 11228 leader_election.cc:288] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.842087 9848 tablet_bootstrap.cc:492] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.842217 9848 ts_tablet_manager.cc:1397] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.136s user 0.004s sys 0.008s
W20260928 14:50:47.842793 9219 leader_election.cc:341] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 8af72ac7bedb4cd7aed28cffda867c96
I20260928 14:50:47.843397 9848 raft_consensus.cc:348] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.843631 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2aae21b7ed2417dafd4cca54c53de33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.843618 9848 raft_consensus.cc:374] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.843679 9848 raft_consensus.cc:729] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.843714 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af72ac7bedb4cd7aed28cffda867c96" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.843875 9848 consensus_queue.cc:260] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.847045 11454 raft_consensus.cc:482] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.847177 11454 raft_consensus.cc:504] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:47.847709 11454 leader_election.cc:288] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:47.848481 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d69e4ad9554da9871800c8b392851c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:47.849005 9497 leader_election.cc:341] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.849253 11519 raft_consensus.cc:482] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.849359 11519 raft_consensus.cc:504] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.849859 11519 leader_election.cc:288] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.851048 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d69e4ad9554da9871800c8b392851c" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.851697 9498 leader_election.cc:341] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.851804 9498 leader_election.cc:302] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:47.852468 9219 leader_election.cc:341] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e2c5877a52264f0e9ebb070792e39e55
I20260928 14:50:47.852964 9848 ts_tablet_manager.cc:1428] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.011s user 0.002s sys 0.003s
I20260928 14:50:47.852981 11454 raft_consensus.cc:2726] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.853304 9848 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:47.853823 9220 leader_election.cc:341] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.853926 9220 leader_election.cc:302] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.854282 11371 raft_consensus.cc:2726] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.855517 9848 tablet_bootstrap.cc:654] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.855814 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c5877a52264f0e9ebb070792e39e55" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.857300 9851 tablet_bootstrap.cc:654] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.857578 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_d2bb4944eca84689ba20b5d635022eac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.858383 8946 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7fff583d70804daab622a201e1425a06" } new_table_name: "default.Table_af046ffa6eae433393a3031778aca57d" modify_external_catalogs: true
W20260928 14:50:47.859004 9220 leader_election.cc:341] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.859093 9220 leader_election.cc:302] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.859521 11371 raft_consensus.cc:2726] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.860028 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d8e4357c3d5487fa76e1e49c6cb7547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:43 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:47.860221 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2bb4944eca84689ba20b5d635022eac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.860312 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:47.860898 8954 master_service.cc:946] ReplaceTablet: received request to replace tablet 989df9ccfce446008435161626ce4f5e from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:47.861392 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a360c09e2f3e4964a42372b6be5d8d22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.861868 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a360c09e2f3e4964a42372b6be5d8d22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.862275 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c544dea48c6f440690ed603809e58355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.862990 11526 raft_consensus.cc:482] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.863092 11526 raft_consensus.cc:504] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.863570 11526 leader_election.cc:288] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.864987 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:47.865849 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efff5e27be64ba7bd8cae2033b2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.868767 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba3c51e7f3874390b9e91cd4eb024e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.868901 9813 ts_tablet_manager.cc:1918] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.868994 9813 log.cc:1196] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9cb3cc5b42524a4399d0bcf21c851fd8
I20260928 14:50:47.869127 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a3c4cca0f2d148ccaa69cdfe09591cb5
I20260928 14:50:47.869278 9813 ts_tablet_manager.cc:1939] T 9cb3cc5b42524a4399d0bcf21c851fd8 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.870169 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.870445 9813 tablet_replica.cc:330] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.871620 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8094e2e695224b0abf86430f5cf43b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.872125 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 504c0f61d8844bd18062a3b40cd6f8ce (table default.Table_92d3b119492d4f65aa2b228040ac958f [id=f9c8e9781b03480f8a6500e36500ddfb]) successfully deleted
I20260928 14:50:47.872390 9815 tablet_replica.cc:330] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.872558 9815 raft_consensus.cc:2229] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.872692 9815 raft_consensus.cc:2258] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.873129 9815 ts_tablet_manager.cc:1905] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.875174 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4eeb2aa92a24b628156d34129f1381c" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:47.875379 9567 raft_consensus.cc:2379] T f4eeb2aa92a24b628156d34129f1381c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae832871bd1142f7af10c084115ffc12 in current term 1: Already voted for candidate 9b4626c584ad47ffaf346e81daff846b in this term.
I20260928 14:50:47.876252 9360 leader_election.cc:302] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.877115 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9cb3cc5b42524a4399d0bcf21c851fd8 (table default.Table_27c8c6bf92104baba58d5f721c298c16 [id=44b6b5a0e8a4438c97dd07f6c86ffef6]) successfully deleted
I20260928 14:50:47.877583 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:47.879156 11526 raft_consensus.cc:3037] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.882639 11469 raft_consensus.cc:482] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.882755 11469 raft_consensus.cc:504] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.883240 11469 leader_election.cc:288] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.883670 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 398c9a44b8e24aec961e58038e403cc7 (DEFAULT_TABLE table=default.Table_f4d3dbaeb1f84920827d26b8973ddc73 [id=4b7b40901d914065be3319dc3f7fe39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.884070 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 398c9a44b8e24aec961e58038e403cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.884116 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 398c9a44b8e24aec961e58038e403cc7 (DEFAULT_TABLE table=default.Table_f4d3dbaeb1f84920827d26b8973ddc73 [id=4b7b40901d914065be3319dc3f7fe39f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:47.884344 9360 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: edf76b53ded84392a39c73d7e653615d
I20260928 14:50:47.884402 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 398c9a44b8e24aec961e58038e403cc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:47.884652 9360 leader_election.cc:341] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: edf76b53ded84392a39c73d7e653615d
I20260928 14:50:47.884739 9360 leader_election.cc:302] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:47.885018 11469 raft_consensus.cc:2726] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.886991 9815 ts_tablet_manager.cc:1918] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.887077 9815 log.cc:1196] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/39091da7a6fb4aceadd3434bd304c268
I20260928 14:50:47.887319 9815 ts_tablet_manager.cc:1939] T 39091da7a6fb4aceadd3434bd304c268 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:47.883749 9814 ts_tablet_manager.cc:1918] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.887964 9814 log.cc:1196] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:47.888204 9814 ts_tablet_manager.cc:1939] T 52993ae8b63d4fbaa8cf38720af3dea5 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.888448 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1267) took 1677 ms. Trace:
I20260928 14:50:47.890663 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_3ea8db61274e41a08148c87cf11173ec" } new_table_name: "default.Table_1efdd8fd674e4bd28edec9a0fd916b45" modify_external_catalogs: true
I20260928 14:50:47.892132 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1cdf5a5e5de84da29ed57e51ac23b1a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.892642 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cdf5a5e5de84da29ed57e51ac23b1a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.895187 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 24a3cfc80f064f768b5166e92b6cfa20 (DEFAULT_TABLE table=default.Table_a76f0a26d27b41dcabf3037845dfe4ea [id=344dedf0c1054b24b2ffde1daae404ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.895506 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a3cfc80f064f768b5166e92b6cfa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.896179 9855 tablet_bootstrap.cc:492] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.896306 9855 ts_tablet_manager.cc:1397] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.013s
I20260928 14:50:47.896970 9855 raft_consensus.cc:348] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.897176 9855 raft_consensus.cc:374] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.897239 9855 raft_consensus.cc:729] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.897441 9855 consensus_queue.cc:260] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.897997 9855 ts_tablet_manager.cc:1428] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 14:50:47.898234 9813 raft_consensus.cc:2229] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.898386 9813 raft_consensus.cc:2258] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.899433 9813 ts_tablet_manager.cc:1905] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.901269 9855 tablet_bootstrap.cc:492] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.903384 9855 tablet_bootstrap.cc:654] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:47.904752 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet caddc46461d349c78a8f06df1f4d658c consensus state has no leader
I20260928 14:50:47.890161 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:47.905076 9814 rpcz_store.cc:276] 0928 14:50:46.210744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.211611 (+ 867us) service_pool.cc:227] Handling call
0928 14:50:47.829693 (+1618082us) ts_tablet_manager.cc:1145] Deleting tablet 52993ae8b63d4fbaa8cf38720af3dea5
0928 14:50:47.829704 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.843407 (+ 13703us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.883642 (+ 40235us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.888433 (+ 4791us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617912}
I20260928 14:50:47.905623 9814 tablet_replica.cc:330] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.905884 9814 raft_consensus.cc:2229] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.906160 9814 raft_consensus.cc:2258] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.906708 9814 ts_tablet_manager.cc:1905] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.907876 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 52993ae8b63d4fbaa8cf38720af3dea5 (table default.Table_2969f92d404942518e3feadd54948444 [id=d19993a468fd4f7d994003f4977a1c59]) successfully deleted
I20260928 14:50:47.899252 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 24a3cfc80f064f768b5166e92b6cfa20 (DEFAULT_TABLE table=default.Table_a76f0a26d27b41dcabf3037845dfe4ea [id=344dedf0c1054b24b2ffde1daae404ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.908341 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a3cfc80f064f768b5166e92b6cfa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.910408 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 24a3cfc80f064f768b5166e92b6cfa20 (DEFAULT_TABLE table=default.Table_a76f0a26d27b41dcabf3037845dfe4ea [id=344dedf0c1054b24b2ffde1daae404ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.910763 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a3cfc80f064f768b5166e92b6cfa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.914813 9406 tablet_service.cc:1467] Processing CreateTablet for tablet d6ab02bc1b0e494fad5b298888712e00 (DEFAULT_TABLE table=default.Table_a092daf652f54ff792d60a1edd7da165 [id=58f754b665794c88a64cbf1633409be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.915110 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ab02bc1b0e494fad5b298888712e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.919811 9815 tablet_replica.cc:330] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.919991 9815 raft_consensus.cc:2229] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.920113 9815 raft_consensus.cc:2258] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.920761 9815 ts_tablet_manager.cc:1905] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.930246 9855 tablet_bootstrap.cc:492] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:47.930410 9855 ts_tablet_manager.cc:1397] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260928 14:50:47.931066 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 39091da7a6fb4aceadd3434bd304c268 (table default.Table_41fcada969964258a48a44db603216b5 [id=f759fe3632ad445ebf1d7bcc1c5aed70]) successfully deleted
I20260928 14:50:47.931172 9855 raft_consensus.cc:348] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:47.931346 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa61fb67d494d8ab7dec29dbc5b61cc already in progress: creating tablet
I20260928 14:50:47.931406 9855 raft_consensus.cc:374] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.931528 9855 raft_consensus.cc:729] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
W20260928 14:50:47.931582 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d263b3af1ef402b95affbfcd2aa7ed0 already in progress: creating tablet
I20260928 14:50:47.931773 9855 consensus_queue.cc:260] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:47.931891 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 89431db9b37d4d13a25cb736f67129bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89431db9b37d4d13a25cb736f67129bd already in progress: creating tablet
I20260928 14:50:47.931905 9813 ts_tablet_manager.cc:1918] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:47.932046 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet d4ff58de6c794b5ba7b44201800592d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4ff58de6c794b5ba7b44201800592d2 already in progress: creating tablet
I20260928 14:50:47.932276 9813 log.cc:1196] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/148e81f8add349f2b233862a7049e54c
I20260928 14:50:47.932519 9855 ts_tablet_manager.cc:1428] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:47.932757 9855 tablet_bootstrap.cc:492] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:47.934501 9855 tablet_bootstrap.cc:654] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.935933 11228 raft_consensus.cc:482] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.936060 11228 raft_consensus.cc:504] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.936618 11228 leader_election.cc:288] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:47.937831 9219 leader_election.cc:341] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c51f5944c6534e9492594c39ae9796b2
I20260928 14:50:47.938191 8956 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:47.938906 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e594e1604db944939af18d3c73be5ff1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:47.939851 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e594e1604db944939af18d3c73be5ff1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:47.942808 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_272ae048ec1e43cd95fdc4772c5a38a3" } modify_external_catalogs: true
I20260928 14:50:47.942970 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_272ae048ec1e43cd95fdc4772c5a38a3" } modify_external_catalogs: true
I20260928 14:50:47.933123 9813 ts_tablet_manager.cc:1939] T 148e81f8add349f2b233862a7049e54c P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:47.937408 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c51f5944c6534e9492594c39ae9796b2" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:47.948167 9813 tablet_replica.cc:330] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:47.948271 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 148e81f8add349f2b233862a7049e54c (table default.Table_3ae346f4e35f4daf82d04747a821694f [id=bb4f3bdec2de40b79c53830b61634e61]) successfully deleted
I20260928 14:50:47.948429 9813 raft_consensus.cc:2229] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.948632 9813 raft_consensus.cc:2258] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.949222 9851 tablet_bootstrap.cc:492] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:47.949340 9851 ts_tablet_manager.cc:1397] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.007s
I20260928 14:50:47.950073 9851 raft_consensus.cc:348] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.950258 9851 raft_consensus.cc:374] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:47.950301 9851 raft_consensus.cc:729] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:47.950459 9851 consensus_queue.cc:260] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.950934 9851 ts_tablet_manager.cc:1428] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:47.951174 9851 tablet_bootstrap.cc:492] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:47.951573 9814 ts_tablet_manager.cc:1918] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.951669 9814 log.cc:1196] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/76ad7685ece44665896f687697bddccf
I20260928 14:50:47.951936 9814 ts_tablet_manager.cc:1939] T 76ad7685ece44665896f687697bddccf P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:47.952214 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1268) took 1741 ms. Trace:
I20260928 14:50:47.952291 9814 rpcz_store.cc:276] 0928 14:50:46.210969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.211809 (+ 840us) service_pool.cc:227] Handling call
0928 14:50:47.905578 (+1693769us) ts_tablet_manager.cc:1145] Deleting tablet 76ad7685ece44665896f687697bddccf
0928 14:50:47.905588 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:47.946305 (+ 40717us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.951492 (+ 5187us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:47.952197 (+ 705us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1693639}
I20260928 14:50:47.952330 9815 ts_tablet_manager.cc:1918] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:47.952919 9813 ts_tablet_manager.cc:1905] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.952889 9815 log.cc:1196] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/fbf7193095e54214a5b9241728239c8c
I20260928 14:50:47.953066 9265 tablet_service.cc:1467] Processing CreateTablet for tablet d6ab02bc1b0e494fad5b298888712e00 (DEFAULT_TABLE table=default.Table_a092daf652f54ff792d60a1edd7da165 [id=58f754b665794c88a64cbf1633409be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.953402 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ab02bc1b0e494fad5b298888712e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.953987 9851 tablet_bootstrap.cc:654] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:47.954680 9815 ts_tablet_manager.cc:1939] T fbf7193095e54214a5b9241728239c8c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:47.953410 9220 leader_election.cc:341] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.957656 9220 leader_election.cc:302] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:47.958038 11228 raft_consensus.cc:2726] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.958585 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet fbf7193095e54214a5b9241728239c8c (table default.Table_e30db7589ca148c489d5e75da88d4412 [id=91303dda9c3d417583a2051ea8a2d100]) successfully deleted
I20260928 14:50:47.962801 9542 tablet_service.cc:1467] Processing CreateTablet for tablet d6ab02bc1b0e494fad5b298888712e00 (DEFAULT_TABLE table=default.Table_a092daf652f54ff792d60a1edd7da165 [id=58f754b665794c88a64cbf1633409be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.972990 11526 raft_consensus.cc:2726] T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:47.974010 9395 tablet_service.cc:1467] Processing CreateTablet for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135 (DEFAULT_TABLE table=default.Table_7aee7ac87b2648b19dee4865905706d9 [id=9ed3ada48a674bb58dfd2517405f6fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.976842 11228 raft_consensus.cc:482] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:47.976958 11228 raft_consensus.cc:504] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:47.977459 11228 leader_election.cc:288] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:47.978240 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.978667 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:47.978842 9569 raft_consensus.cc:2454] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:47.979441 9219 leader_election.cc:302] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:47.979799 11371 raft_consensus.cc:2781] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:47.979862 11371 raft_consensus.cc:482] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:47.979912 11371 raft_consensus.cc:3037] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:47.981863 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:47.982389 9220 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:47.985846 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 76ad7685ece44665896f687697bddccf (table default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]) successfully deleted
I20260928 14:50:47.986722 9406 tablet_service.cc:1467] Processing CreateTablet for tablet c552bd6581434c59acb61fd1c708bf18 (DEFAULT_TABLE table=default.Table_f02d0e8cb13d4d7b9340bf625a4fa4c5 [id=cdd8cf33b39b4c9cbf6f04ce9c46053c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.987196 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c552bd6581434c59acb61fd1c708bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.987315 9848 tablet_bootstrap.cc:492] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:47.987262 9530 tablet_service.cc:1467] Processing CreateTablet for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135 (DEFAULT_TABLE table=default.Table_7aee7ac87b2648b19dee4865905706d9 [id=9ed3ada48a674bb58dfd2517405f6fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.987425 9848 ts_tablet_manager.cc:1397] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.134s user 0.003s sys 0.000s
I20260928 14:50:47.989022 8955 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet b6e4ce1f9eed42abb3688716dc6733cf (table default.Table_d441068e52104bbfb805f4c1ae8e1cf8 [id=9cfcf70c9f6e4c8eb485c2f1ecd5a3d5]). Expected version 2 got 0
I20260928 14:50:47.990607 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 299ed0acd7cf46d3b78f4f4cea31858f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:47.991853 9814 tablet_replica.cc:330] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:47.992043 9814 raft_consensus.cc:2229] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:47.992197 9814 raft_consensus.cc:2258] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:47.992668 9814 ts_tablet_manager.cc:1905] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:47.993327 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ab02bc1b0e494fad5b298888712e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.992918 8955 catalog_manager.cc:5495] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:47.993678 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:47.994714 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e3236b0fb0944dc0a1f0893eb8d8e3b4 (table default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713]). Expected version 1 got 0
I20260928 14:50:47.994750 9535 tablet_service.cc:1467] Processing CreateTablet for tablet c552bd6581434c59acb61fd1c708bf18 (DEFAULT_TABLE table=default.Table_f02d0e8cb13d4d7b9340bf625a4fa4c5 [id=cdd8cf33b39b4c9cbf6f04ce9c46053c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.995186 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c552bd6581434c59acb61fd1c708bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:47.995101 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bef0b52d178f4baeae621da769f6d518 (table default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d]). Expected version 1 got 0
I20260928 14:50:47.995817 8955 catalog_manager.cc:5495] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:47.996415 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:47.996730 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b08bce102125416fbcf446f12243ebe9 (table default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83]). Expected version 1 got 0
I20260928 14:50:47.997035 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6aa393b1fc2b40ebb87df86180717db8 (table default.Table_0b822e5685d1472b8e5cb2ef43cd0f4d [id=a325eabc142d47b88dae65aaba6082c1]). Expected version 1 got 0
I20260928 14:50:47.998360 9262 tablet_service.cc:1467] Processing CreateTablet for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135 (DEFAULT_TABLE table=default.Table_7aee7ac87b2648b19dee4865905706d9 [id=9ed3ada48a674bb58dfd2517405f6fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:47.998704 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:47.999075 8946 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8d84881afc441d9be2bfb5505c9156 consensus state has no leader
I20260928 14:50:47.999547 9815 tablet_replica.cc:330] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:47.999452 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b4648844c9c242f389f03099c4e7576d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:47.999821 9815 raft_consensus.cc:2229] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:48.000000 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4648844c9c242f389f03099c4e7576d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.000029 9815 raft_consensus.cc:2258] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.000875 9815 ts_tablet_manager.cc:1905] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.001259 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet e33ecd8df52d4355b187142ff61f24ef from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:48.001317 11454 raft_consensus.cc:482] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.001416 11454 raft_consensus.cc:504] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.001974 11454 leader_election.cc:288] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.001957 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_14ce1e2c279449f99310a50520454758" } modify_external_catalogs: true
I20260928 14:50:48.002121 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_14ce1e2c279449f99310a50520454758" } modify_external_catalogs: true
I20260928 14:50:48.002522 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.002677 9813 ts_tablet_manager.cc:1918] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.002760 9813 log.cc:1196] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/edf76b53ded84392a39c73d7e653615d
I20260928 14:50:48.003015 9813 ts_tablet_manager.cc:1939] T edf76b53ded84392a39c73d7e653615d P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.003496 9813 tablet_replica.cc:330] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:48.003659 9813 raft_consensus.cc:2229] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.003633 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:48.003789 9813 raft_consensus.cc:2258] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 14:50:48.004120 9498 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.004227 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet edf76b53ded84392a39c73d7e653615d (table default.Table_b201177c711e44c5b8800158642374e3 [id=ffdb6ff2291345d18b76c89544e7d6bd]) successfully deleted
I20260928 14:50:48.004320 9813 ts_tablet_manager.cc:1905] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:48.004457 9497 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.004549 9497 leader_election.cc:302] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.005347 11454 raft_consensus.cc:2726] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.005919 9265 tablet_service.cc:1467] Processing CreateTablet for tablet c552bd6581434c59acb61fd1c708bf18 (DEFAULT_TABLE table=default.Table_f02d0e8cb13d4d7b9340bf625a4fa4c5 [id=cdd8cf33b39b4c9cbf6f04ce9c46053c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.006266 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c552bd6581434c59acb61fd1c708bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.006899 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 91262a2cf39e4e5bb4854998332ca1f1 (table default.Table_c0348630a5014a34baa6f91ce3af6db8 [id=c6459695f1464a9db30ca63fe42445f0]). Expected version 1 got 0
I20260928 14:50:48.007262 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet d5b08f7c9a1e4fcab0951eb5d4cd059a (table default.Table_d6786a7a8c4c4bfca78e8dfa802dee71 [id=53a8fdb3cf364603a1acdf162636cd80]). Expected version 1 got 0
I20260928 14:50:48.007995 11371 raft_consensus.cc:504] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.008908 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:48.008908 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9c9ea18f2046a080aca899f51f6759" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:48.009063 9569 raft_consensus.cc:3037] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.009368 9855 tablet_bootstrap.cc:492] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.009593 11371 leader_election.cc:288] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.010056 9851 tablet_bootstrap.cc:492] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.010249 9851 ts_tablet_manager.cc:1397] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.008s
I20260928 14:50:48.010910 9851 raft_consensus.cc:348] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.011099 9851 raft_consensus.cc:374] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.011160 9851 raft_consensus.cc:729] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.011495 9851 consensus_queue.cc:260] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.011802 9220 leader_election.cc:341] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.016453 9848 raft_consensus.cc:348] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.017692 9814 ts_tablet_manager.cc:1918] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.017818 9265 tablet_service.cc:1467] Processing CreateTablet for tablet dd02e73d6efc4686b36879fc0540f861 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.018168 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd02e73d6efc4686b36879fc0540f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.020120 9851 ts_tablet_manager.cc:1428] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260928 14:50:48.024127 9851 tablet_bootstrap.cc:492] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.011273 9569 raft_consensus.cc:2454] T eb9c9ea18f2046a080aca899f51f6759 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:48.025283 9545 tablet_service.cc:1467] Processing CreateTablet for tablet dd02e73d6efc4686b36879fc0540f861 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.026507 9537 tablet_service.cc:1467] Processing CreateTablet for tablet c5574cd8a3ee4467be4ad4f70fbdcb50 (DEFAULT_TABLE table=default.Table_821a2620e0a049108c3a745a86f6f553 [id=6033b624d2394addb3d5a2edcc26656f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.027320 9219 leader_election.cc:302] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.027628 9851 tablet_bootstrap.cc:654] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.028095 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 0273eaee806d4f3890bca8b4cf55bbc0 (DEFAULT_TABLE table=default.Table_7a9eeb5c71b24b57ab5f5b8f3568b6de [id=d6b209f3f6f74e1a862d4c5996ece4c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.029421 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.029632 9855 ts_tablet_manager.cc:1397] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.006s
I20260928 14:50:48.028232 11371 raft_consensus.cc:2781] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:48.030615 11371 raft_consensus.cc:686] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:48.030961 11371 consensus_queue.cc:237] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.031147 9855 raft_consensus.cc:348] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.031339 9855 raft_consensus.cc:374] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.031392 9855 raft_consensus.cc:729] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.032351 9855 consensus_queue.cc:260] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.036234 9848 raft_consensus.cc:374] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.036355 9848 raft_consensus.cc:729] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.036585 9848 consensus_queue.cc:260] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.027077 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 0273eaee806d4f3890bca8b4cf55bbc0 (DEFAULT_TABLE table=default.Table_7a9eeb5c71b24b57ab5f5b8f3568b6de [id=d6b209f3f6f74e1a862d4c5996ece4c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.037092 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0273eaee806d4f3890bca8b4cf55bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.037181 9848 ts_tablet_manager.cc:1428] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.050s user 0.001s sys 0.001s
I20260928 14:50:48.039520 9848 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.028986 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.041826 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.042603 9848 tablet_bootstrap.cc:654] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.017831 9814 log.cc:1196] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2b92039b9a484a768efa3714b58248ef
I20260928 14:50:48.044670 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:48.045077 9814 ts_tablet_manager.cc:1939] T 2b92039b9a484a768efa3714b58248ef P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.046342 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1266) took 1835 ms. Trace:
I20260928 14:50:48.046599 9814 rpcz_store.cc:276] 0928 14:50:46.210445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.211962 (+ 1517us) service_pool.cc:227] Handling call
0928 14:50:47.989574 (+1777612us) ts_tablet_manager.cc:1145] Deleting tablet 2b92039b9a484a768efa3714b58248ef
0928 14:50:47.989584 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.015112 (+ 25528us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.017609 (+ 2497us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.046322 (+ 28713us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1777487}
I20260928 14:50:48.024336 9406 tablet_service.cc:1467] Processing CreateTablet for tablet dd02e73d6efc4686b36879fc0540f861 (DEFAULT_TABLE table=default.Table_d71d1147c74944da89bda163f87c7417 [id=9ceafaaca2474ef4a1296863498cc56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.048663 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd02e73d6efc4686b36879fc0540f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.048985 9855 ts_tablet_manager.cc:1428] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260928 14:50:48.049315 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1272) took 1626 ms. Trace:
I20260928 14:50:48.049500 9814 rpcz_store.cc:276] 0928 14:50:46.423153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.423474 (+ 321us) service_pool.cc:227] Handling call
0928 14:50:48.048372 (+1624898us) ts_tablet_manager.cc:1145] Deleting tablet 24f53d04326f4e639be23564563034e0
0928 14:50:48.048384 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.049296 (+ 912us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1624699}
I20260928 14:50:48.050161 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1273) took 1626 ms. Trace:
I20260928 14:50:48.051307 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f3a1b6fc1c4782b3bd9cf7b3e96135. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:48.053664 11270 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260928 14:50:48.058068 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd02e73d6efc4686b36879fc0540f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.058638 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2b92039b9a484a768efa3714b58248ef (table default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]) successfully deleted
I20260928 14:50:48.058832 9258 tablet_service.cc:1467] Processing CreateTablet for tablet c5574cd8a3ee4467be4ad4f70fbdcb50 (DEFAULT_TABLE table=default.Table_821a2620e0a049108c3a745a86f6f553 [id=6033b624d2394addb3d5a2edcc26656f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:48.058981 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 24f53d04326f4e639be23564563034e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24f53d04326f4e639be23564563034e0 already in progress: creating tablet
I20260928 14:50:48.059160 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5574cd8a3ee4467be4ad4f70fbdcb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.061720 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5574cd8a3ee4467be4ad4f70fbdcb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.065639 9815 ts_tablet_manager.cc:1918] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.065740 9815 log.cc:1196] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b8237f7d97304a98889bde6817358eda
I20260928 14:50:48.065809 9267 tablet_service.cc:1467] Processing CreateTablet for tablet 0273eaee806d4f3890bca8b4cf55bbc0 (DEFAULT_TABLE table=default.Table_7a9eeb5c71b24b57ab5f5b8f3568b6de [id=d6b209f3f6f74e1a862d4c5996ece4c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.066030 9815 ts_tablet_manager.cc:1939] T b8237f7d97304a98889bde6817358eda P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.066118 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0273eaee806d4f3890bca8b4cf55bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.067155 9815 tablet_replica.cc:330] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.067337 9815 raft_consensus.cc:2229] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.067449 9815 raft_consensus.cc:2258] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.050328 9814 rpcz_store.cc:276] 0928 14:50:46.423248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.423673 (+ 425us) service_pool.cc:227] Handling call
0928 14:50:48.049987 (+1626314us) ts_tablet_manager.cc:1145] Deleting tablet 2871c2000c9f41f9ba8145ed0c3ee508
0928 14:50:48.049996 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.050124 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1626179}
I20260928 14:50:48.069816 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e (DEFAULT_TABLE table=default.Table_c9b71ef1edaf42c2853cb149e0d5e469 [id=6acb2eeee4934284ab1344a47380190d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.070156 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0273eaee806d4f3890bca8b4cf55bbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.070839 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.073741 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16f38e7ca6b644fd8173ff5b7ee61c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.076457 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b8237f7d97304a98889bde6817358eda (table default.Table_268a79e835004ddaa114b663c8be3a9c [id=6c0247f77b83490b90d1f7ccbfa55ab4]) successfully deleted
I20260928 14:50:48.076496 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1274) took 1653 ms. Trace:
I20260928 14:50:48.077411 11223 raft_consensus.cc:482] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.077709 11454 raft_consensus.cc:482] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.077656 11223 raft_consensus.cc:504] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.077818 11454 raft_consensus.cc:504] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.078183 11223 leader_election.cc:288] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.078313 11454 leader_election.cc:288] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.078768 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "299ed0acd7cf46d3b78f4f4cea31858f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:48.078785 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:48.078943 9568 raft_consensus.cc:2454] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
W20260928 14:50:48.079238 9497 leader_election.cc:341] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.077301 9814 rpcz_store.cc:276] 0928 14:50:46.423356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.425989 (+ 2633us) service_pool.cc:227] Handling call
0928 14:50:48.069845 (+1643856us) ts_tablet_manager.cc:1145] Deleting tablet 22e642af72ff4f5285f8bc4e6ed36401
0928 14:50:48.069856 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.076305 (+ 6449us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1643535}
I20260928 14:50:48.079357 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.079427 9219 leader_election.cc:302] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
W20260928 14:50:48.080083 9220 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.080063 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "299ed0acd7cf46d3b78f4f4cea31858f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.080402 11223 raft_consensus.cc:2781] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:48.080497 11223 raft_consensus.cc:482] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 14:50:48.080544 9498 leader_election.cc:341] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.080585 11223 raft_consensus.cc:3037] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.080637 9498 leader_election.cc:302] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.080983 11454 raft_consensus.cc:2726] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.082289 9813 ts_tablet_manager.cc:1918] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.082394 9813 log.cc:1196] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/42b9f78ecb674ae691d407615680ca56
I20260928 14:50:48.082700 9813 ts_tablet_manager.cc:1939] T 42b9f78ecb674ae691d407615680ca56 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.082726 11223 raft_consensus.cc:504] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.082716 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1275) took 1651 ms. Trace:
I20260928 14:50:48.083444 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 42b9f78ecb674ae691d407615680ca56 (table default.Table_6b95962f27a14d3f9dea2a54a324eb75 [id=de57b2d971c842d8951ba6e933ae60a6]) successfully deleted
I20260928 14:50:48.083724 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:48.083873 11223 leader_election.cc:288] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.084064 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59b8e736b6d4644a78a6d7570746e18" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:48.084231 9568 raft_consensus.cc:3037] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:48.084532 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d4ff58de6c794b5ba7b44201800592d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4ff58de6c794b5ba7b44201800592d2 already in progress: creating tablet
W20260928 14:50:48.084141 9220 leader_election.cc:341] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.083302 9814 rpcz_store.cc:276] 0928 14:50:46.431037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.431624 (+ 587us) service_pool.cc:227] Handling call
0928 14:50:48.080501 (+1648877us) ts_tablet_manager.cc:1145] Deleting tablet 4fdc5e3f83924f4cae8d30be9dcce152
0928 14:50:48.080514 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.082473 (+ 1959us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1648368}
W20260928 14:50:48.085129 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e0c64096ca3c490a909131c92e0846a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0c64096ca3c490a909131c92e0846a0 already in progress: creating tablet
W20260928 14:50:48.085114 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e0c64096ca3c490a909131c92e0846a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0c64096ca3c490a909131c92e0846a0 already in progress: creating tablet
I20260928 14:50:48.086526 9568 raft_consensus.cc:2454] T e59b8e736b6d4644a78a6d7570746e18 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:48.086619 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1276) took 1622 ms. Trace:
I20260928 14:50:48.087738 9219 leader_election.cc:302] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.087972 11223 raft_consensus.cc:2781] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:48.088071 11223 raft_consensus.cc:686] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:48.087422 9814 rpcz_store.cc:276] 0928 14:50:46.464565 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.464717 (+ 152us) service_pool.cc:227] Handling call
0928 14:50:48.085853 (+1621136us) ts_tablet_manager.cc:1145] Deleting tablet b39c67a1cf4c4a97af85aaf0484835f8
0928 14:50:48.086085 (+ 232us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.086601 (+ 516us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620968}
I20260928 14:50:48.088639 11223 consensus_queue.cc:237] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.089973 9815 ts_tablet_manager.cc:1905] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.089779 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1277) took 1625 ms. Trace:
W20260928 14:50:48.090407 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 2871c2000c9f41f9ba8145ed0c3ee508 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2871c2000c9f41f9ba8145ed0c3ee508 already in progress: creating tablet
I20260928 14:50:48.090317 9814 rpcz_store.cc:276] 0928 14:50:46.464675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.464912 (+ 237us) service_pool.cc:227] Handling call
0928 14:50:48.089138 (+1624226us) ts_tablet_manager.cc:1145] Deleting tablet cacb6cd51f3b4f238813e764818767c2
0928 14:50:48.089149 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.089758 (+ 609us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1624097}
W20260928 14:50:48.092514 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 22e642af72ff4f5285f8bc4e6ed36401 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22e642af72ff4f5285f8bc4e6ed36401 already in progress: creating tablet
I20260928 14:50:48.092402 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1278) took 1626 ms. Trace:
W20260928 14:50:48.092821 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 4fdc5e3f83924f4cae8d30be9dcce152 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fdc5e3f83924f4cae8d30be9dcce152 already in progress: creating tablet
W20260928 14:50:48.093047 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b39c67a1cf4c4a97af85aaf0484835f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39c67a1cf4c4a97af85aaf0484835f8 already in progress: creating tablet
I20260928 14:50:48.093050 9814 rpcz_store.cc:276] 0928 14:50:46.465964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.466010 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:48.091838 (+1625828us) ts_tablet_manager.cc:1145] Deleting tablet fb2feb8adf57477ab915eea1d980d3e6
0928 14:50:48.092004 (+ 166us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.092384 (+ 380us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1625659}
I20260928 14:50:48.095074 9814 tablet_replica.cc:330] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
W20260928 14:50:48.105826 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet b8237f7d97304a98889bde6817358eda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8237f7d97304a98889bde6817358eda already in progress: creating tablet
I20260928 14:50:48.105383 9395 tablet_service.cc:1467] Processing CreateTablet for tablet c5574cd8a3ee4467be4ad4f70fbdcb50 (DEFAULT_TABLE table=default.Table_821a2620e0a049108c3a745a86f6f553 [id=6033b624d2394addb3d5a2edcc26656f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.106129 9813 tablet_replica.cc:330] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:48.106333 9813 raft_consensus.cc:2229] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.106482 9813 raft_consensus.cc:2258] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.107002 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5574cd8a3ee4467be4ad4f70fbdcb50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:48.108186 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet cacb6cd51f3b4f238813e764818767c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cacb6cd51f3b4f238813e764818767c2 already in progress: creating tablet
W20260928 14:50:48.108940 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fb2feb8adf57477ab915eea1d980d3e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb2feb8adf57477ab915eea1d980d3e6 already in progress: creating tablet
I20260928 14:50:48.109129 9855 tablet_bootstrap.cc:492] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:48.112208 9855 tablet_bootstrap.cc:654] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.122390 11223 consensus_queue.cc:1035] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:48.129608 9814 raft_consensus.cc:2229] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.129797 9814 raft_consensus.cc:2258] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.130316 9814 ts_tablet_manager.cc:1905] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.135723 9815 ts_tablet_manager.cc:1918] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.135838 9815 log.cc:1196] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/49d69e4ad9554da9871800c8b392851c
I20260928 14:50:48.136106 9815 ts_tablet_manager.cc:1939] T 49d69e4ad9554da9871800c8b392851c P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.137358 9813 ts_tablet_manager.cc:1905] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.139043 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 49d69e4ad9554da9871800c8b392851c (table default.Table_eba035915e264e878ed46dfadc6f379d [id=36fdfb9776ce45c095e29afee6bdf88c]) successfully deleted
I20260928 14:50:48.140614 9851 tablet_bootstrap.cc:492] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.141911 11535 tablet.cc:1722] T b08bce102125416fbcf446f12243ebe9 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:48.142759 9851 ts_tablet_manager.cc:1397] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.119s user 0.007s sys 0.001s
I20260928 14:50:48.144848 11454 raft_consensus.cc:482] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.144968 11454 raft_consensus.cc:504] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.145514 11454 leader_election.cc:288] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.146064 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72cab768a1194a9c9ef3e3ab15d0f449" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:48.146889 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72cab768a1194a9c9ef3e3ab15d0f449" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.147564 9497 leader_election.cc:341] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:48.147967 9498 leader_election.cc:341] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.148061 9498 leader_election.cc:302] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.149183 11454 raft_consensus.cc:2726] T 72cab768a1194a9c9ef3e3ab15d0f449 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:48.149355 9220 consensus_peers.cc:487] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:48.150025 11536 tablet.cc:1722] T b08bce102125416fbcf446f12243ebe9 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:48.152665 9851 raft_consensus.cc:348] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.153590 9851 raft_consensus.cc:374] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.153828 9851 raft_consensus.cc:729] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.154563 11454 raft_consensus.cc:482] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.154673 11454 raft_consensus.cc:504] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.155324 11454 leader_election.cc:288] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.154629 9851 consensus_queue.cc:260] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.155864 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:48.156340 9497 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.157058 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.157565 9498 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.157680 9498 leader_election.cc:302] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.157778 9851 ts_tablet_manager.cc:1428] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.014s user 0.004s sys 0.001s
I20260928 14:50:48.158058 11454 raft_consensus.cc:2726] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.159528 9851 tablet_bootstrap.cc:492] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.162478 9815 tablet_replica.cc:330] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.162699 9815 raft_consensus.cc:2229] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.162861 9815 raft_consensus.cc:2258] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.167855 9851 tablet_bootstrap.cc:654] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:48.176930 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f8b1156c1b4b437c98c07070452ee260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8b1156c1b4b437c98c07070452ee260 already in progress: creating tablet
W20260928 14:50:48.177443 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 1195380515774c9f9e004d10db9d6907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1195380515774c9f9e004d10db9d6907 already in progress: creating tablet
I20260928 14:50:48.178690 9814 ts_tablet_manager.cc:1918] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.178854 9814 log.cc:1196] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/1b22c3f9578a464a96be0bac6127e56d
I20260928 14:50:48.179224 9814 ts_tablet_manager.cc:1939] T 1b22c3f9578a464a96be0bac6127e56d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.179565 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1281) took 1622 ms. Trace:
I20260928 14:50:48.186056 9815 ts_tablet_manager.cc:1905] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.193653 9813 ts_tablet_manager.cc:1918] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.193838 9813 log.cc:1196] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/5a6755b697134b8e90e457b554b9599c
I20260928 14:50:48.194260 9813 ts_tablet_manager.cc:1939] T 5a6755b697134b8e90e457b554b9599c P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.194077 9848 tablet_bootstrap.cc:492] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.194862 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 5a6755b697134b8e90e457b554b9599c (table default.Table_d9085bedbe34425b957fa044a6abcb21 [id=81527ca1be4843e180734249d97c81b6]) successfully deleted
I20260928 14:50:48.195030 9848 ts_tablet_manager.cc:1397] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.003s
W20260928 14:50:48.195562 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 1195380515774c9f9e004d10db9d6907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1195380515774c9f9e004d10db9d6907 already in progress: creating tablet
W20260928 14:50:48.196168 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f8b1156c1b4b437c98c07070452ee260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8b1156c1b4b437c98c07070452ee260 already in progress: creating tablet
W20260928 14:50:48.196720 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3c4cca0f2d148ccaa69cdfe09591cb5 already in progress: creating tablet
I20260928 14:50:48.186769 9851 tablet_bootstrap.cc:492] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.186769 11371 raft_consensus.cc:482] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.200906 11371 raft_consensus.cc:504] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.201503 11371 leader_election.cc:288] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.202598 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "666de9dd64734708b35738605204ed7d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.201387 9848 raft_consensus.cc:348] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.203186 9220 leader_election.cc:341] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.203049 9848 raft_consensus.cc:374] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.203503 9848 raft_consensus.cc:729] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.200923 9851 ts_tablet_manager.cc:1397] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.005s
I20260928 14:50:48.200778 9814 rpcz_store.cc:276] 0928 14:50:46.556704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.557035 (+ 331us) service_pool.cc:227] Handling call
0928 14:50:48.094873 (+1537838us) ts_tablet_manager.cc:1145] Deleting tablet 1b22c3f9578a464a96be0bac6127e56d
0928 14:50:48.094886 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.133148 (+ 38262us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.178577 (+ 45429us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.179551 (+ 974us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1537488}
I20260928 14:50:48.205026 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1283) took 1501 ms. Trace:
I20260928 14:50:48.205116 9814 rpcz_store.cc:276] 0928 14:50:46.703443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.707215 (+ 3772us) service_pool.cc:227] Handling call
0928 14:50:48.204919 (+1497704us) ts_tablet_manager.cc:1145] Deleting tablet 48f1d934435241529be3b4300ef4aa58
0928 14:50:48.204930 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.205011 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1497391}
I20260928 14:50:48.205319 9851 raft_consensus.cc:348] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.205506 9851 raft_consensus.cc:374] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.205578 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1284) took 1497 ms. Trace:
I20260928 14:50:48.205590 9851 raft_consensus.cc:729] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.205866 9851 consensus_queue.cc:260] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.206329 9851 ts_tablet_manager.cc:1428] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260928 14:50:48.206563 9851 tablet_bootstrap.cc:492] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.208033 9851 tablet_bootstrap.cc:654] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.208002 9815 ts_tablet_manager.cc:1918] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.208106 9815 log.cc:1196] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/5d8e4357c3d5487fa76e1e49c6cb7547
I20260928 14:50:48.208369 9815 ts_tablet_manager.cc:1939] T 5d8e4357c3d5487fa76e1e49c6cb7547 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.205659 9814 rpcz_store.cc:276] 0928 14:50:46.707916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.707968 (+ 52us) service_pool.cc:227] Handling call
0928 14:50:48.205462 (+1497494us) ts_tablet_manager.cc:1145] Deleting tablet 293ba34b7a6c49e790861431646bb405
0928 14:50:48.205472 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.205565 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2573,"tablet-delete.queue_time_us":1497248}
I20260928 14:50:48.214694 11371 raft_consensus.cc:482] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.214814 11371 raft_consensus.cc:504] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.215314 11371 leader_election.cc:288] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.215930 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "835ba6c803a34707b77bb8bc280b9e68" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.216450 9220 leader_election.cc:341] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:48.217314 9219 leader_election.cc:341] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 835ba6c803a34707b77bb8bc280b9e68
I20260928 14:50:48.217425 9219 leader_election.cc:302] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.217878 11371 raft_consensus.cc:2726] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.214759 9848 consensus_queue.cc:260] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.232262 9851 tablet_bootstrap.cc:492] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:48.232471 9219 leader_election.cc:341] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 666de9dd64734708b35738605204ed7d
I20260928 14:50:48.232604 9815 tablet_replica.cc:330] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.232635 9219 leader_election.cc:302] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.232797 9815 raft_consensus.cc:2229] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.232929 9815 raft_consensus.cc:2258] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.233038 11371 raft_consensus.cc:2726] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.233111 9851 ts_tablet_manager.cc:1397] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.009s
I20260928 14:50:48.240585 9848 ts_tablet_manager.cc:1428] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.044s user 0.002s sys 0.006s
I20260928 14:50:48.246392 9815 ts_tablet_manager.cc:1905] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.248579 9848 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.245747 9851 raft_consensus.cc:348] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.251497 11371 raft_consensus.cc:482] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.251629 11371 raft_consensus.cc:504] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.250900 9851 raft_consensus.cc:374] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.252707 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.253322 9220 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.253310 9855 tablet_bootstrap.cc:492] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.252156 11371 leader_election.cc:288] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.252625 9851 raft_consensus.cc:729] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.253845 9855 ts_tablet_manager.cc:1397] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.145s user 0.017s sys 0.016s
I20260928 14:50:48.256222 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:48.256613 9568 raft_consensus.cc:2454] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:48.257165 9219 leader_election.cc:302] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.258625 11371 raft_consensus.cc:2781] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:48.258705 11371 raft_consensus.cc:482] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:48.258769 11371 raft_consensus.cc:3037] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.258270 9855 raft_consensus.cc:348] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.259503 9855 raft_consensus.cc:374] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.259909 9855 raft_consensus.cc:729] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.261618 11371 raft_consensus.cc:504] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.263360 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:48.257131 9851 consensus_queue.cc:260] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.263926 9220 leader_election.cc:341] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.264667 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bda4f5da7a6b4a4e867d4e260a274d2a" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:48.264849 9567 raft_consensus.cc:3037] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.267488 9567 raft_consensus.cc:2454] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:48.267988 9219 leader_election.cc:302] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.268251 11371 leader_election.cc:288] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.268249 11223 raft_consensus.cc:2781] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:48.268771 11223 raft_consensus.cc:686] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:48.269349 11223 consensus_queue.cc:237] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.271809 11547 tablet.cc:1722] T bef0b52d178f4baeae621da769f6d518 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:48.273284 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 5d8e4357c3d5487fa76e1e49c6cb7547 (table default.Table_f573f1430fb34a24978cb467dd065e73 [id=4d5ddc7ef39d4d6a88121b4c39d44cdf]) successfully deleted
W20260928 14:50:48.273693 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3c4cca0f2d148ccaa69cdfe09591cb5 already in progress: creating tablet
I20260928 14:50:48.273957 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 1b22c3f9578a464a96be0bac6127e56d (table default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]) successfully deleted
W20260928 14:50:48.274226 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 48f1d934435241529be3b4300ef4aa58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48f1d934435241529be3b4300ef4aa58 already in progress: creating tablet
W20260928 14:50:48.274523 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 293ba34b7a6c49e790861431646bb405 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ba34b7a6c49e790861431646bb405 already in progress: creating tablet
I20260928 14:50:48.276190 9851 ts_tablet_manager.cc:1428] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.042s user 0.003s sys 0.004s
I20260928 14:50:48.287839 9848 tablet_bootstrap.cc:654] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.299407 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1285) took 1588 ms. Trace:
I20260928 14:50:48.299506 9814 rpcz_store.cc:276] 0928 14:50:46.711377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.711681 (+ 304us) service_pool.cc:227] Handling call
0928 14:50:48.213167 (+1501486us) ts_tablet_manager.cc:1145] Deleting tablet ba43a88f7aa94597ab76a47869e463cd
0928 14:50:48.299239 (+ 86072us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.299385 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1501287}
I20260928 14:50:48.299901 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1286) took 1584 ms. Trace:
I20260928 14:50:48.299976 9814 rpcz_store.cc:276] 0928 14:50:46.715375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.716225 (+ 850us) service_pool.cc:227] Handling call
0928 14:50:48.299794 (+1583569us) ts_tablet_manager.cc:1145] Deleting tablet b17faf5198e048b2824aea3308070fa8
0928 14:50:48.299805 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.299884 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1583270}
I20260928 14:50:48.300272 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1287) took 1572 ms. Trace:
I20260928 14:50:48.300336 9814 rpcz_store.cc:276] 0928 14:50:46.728292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.728409 (+ 117us) service_pool.cc:227] Handling call
0928 14:50:48.300179 (+1571770us) ts_tablet_manager.cc:1145] Deleting tablet 8a9430a9410f41cc9c3858755a710a99
0928 14:50:48.300187 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.300255 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1571457}
I20260928 14:50:48.300567 9814 tablet_replica.cc:330] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.300755 9814 raft_consensus.cc:2229] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.300887 9814 raft_consensus.cc:2258] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.300961 9851 tablet_bootstrap.cc:492] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.301364 9814 ts_tablet_manager.cc:1905] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.307785 9814 ts_tablet_manager.cc:1918] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.307967 9814 log.cc:1196] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/66772fac8b3747f0983562195abcc64e
I20260928 14:50:48.308435 9814 ts_tablet_manager.cc:1939] T 66772fac8b3747f0983562195abcc64e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.309176 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1289) took 1534 ms. Trace:
I20260928 14:50:48.309309 9814 rpcz_store.cc:276] 0928 14:50:46.774230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.774273 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:48.300532 (+1526259us) ts_tablet_manager.cc:1145] Deleting tablet 66772fac8b3747f0983562195abcc64e
0928 14:50:48.300541 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.304851 (+ 4310us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.307713 (+ 2862us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.309158 (+ 1445us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510150}
I20260928 14:50:48.312269 9814 tablet_replica.cc:330] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.312955 9814 raft_consensus.cc:2229] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.314888 9814 raft_consensus.cc:2258] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.316088 9851 tablet_bootstrap.cc:654] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.316388 9814 ts_tablet_manager.cc:1905] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.325089 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 5c53c8bd0e124a2798d2a7f1e9595f1c
I20260928 14:50:48.325697 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dbfd7328a9af4234a24a02dcba076cde" } new_table_name: "default.Table_0ab85009a02b428b91d39f346817cd56" modify_external_catalogs: true
W20260928 14:50:48.326952 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3d0060df4264a80b623bce21f41a906 consensus state has no leader
I20260928 14:50:48.326859 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_82caf77989ce41868a3a46a2a74d53e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.327265 8951 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_bfd23ac1b2fc4f65a3415f9ff37e9917" } new_table_name: "default.Table_a368bd968edb461dbc01fa01aa8027c2" modify_external_catalogs: true
W20260928 14:50:48.327381 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82caf77989ce41868a3a46a2a74d53e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.328245 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5b171a26e7e643c9bc98c580b7bae60f (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]). Expected version 2 got 0
I20260928 14:50:48.328517 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 00b65284d7da4ee186d228c64a4013d6
I20260928 14:50:48.328539 8955 catalog_manager.cc:5495] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:48.328910 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 7376f56883dc4032b120cc4494fa8936 with delete_type TABLET_DATA_DELETED (replaced by tablet a8f6de1135234f58aa2e534efead2880) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.328945 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e59b8e736b6d4644a78a6d7570746e18 (table default.Table_9aa2a15124ab40d682b1da19d1713074 [id=db3c037ac7784283bb5dc67c99a4b73c]). Expected version 1 got 0
I20260928 14:50:48.329003 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_be87de61868140509f40026cac7ad8a7" } modify_external_catalogs: true
I20260928 14:50:48.329161 9813 tablet_replica.cc:330] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:48.329141 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_be87de61868140509f40026cac7ad8a7" } modify_external_catalogs: true
I20260928 14:50:48.329353 9813 raft_consensus.cc:2229] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.329226 8955 catalog_manager.cc:5495] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:48.329507 9813 raft_consensus.cc:2258] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.329686 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e33ecd8df52d4355b187142ff61f24ef
I20260928 14:50:48.329756 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.329977 8952 catalog_manager.cc:6565] ReplaceTablet: tablet e33ecd8df52d4355b187142ff61f24ef deleted and replaced by tablet 7d0593cc14134b95a8c02280b717a0b9
I20260928 14:50:48.330003 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 989df9ccfce446008435161626ce4f5e
I20260928 14:50:48.330195 8952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7916bc36965447d084793a43b16c2707" } modify_external_catalogs: true
I20260928 14:50:48.330315 8954 catalog_manager.cc:6565] ReplaceTablet: tablet 989df9ccfce446008435161626ce4f5e deleted and replaced by tablet f38c448623b64ac1ba93ba113908ff05
I20260928 14:50:48.330349 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:48.330529 9813 ts_tablet_manager.cc:1905] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.330538 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_34ed3510a4a04fe386d546ba1bdf33af" } modify_external_catalogs: true
I20260928 14:50:48.330657 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_34ed3510a4a04fe386d546ba1bdf33af" } modify_external_catalogs: true
I20260928 14:50:48.330505 8955 catalog_manager.cc:5495] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:48.330812 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet bda4f5da7a6b4a4e867d4e260a274d2a (table default.Table_b7be75ca96434082812ba760c0927f0c [id=0fe8de98dfb54d84912d74fec349c41b]). Expected version 2 got 0
I20260928 14:50:48.330324 8952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7916bc36965447d084793a43b16c2707" } modify_external_catalogs: true
I20260928 14:50:48.331902 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_02ba25efea3d498c91ec5c33248f0fe2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.332334 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02ba25efea3d498c91ec5c33248f0fe2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.333541 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2cc399c677ec4d3f99908a6af4168eed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.333940 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cc399c677ec4d3f99908a6af4168eed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.335441 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_30cbca03b6f14748816af646b024220b" } new_table_name: "default.Table_a78b821ee2e0447fba1bd3b49e74e732" modify_external_catalogs: true
I20260928 14:50:48.337100 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet e33ecd8df52d4355b187142ff61f24ef with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0593cc14134b95a8c02280b717a0b9) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.337314 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 989df9ccfce446008435161626ce4f5e with delete_type TABLET_DATA_DELETED (replaced by tablet f38c448623b64ac1ba93ba113908ff05) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.337507 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b65284d7da4ee186d228c64a4013d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:48.338038 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92bf219c9c074585968764e134375172 consensus state has no leader
I20260928 14:50:48.338227 9848 tablet_bootstrap.cc:492] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.338250 8949 master_service.cc:946] ReplaceTablet: received request to replace tablet a78d6d6db7a1484498c7496ddbdc29fb from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:48.338433 9848 ts_tablet_manager.cc:1397] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.092s user 0.005s sys 0.005s
I20260928 14:50:48.340723 9848 raft_consensus.cc:348] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.340987 9848 raft_consensus.cc:374] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.341132 9848 raft_consensus.cc:729] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.341364 9848 consensus_queue.cc:260] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.341636 9813 ts_tablet_manager.cc:1918] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.341856 9813 log.cc:1196] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/7376f56883dc4032b120cc4494fa8936
I20260928 14:50:48.342209 9813 ts_tablet_manager.cc:1939] T 7376f56883dc4032b120cc4494fa8936 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.342720 9848 ts_tablet_manager.cc:1428] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260928 14:50:48.343700 8951 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2aae21b7ed2417dafd4cca54c53de33 consensus state has no leader
I20260928 14:50:48.345844 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 7376f56883dc4032b120cc4494fa8936 (table default.Table_d14014ff4a6c4eadaf258a45e65b09b2 [id=fee7478c31d54663aa41d4e1ce00a6ed]) successfully deleted
I20260928 14:50:48.348639 9848 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:48.349125 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c53c8bd0e124a2798d2a7f1e9595f1c already in progress: creating tablet
I20260928 14:50:48.349756 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4468740bf6154eed85dedb956707a307"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.350219 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4468740bf6154eed85dedb956707a307 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:48.350468 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e33ecd8df52d4355b187142ff61f24ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33ecd8df52d4355b187142ff61f24ef already in progress: creating tablet
I20260928 14:50:48.351945 9814 ts_tablet_manager.cc:1918] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.352922 9814 log.cc:1196] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8fcc42af91c247b1b80059e95e3659cf
I20260928 14:50:48.354707 8956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_7a9d845260784a298e728d7c89c2e202" } new_table_name: "default.Table_5409a3ec42e34441ba63298dbfeb27b4" modify_external_catalogs: true
I20260928 14:50:48.358254 9814 ts_tablet_manager.cc:1939] T 8fcc42af91c247b1b80059e95e3659cf P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.359228 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 32e609be5acd42b48b6b7423cd56401a
I20260928 14:50:48.359272 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 72099e766c574246b38acb34ee369d2e
I20260928 14:50:48.359835 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9c7ece9445444dc6ab234fe2ecf2e9e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.359973 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 72099e766c574246b38acb34ee369d2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.360145 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e609be5acd42b48b6b7423cd56401a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:48.360302 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c7ece9445444dc6ab234fe2ecf2e9e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.365651 8946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b930803d2aa44996b012d941744bf25c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.365859 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet de77b0bec60a4ebbb0a1b6f779eaaf70
W20260928 14:50:48.366101 8946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b930803d2aa44996b012d941744bf25c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.367895 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.368552 9855 consensus_queue.cc:260] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.369074 9855 ts_tablet_manager.cc:1428] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.115s user 0.023s sys 0.003s
I20260928 14:50:48.369755 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1290) took 1500 ms. Trace:
I20260928 14:50:48.371647 9855 tablet_bootstrap.cc:492] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:48.371757 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 989df9ccfce446008435161626ce4f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 989df9ccfce446008435161626ce4f5e already in progress: creating tablet
I20260928 14:50:48.370656 9814 rpcz_store.cc:276] 0928 14:50:46.869169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.869220 (+ 51us) service_pool.cc:227] Handling call
0928 14:50:48.312225 (+1443005us) ts_tablet_manager.cc:1145] Deleting tablet 8fcc42af91c247b1b80059e95e3659cf
0928 14:50:48.312236 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.327871 (+ 15635us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.350924 (+ 23053us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.369491 (+ 18567us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442803}
W20260928 14:50:48.372787 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 00b65284d7da4ee186d228c64a4013d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b65284d7da4ee186d228c64a4013d6 already in progress: creating tablet
I20260928 14:50:48.372927 9855 tablet_bootstrap.cc:654] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:48.373005 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 72099e766c574246b38acb34ee369d2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72099e766c574246b38acb34ee369d2e already in progress: creating tablet
I20260928 14:50:48.373309 9848 tablet_bootstrap.cc:654] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:48.374143 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de77b0bec60a4ebbb0a1b6f779eaaf70 already in progress: creating tablet
I20260928 14:50:48.374781 9814 tablet_replica.cc:330] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.376374 9814 raft_consensus.cc:2229] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.377807 9814 raft_consensus.cc:2258] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.379446 11548 tablet.cc:1722] T bef0b52d178f4baeae621da769f6d518 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:48.381704 9814 ts_tablet_manager.cc:1905] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.382711 11223 raft_consensus.cc:482] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.382818 11223 raft_consensus.cc:504] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.383306 11223 leader_election.cc:288] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.383920 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.384337 9568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
W20260928 14:50:48.384470 9220 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.384620 9568 raft_consensus.cc:2454] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:48.385005 9219 leader_election.cc:302] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.385408 11223 raft_consensus.cc:2781] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:48.385480 11223 raft_consensus.cc:482] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:48.385627 11223 raft_consensus.cc:3037] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.386840 9851 tablet_bootstrap.cc:492] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.386998 9851 ts_tablet_manager.cc:1397] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.087s user 0.006s sys 0.010s
I20260928 14:50:48.388064 11223 raft_consensus.cc:504] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.388096 9851 raft_consensus.cc:348] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.388415 9851 raft_consensus.cc:374] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.388532 9851 raft_consensus.cc:729] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.388876 9851 consensus_queue.cc:260] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.389842 9851 ts_tablet_manager.cc:1428] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260928 14:50:48.390571 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:48.390617 9851 tablet_bootstrap.cc:492] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:48.391562 9220 leader_election.cc:341] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.392076 11223 leader_election.cc:288] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.392524 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b171a26e7e643c9bc98c580b7bae60f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:48.392704 9567 raft_consensus.cc:3037] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.395520 9567 raft_consensus.cc:2454] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:48.395947 9219 leader_election.cc:302] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.398922 11498 raft_consensus.cc:2781] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:48.399034 11498 raft_consensus.cc:686] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:48.399220 11498 consensus_queue.cc:237] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.402074 9851 tablet_bootstrap.cc:654] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.410539 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f4b20a5e784d909f7297cc7f1b05e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.410799 11454 raft_consensus.cc:482] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.410912 11454 raft_consensus.cc:504] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.411443 11454 leader_election.cc:288] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.411916 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a94a7a6c81453c8e47149be3d6479e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:48.412349 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a94a7a6c81453c8e47149be3d6479e" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.412941 9498 leader_election.cc:341] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.413013 11270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d70b1b045bd4ec4b74be2dc2364ecba: Bootstrap replaying log segment 1/1 (198.8K/334.2K this segment, stats: ops{read=545 overwritten=0 applied=544 ignored=0} inserts{seen=497 ignored=0} mutations{seen=602 ignored=0} orphaned_commits=0)
W20260928 14:50:48.413319 9497 leader_election.cc:341] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.413416 9497 leader_election.cc:302] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.413834 11454 raft_consensus.cc:2726] T 71a94a7a6c81453c8e47149be3d6479e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.419283 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 666de9dd64734708b35738605204ed7d with delete_type TABLET_DATA_DELETED (replaced by tablet f421b29c12cb4b5989de6bebcf04639f) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.419305 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.421975 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ef1340deca4f00a250c390afcb5064 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.423678 9851 tablet_bootstrap.cc:492] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.423862 9851 ts_tablet_manager.cc:1397] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.003s
I20260928 14:50:48.425053 9851 raft_consensus.cc:348] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.425436 9851 raft_consensus.cc:374] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.425555 9851 raft_consensus.cc:729] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.428884 9815 ts_tablet_manager.cc:1918] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.428998 9815 log.cc:1196] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/299ed0acd7cf46d3b78f4f4cea31858f
I20260928 14:50:48.429306 9815 ts_tablet_manager.cc:1939] T 299ed0acd7cf46d3b78f4f4cea31858f P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.430627 9815 tablet_replica.cc:330] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.430953 9815 raft_consensus.cc:2229] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.431195 9815 raft_consensus.cc:2258] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.432035 9815 ts_tablet_manager.cc:1905] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.432322 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.435242 9851 consensus_queue.cc:260] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.435948 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b65284d7da4ee186d228c64a4013d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.436430 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 00b65284d7da4ee186d228c64a4013d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:47 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.437096 9851 ts_tablet_manager.cc:1428] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260928 14:50:48.437124 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet e33ecd8df52d4355b187142ff61f24ef with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0593cc14134b95a8c02280b717a0b9) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.437686 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet e33ecd8df52d4355b187142ff61f24ef with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0593cc14134b95a8c02280b717a0b9) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.438153 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 32e609be5acd42b48b6b7423cd56401a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e609be5acd42b48b6b7423cd56401a already in progress: creating tablet
I20260928 14:50:48.438915 9814 ts_tablet_manager.cc:1918] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.438874 9851 tablet_bootstrap.cc:492] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.439498 9814 log.cc:1196] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/9f2c5afbdeda4ddfb82124031135e6cb
I20260928 14:50:48.440091 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 989df9ccfce446008435161626ce4f5e with delete_type TABLET_DATA_DELETED (replaced by tablet f38c448623b64ac1ba93ba113908ff05) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.441694 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 989df9ccfce446008435161626ce4f5e with delete_type TABLET_DATA_DELETED (replaced by tablet f38c448623b64ac1ba93ba113908ff05) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.441915 9814 ts_tablet_manager.cc:1939] T 9f2c5afbdeda4ddfb82124031135e6cb P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.442896 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e609be5acd42b48b6b7423cd56401a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.445865 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 32e609be5acd42b48b6b7423cd56401a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.447647 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1291) took 1554 ms. Trace:
I20260928 14:50:48.448457 9814 rpcz_store.cc:276] 0928 14:50:46.893163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.895713 (+ 2550us) service_pool.cc:227] Handling call
0928 14:50:48.374574 (+1478861us) ts_tablet_manager.cc:1145] Deleting tablet 9f2c5afbdeda4ddfb82124031135e6cb
0928 14:50:48.374588 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.410209 (+ 35621us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.438397 (+ 28188us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.447625 (+ 9228us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1478536}
I20260928 14:50:48.450433 9851 tablet_bootstrap.cc:654] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.454442 11556 tablet.cc:1722] T bef0b52d178f4baeae621da769f6d518 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:48.457894 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1292) took 1530 ms. Trace:
I20260928 14:50:48.458432 11519 raft_consensus.cc:482] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.458701 11519 raft_consensus.cc:504] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.459250 11519 leader_election.cc:288] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.459532 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.459568 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:48.459775 9569 raft_consensus.cc:2454] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:48.459955 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.460117 9219 leader_election.cc:302] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:48.460392 11519 raft_consensus.cc:2781] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:48.460469 11519 raft_consensus.cc:482] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:48.460537 11519 raft_consensus.cc:3037] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:48.460384 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.460955 9220 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.461046 9848 tablet_bootstrap.cc:492] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.461151 9848 ts_tablet_manager.cc:1397] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.113s user 0.011s sys 0.017s
I20260928 14:50:48.461833 9848 raft_consensus.cc:348] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.462023 9848 raft_consensus.cc:374] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.462080 9848 raft_consensus.cc:729] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.462266 9848 consensus_queue.cc:260] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.463167 11519 raft_consensus.cc:504] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.464046 11519 leader_election.cc:288] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.464119 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:48.464376 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 72099e766c574246b38acb34ee369d2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.464560 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 72099e766c574246b38acb34ee369d2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.464735 9569 raft_consensus.cc:3037] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:48.464926 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet ba43a88f7aa94597ab76a47869e463cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba43a88f7aa94597ab76a47869e463cd already in progress: creating tablet
W20260928 14:50:48.465211 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b17faf5198e048b2824aea3308070fa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17faf5198e048b2824aea3308070fa8 already in progress: creating tablet
W20260928 14:50:48.465440 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 8a9430a9410f41cc9c3858755a710a99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9430a9410f41cc9c3858755a710a99 already in progress: creating tablet
I20260928 14:50:48.465716 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 66772fac8b3747f0983562195abcc64e (table default.Table_cec79b345afa4c25bbd3c96ac88c6b11 [id=2e13625a246447c094acfbe1f0e6b106]) successfully deleted
I20260928 14:50:48.465902 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8fcc42af91c247b1b80059e95e3659cf (table default.Table_cb52782bde064ae2b1ea4ca8d30db871 [id=d941acc245774ff4b5d6f5f73a866e3f]) successfully deleted
I20260928 14:50:48.466151 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 9f2c5afbdeda4ddfb82124031135e6cb (table default.Table_fc1ba1d4357b4f88865fb323d86d0bc4 [id=b9da8f3786084226ae396c4c3a19b20b]) successfully deleted
I20260928 14:50:48.460106 9814 rpcz_store.cc:276] 0928 14:50:46.927518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.927579 (+ 61us) service_pool.cc:227] Handling call
0928 14:50:48.450490 (+1522911us) ts_tablet_manager.cc:1145] Deleting tablet b6fed86d9eda45cab2083fca73825383
0928 14:50:48.450500 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.457875 (+ 7375us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522726}
I20260928 14:50:48.466588 8952 master_service.cc:946] ReplaceTablet: received request to replace tablet 546a0b9b92404b9db1e02cf3f77feda1 from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:48.467103 9569 raft_consensus.cc:2454] T 6aa393b1fc2b40ebb87df86180717db8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:48.467123 8948 master_service.cc:946] ReplaceTablet: received request to replace tablet fb7f3aeffb2a4a9683b728e17aa28d9d from {username='slave'} at 127.0.0.1:59208
I20260928 14:50:48.467511 9219 leader_election.cc:302] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:48.467784 11519 raft_consensus.cc:2781] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:48.467965 11519 raft_consensus.cc:686] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:48.468228 11519 consensus_queue.cc:237] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.468802 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1293) took 1530 ms. Trace:
I20260928 14:50:48.470844 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ad7685ece44665896f687697bddccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.471060 9813 tablet_replica.cc:330] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:48.471072 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 299ed0acd7cf46d3b78f4f4cea31858f (table default.Table_39fb4e4216bf46188c6df0df4e908528 [id=6d447d56ce46413f934c0d407c8b7eb9]) successfully deleted
I20260928 14:50:48.471241 9813 raft_consensus.cc:2229] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:48.471256 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b6fed86d9eda45cab2083fca73825383 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6fed86d9eda45cab2083fca73825383 already in progress: creating tablet
I20260928 14:50:48.471382 9813 raft_consensus.cc:2258] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.470052 9814 rpcz_store.cc:276] 0928 14:50:46.938238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.938408 (+ 170us) service_pool.cc:227] Handling call
0928 14:50:48.467610 (+1529202us) ts_tablet_manager.cc:1145] Deleting tablet be0ef95fd8b54b2ab140a77a74c75c5c
0928 14:50:48.467914 (+ 304us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.468784 (+ 870us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528771}
I20260928 14:50:48.471930 9813 ts_tablet_manager.cc:1905] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.472002 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa393b1fc2b40ebb87df86180717db8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:48.472826 9220 leader_election.cc:341] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.474263 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1294) took 1529 ms. Trace:
I20260928 14:50:48.474852 9814 rpcz_store.cc:276] 0928 14:50:46.944164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:46.944383 (+ 219us) service_pool.cc:227] Handling call
0928 14:50:48.473237 (+1528854us) ts_tablet_manager.cc:1145] Deleting tablet fb7f3aeffb2a4a9683b728e17aa28d9d
0928 14:50:48.473249 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.474023 (+ 774us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528450}
I20260928 14:50:48.477748 9813 ts_tablet_manager.cc:1918] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.478080 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1296) took 1107 ms. Trace:
I20260928 14:50:48.478335 9815 ts_tablet_manager.cc:1918] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.478271 9814 rpcz_store.cc:276] 0928 14:50:47.371028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.371081 (+ 53us) service_pool.cc:227] Handling call
0928 14:50:48.477271 (+1106190us) ts_tablet_manager.cc:1145] Deleting tablet 3aa61fb67d494d8ab7dec29dbc5b61cc
0928 14:50:48.477924 (+ 653us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.478038 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1231616,"tablet-delete.queue_time_us":1106021}
I20260928 14:50:48.479435 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1297) took 1091 ms. Trace:
I20260928 14:50:48.479645 9814 rpcz_store.cc:276] 0928 14:50:47.388000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.388160 (+ 160us) service_pool.cc:227] Handling call
0928 14:50:48.479342 (+1091182us) ts_tablet_manager.cc:1145] Deleting tablet 3d263b3af1ef402b95affbfcd2aa7ed0
0928 14:50:48.479351 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.479420 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090981}
I20260928 14:50:48.479657 9815 log.cc:1196] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/69ef1340deca4f00a250c390afcb5064
I20260928 14:50:48.480212 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1298) took 1092 ms. Trace:
I20260928 14:50:48.480325 9814 rpcz_store.cc:276] 0928 14:50:47.388112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.388157 (+ 45us) service_pool.cc:227] Handling call
0928 14:50:48.480107 (+1091950us) ts_tablet_manager.cc:1145] Deleting tablet 89431db9b37d4d13a25cb736f67129bd
0928 14:50:48.480116 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.480197 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19,"tablet-delete.queue_time_us":1091742}
I20260928 14:50:48.480764 9814 tablet_replica.cc:330] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.481014 9814 raft_consensus.cc:2229] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.481194 9814 raft_consensus.cc:2258] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.480469 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.481715 9813 log.cc:1196] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/76ad7685ece44665896f687697bddccf
I20260928 14:50:48.482029 9813 ts_tablet_manager.cc:1939] T 76ad7685ece44665896f687697bddccf P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.481910 9815 ts_tablet_manager.cc:1939] T 69ef1340deca4f00a250c390afcb5064 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.482451 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b92039b9a484a768efa3714b58248ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.483172 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 76ad7685ece44665896f687697bddccf (table default.Table_c4ee932ad9e24a838fb0b64ff03ef0b7 [id=1f1b45ac877445d8bc3ca2c47cfb24d6]) successfully deleted
I20260928 14:50:48.483299 9813 tablet_replica.cc:330] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:48.483476 9813 raft_consensus.cc:2229] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:48.483534 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 9f2c5afbdeda4ddfb82124031135e6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f2c5afbdeda4ddfb82124031135e6cb already in progress: creating tablet
I20260928 14:50:48.483604 9813 raft_consensus.cc:2258] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.484058 9848 ts_tablet_manager.cc:1428] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260928 14:50:48.484483 9813 ts_tablet_manager.cc:1905] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.495334 9855 tablet_bootstrap.cc:492] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.495505 9855 ts_tablet_manager.cc:1397] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.124s user 0.005s sys 0.009s
I20260928 14:50:48.495582 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a78d6d6db7a1484498c7496ddbdc29fb
I20260928 14:50:48.495975 8949 catalog_manager.cc:6565] ReplaceTablet: tablet a78d6d6db7a1484498c7496ddbdc29fb deleted and replaced by tablet 04375426aa5d42528381227556d7f06d
I20260928 14:50:48.496193 9855 raft_consensus.cc:348] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.496448 9855 raft_consensus.cc:374] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.496565 9855 raft_consensus.cc:729] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.496773 9855 consensus_queue.cc:260] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.499009 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet be0ef95fd8b54b2ab140a77a74c75c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be0ef95fd8b54b2ab140a77a74c75c5c already in progress: creating tablet
I20260928 14:50:48.500290 9855 ts_tablet_manager.cc:1428] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260928 14:50:48.501098 9851 tablet_bootstrap.cc:492] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.501252 9851 ts_tablet_manager.cc:1397] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.002s
W20260928 14:50:48.501292 9220 consensus_peers.cc:487] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:48.501588 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet fb7f3aeffb2a4a9683b728e17aa28d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb7f3aeffb2a4a9683b728e17aa28d9d already in progress: creating tablet
W20260928 14:50:48.501817 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3aa61fb67d494d8ab7dec29dbc5b61cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa61fb67d494d8ab7dec29dbc5b61cc already in progress: creating tablet
W20260928 14:50:48.502033 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 3d263b3af1ef402b95affbfcd2aa7ed0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d263b3af1ef402b95affbfcd2aa7ed0 already in progress: creating tablet
I20260928 14:50:48.503015 9851 raft_consensus.cc:348] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.503219 9851 raft_consensus.cc:374] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.503275 9851 raft_consensus.cc:729] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
W20260928 14:50:48.502373 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 89431db9b37d4d13a25cb736f67129bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89431db9b37d4d13a25cb736f67129bd already in progress: creating tablet
I20260928 14:50:48.503525 9851 consensus_queue.cc:260] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.504058 9851 ts_tablet_manager.cc:1428] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260928 14:50:48.504300 9851 tablet_bootstrap.cc:492] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.507232 9851 tablet_bootstrap.cc:654] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.508325 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb with delete_type TABLET_DATA_DELETED (replaced by tablet 04375426aa5d42528381227556d7f06d) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.509155 9848 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.510692 9848 tablet_bootstrap.cc:654] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.515568 9814 ts_tablet_manager.cc:1905] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.516264 11548 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:48.517688 11535 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:48.522583 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb with delete_type TABLET_DATA_DELETED (replaced by tablet 04375426aa5d42528381227556d7f06d) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.522843 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet a78d6d6db7a1484498c7496ddbdc29fb with delete_type TABLET_DATA_DELETED (replaced by tablet 04375426aa5d42528381227556d7f06d) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.523255 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet 69ef1340deca4f00a250c390afcb5064 (table default.Table_63cbd45ae23a4ee7ac51f928b7613600 [id=2c9c5608bca44d7da4970e7173316f90]) successfully deleted
W20260928 14:50:48.523463 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c53c8bd0e124a2798d2a7f1e9595f1c already in progress: creating tablet
W20260928 14:50:48.524066 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 00b65284d7da4ee186d228c64a4013d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b65284d7da4ee186d228c64a4013d6 already in progress: creating tablet
W20260928 14:50:48.524245 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet e33ecd8df52d4355b187142ff61f24ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33ecd8df52d4355b187142ff61f24ef already in progress: creating tablet
W20260928 14:50:48.524456 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 989df9ccfce446008435161626ce4f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 989df9ccfce446008435161626ce4f5e already in progress: creating tablet
W20260928 14:50:48.524616 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 32e609be5acd42b48b6b7423cd56401a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e609be5acd42b48b6b7423cd56401a already in progress: creating tablet
W20260928 14:50:48.524809 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de77b0bec60a4ebbb0a1b6f779eaaf70 already in progress: creating tablet
W20260928 14:50:48.525012 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 72099e766c574246b38acb34ee369d2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72099e766c574246b38acb34ee369d2e already in progress: creating tablet
W20260928 14:50:48.525218 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet a78d6d6db7a1484498c7496ddbdc29fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78d6d6db7a1484498c7496ddbdc29fb already in progress: creating tablet
I20260928 14:50:48.525069 9855 tablet_bootstrap.cc:492] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
W20260928 14:50:48.526944 8956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09981dbe345a40e5b1fbb06abf491ea9 consensus state has no leader
I20260928 14:50:48.528532 9855 tablet_bootstrap.cc:654] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.529762 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2c5afbdeda4ddfb82124031135e6cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.537032 11519 raft_consensus.cc:482] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.537163 11519 raft_consensus.cc:504] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.537801 11519 leader_election.cc:288] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.538101 9851 tablet_bootstrap.cc:492] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.538220 9851 ts_tablet_manager.cc:1397] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20260928 14:50:48.538458 9813 ts_tablet_manager.cc:1918] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.538591 9813 log.cc:1196] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/2b92039b9a484a768efa3714b58248ef
W20260928 14:50:48.538659 9219 leader_election.cc:341] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 79f4b20a5e784d909f7297cc7f1b05e6
I20260928 14:50:48.538911 9813 ts_tablet_manager.cc:1939] T 2b92039b9a484a768efa3714b58248ef P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.539011 11454 raft_consensus.cc:482] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.539119 11454 raft_consensus.cc:504] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.539261 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f4b20a5e784d909f7297cc7f1b05e6" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.539605 11454 leader_election.cc:288] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.539803 9813 tablet_replica.cc:330] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
W20260928 14:50:48.539804 9220 leader_election.cc:341] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.539896 9220 leader_election.cc:302] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.539961 9813 raft_consensus.cc:2229] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.540086 9813 raft_consensus.cc:2258] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.540230 11519 raft_consensus.cc:2726] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.540498 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a067ac578184491c8862fcea2c0ffc43" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:48.541320 9497 leader_election.cc:341] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.541569 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 2b92039b9a484a768efa3714b58248ef (table default.Table_c0fd7600a4cc43e097236ff0f5cd78f9 [id=f313b904e0b14ada8899183fe701dc9e]) successfully deleted
W20260928 14:50:48.541817 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a78d6d6db7a1484498c7496ddbdc29fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78d6d6db7a1484498c7496ddbdc29fb already in progress: creating tablet
I20260928 14:50:48.542519 11556 tablet.cc:1722] T 5e325cbe459440cfa0f3cf9fd026cbb2 P ae832871bd1142f7af10c084115ffc12: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:48.543211 9851 raft_consensus.cc:348] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.544857 8955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_f1801703d3bc431788b7d33125736e7b [id=05fde8fccafd446eaec21e4d8de7071d] alter complete (version 1)
I20260928 14:50:48.553953 9814 ts_tablet_manager.cc:1918] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.554060 9814 log.cc:1196] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4a14c0b50cad4954b5dc5666689810ba
I20260928 14:50:48.543387 9851 raft_consensus.cc:374] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.554915 9851 raft_consensus.cc:729] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.556133 9851 consensus_queue.cc:260] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.556949 11454 raft_consensus.cc:482] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.557070 11454 raft_consensus.cc:504] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.557621 11454 leader_election.cc:288] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.558190 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e4ce1f9eed42abb3688716dc6733cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:48.558291 9851 ts_tablet_manager.cc:1428] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260928 14:50:48.558586 9851 tablet_bootstrap.cc:492] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:48.558724 9497 leader_election.cc:341] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.560241 9851 tablet_bootstrap.cc:654] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.561048 9848 tablet_bootstrap.cc:492] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.561618 9848 ts_tablet_manager.cc:1397] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260928 14:50:48.562911 9814 ts_tablet_manager.cc:1939] T 4a14c0b50cad4954b5dc5666689810ba P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.563584 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1300) took 1051 ms. Trace:
I20260928 14:50:48.563674 9814 rpcz_store.cc:276] 0928 14:50:47.511634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512079 (+ 445us) service_pool.cc:227] Handling call
0928 14:50:48.480730 (+968651us) ts_tablet_manager.cc:1145] Deleting tablet 4a14c0b50cad4954b5dc5666689810ba
0928 14:50:48.480739 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.530671 (+ 49932us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.553863 (+ 23192us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.563566 (+ 9703us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":968459}
I20260928 14:50:48.565052 9848 raft_consensus.cc:348] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.565254 9848 raft_consensus.cc:374] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.567480 9848 raft_consensus.cc:729] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.567698 9848 consensus_queue.cc:260] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.568409 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4a14c0b50cad4954b5dc5666689810ba (table default.Table_c7687d91f40d47c99ca2f22db2dd127d [id=c3261b896b04437fa936a693b88a6e01]) successfully deleted
I20260928 14:50:48.568699 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b75816a9816497ca6bc6ba8e5c5eb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.568874 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c5877a52264f0e9ebb070792e39e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:41 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.569007 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet 835ba6c803a34707b77bb8bc280b9e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:31 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.573236 9813 ts_tablet_manager.cc:1905] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.573380 9848 ts_tablet_manager.cc:1428] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260928 14:50:48.575042 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a067ac578184491c8862fcea2c0ffc43" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.575501 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e4ce1f9eed42abb3688716dc6733cf" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.576876 9498 leader_election.cc:341] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.577009 9498 leader_election.cc:302] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:48.577423 9498 leader_election.cc:341] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.577553 9498 leader_election.cc:302] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.577778 11454 raft_consensus.cc:2726] T a067ac578184491c8862fcea2c0ffc43 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.577909 11454 raft_consensus.cc:2726] T b6e4ce1f9eed42abb3688716dc6733cf P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.581204 9814 tablet_replica.cc:330] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.581552 9848 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.582888 9855 tablet_bootstrap.cc:492] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.583050 9855 ts_tablet_manager.cc:1397] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260928 14:50:48.583802 9855 raft_consensus.cc:348] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.584021 9855 raft_consensus.cc:374] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.584105 9855 raft_consensus.cc:729] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.584303 9855 consensus_queue.cc:260] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.584991 9855 ts_tablet_manager.cc:1428] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 14:50:48.587662 9855 tablet_bootstrap.cc:492] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:48.591511 9848 tablet_bootstrap.cc:654] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.592018 9814 raft_consensus.cc:2229] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.592175 9855 tablet_bootstrap.cc:654] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.592218 9814 raft_consensus.cc:2258] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.598037 9814 ts_tablet_manager.cc:1905] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.607523 9814 ts_tablet_manager.cc:1918] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.593984 9813 ts_tablet_manager.cc:1918] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.607769 9813 log.cc:1196] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/9f2c5afbdeda4ddfb82124031135e6cb
I20260928 14:50:48.608069 9813 ts_tablet_manager.cc:1939] T 9f2c5afbdeda4ddfb82124031135e6cb P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:48.608008 11519 consensus_queue.cc:1035] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:48.609018 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 9f2c5afbdeda4ddfb82124031135e6cb (table default.Table_fc1ba1d4357b4f88865fb323d86d0bc4 [id=b9da8f3786084226ae396c4c3a19b20b]) successfully deleted
I20260928 14:50:48.617293 9814 log.cc:1196] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/f39c1da071164342aea8eab263d4eebb
I20260928 14:50:48.617655 9814 ts_tablet_manager.cc:1939] T f39c1da071164342aea8eab263d4eebb P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.618108 9851 tablet_bootstrap.cc:492] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.618222 9851 ts_tablet_manager.cc:1397] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.003s
I20260928 14:50:48.618593 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1299) took 1107 ms. Trace:
I20260928 14:50:48.618717 9814 rpcz_store.cc:276] 0928 14:50:47.511509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512233 (+ 724us) service_pool.cc:227] Handling call
0928 14:50:48.581161 (+1068928us) ts_tablet_manager.cc:1145] Deleting tablet f39c1da071164342aea8eab263d4eebb
0928 14:50:48.581172 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.604633 (+ 23461us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.607453 (+ 2820us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.618575 (+ 11122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4220,"tablet-delete.queue_time_us":1068770}
I20260928 14:50:48.619239 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet f39c1da071164342aea8eab263d4eebb (table default.Table_8aeb62b2213c429f8c7dd5fdfbcc7e1d [id=b6d0a420047f44d5b8446d5d19b6ed04]) successfully deleted
I20260928 14:50:48.619287 9814 tablet_replica.cc:330] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.618865 9851 raft_consensus.cc:348] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.619459 9851 raft_consensus.cc:374] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.619544 9851 raft_consensus.cc:729] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.619750 9851 consensus_queue.cc:260] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.620018 9814 raft_consensus.cc:2229] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.620239 9851 ts_tablet_manager.cc:1428] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:48.622599 9814 raft_consensus.cc:2258] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.622947 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e4bc240e6f7c42949086a1f776e334a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.622706 9851 tablet_bootstrap.cc:492] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
W20260928 14:50:48.623667 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4bc240e6f7c42949086a1f776e334a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.624053 9814 ts_tablet_manager.cc:1905] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.625146 9851 tablet_bootstrap.cc:654] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.621038 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:48.635084 9848 tablet_bootstrap.cc:492] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.635257 9848 ts_tablet_manager.cc:1397] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.000s
I20260928 14:50:48.636020 9848 raft_consensus.cc:348] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.636433 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_505b9299e8c0438187bc0f61239bfae2" } modify_external_catalogs: true
I20260928 14:50:48.636603 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_505b9299e8c0438187bc0f61239bfae2" } modify_external_catalogs: true
I20260928 14:50:48.637096 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_8dafd1175a9e47c0a409ab3fe102592f" } new_table_name: "default.Table_95d9a4583f1542859543e0de96ea709e" modify_external_catalogs: true
I20260928 14:50:48.638366 8956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_56ac8188c64e44709eff9cb4c866c346" } modify_external_catalogs: true
I20260928 14:50:48.638504 8956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_56ac8188c64e44709eff9cb4c866c346" } modify_external_catalogs: true
I20260928 14:50:48.640664 9848 raft_consensus.cc:374] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.640780 9848 raft_consensus.cc:729] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.640864 11519 raft_consensus.cc:482] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.640971 11519 raft_consensus.cc:504] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.641546 11519 leader_election.cc:288] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:48.642469 9219 leader_election.cc:341] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 3b75816a9816497ca6bc6ba8e5c5eb3d
I20260928 14:50:48.646152 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c8f51416c17449a9888938d0d4153f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.646375 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_4fb8abbca8884313a91d62255eed40e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.646667 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8f51416c17449a9888938d0d4153f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:48.646842 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fb8abbca8884313a91d62255eed40e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.647775 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a6f653e4c8794146a3808ff8a255002d" } new_table_name: "default.Table_d4bf6cb842854d0690958002a203ed14" modify_external_catalogs: true
I20260928 14:50:48.648502 11519 raft_consensus.cc:482] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.648615 11519 raft_consensus.cc:504] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.649161 11519 leader_election.cc:288] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:48.650604 9219 leader_election.cc:341] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: c163d657ec4f40598d7f4f3879e6d817
W20260928 14:50:48.651615 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c665d5bc5b2149bbbfc29b6687474e40 consensus state has no leader
I20260928 14:50:48.652042 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_f51f672a539a4a42bfc9deaa1f2492d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.652487 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f51f672a539a4a42bfc9deaa1f2492d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.662000 11519 consensus_queue.cc:1035] T f4eeb2aa92a24b628156d34129f1381c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:48.663254 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9f8702d1414e418e9b4ec21e704f42e2" } new_table_name: "default.Table_c70256a013e0428f82e14e7cc03ef2d4" modify_external_catalogs: true
W20260928 14:50:48.664245 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ef7b4d3355f4b879060e9e40a3fd11a consensus state has no leader
I20260928 14:50:48.664580 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_261cbd2934a34c30938c1cefffb461ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.667459 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4bc8db2b069e4b2f892d9399ee7f5adf" } modify_external_catalogs: true
I20260928 14:50:48.667613 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_4bc8db2b069e4b2f892d9399ee7f5adf" } modify_external_catalogs: true
I20260928 14:50:48.672377 9814 ts_tablet_manager.cc:1918] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:48.673931 8939 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 9d0dc1a1900846bca0041da5bb918acd (table default.Table_87d7eb8e06534c33a789862af0dbfc1f [id=4a95041dcafe44cf915ebe7b5da47554], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9d0dc1a1900846bca0041da5bb918acd consensus state has no leader
W20260928 14:50:48.675781 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffa3fa2fab7c46419e5b13a933631295 consensus state has no leader
I20260928 14:50:48.676113 8950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e9859aeaaec84f258169f32308e91c31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.676555 8950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9859aeaaec84f258169f32308e91c31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.680446 9814 log.cc:1196] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/4744deca899b4e6caa57f70ce1df8a8d
W20260928 14:50:48.680505 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_261cbd2934a34c30938c1cefffb461ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.680852 9814 ts_tablet_manager.cc:1939] T 4744deca899b4e6caa57f70ce1df8a8d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.681559 9851 tablet_bootstrap.cc:492] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.681689 9851 ts_tablet_manager.cc:1397] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.005s
I20260928 14:50:48.681874 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1304) took 1169 ms. Trace:
I20260928 14:50:48.681994 9814 rpcz_store.cc:276] 0928 14:50:47.512061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512331 (+ 270us) service_pool.cc:227] Handling call
0928 14:50:48.619245 (+1106914us) ts_tablet_manager.cc:1145] Deleting tablet 4744deca899b4e6caa57f70ce1df8a8d
0928 14:50:48.619256 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.638475 (+ 19219us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.672272 (+ 33797us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.681853 (+ 9581us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1106794}
I20260928 14:50:48.682453 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 4744deca899b4e6caa57f70ce1df8a8d (table default.Table_ab677e004fee49e4882b664fb17465d4 [id=0a4962670d0a43b2aac92a73a5fb69cf]) successfully deleted
I20260928 14:50:48.682458 9851 raft_consensus.cc:348] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.682683 9851 raft_consensus.cc:374] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.682746 9851 raft_consensus.cc:729] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.682927 9851 consensus_queue.cc:260] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.682925 9814 tablet_replica.cc:330] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.683413 9814 raft_consensus.cc:2229] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.683569 9814 raft_consensus.cc:2258] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.684051 9814 ts_tablet_manager.cc:1905] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.689486 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_db83f8c905e54fbeb75b212120f77ba7" } new_table_name: "default.Table_b60d5338abb24a4b8f03f655152245cb" modify_external_catalogs: true
I20260928 14:50:48.689903 9851 ts_tablet_manager.cc:1428] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:48.690178 9851 tablet_bootstrap.cc:492] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.694187 9814 ts_tablet_manager.cc:1918] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.698997 9814 log.cc:1196] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/2ebd54cdc07549e5b7cb179f4ab3aa9f
I20260928 14:50:48.699370 9814 ts_tablet_manager.cc:1939] T 2ebd54cdc07549e5b7cb179f4ab3aa9f P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.699685 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1301) took 1187 ms. Trace:
I20260928 14:50:48.699815 9814 rpcz_store.cc:276] 0928 14:50:47.511759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512411 (+ 652us) service_pool.cc:227] Handling call
0928 14:50:48.682884 (+1170473us) ts_tablet_manager.cc:1145] Deleting tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f
0928 14:50:48.682896 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.691528 (+ 8632us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.694098 (+ 2570us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.699655 (+ 5557us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1170287}
I20260928 14:50:48.700239 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 2ebd54cdc07549e5b7cb179f4ab3aa9f (table default.Table_b7a4bbe399d049febce65ba67480aa5b [id=c7da048bc94343ceb9f28c8b810d8505]) successfully deleted
I20260928 14:50:48.701742 9814 tablet_replica.cc:330] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.701968 9814 raft_consensus.cc:2229] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.702198 9814 raft_consensus.cc:2258] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.702991 9814 ts_tablet_manager.cc:1905] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.704078 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_88b2f18d021948e58d6010ac127ac782"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.704600 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88b2f18d021948e58d6010ac127ac782 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.706370 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_951f708456f94cd18c077cef81046c15" } modify_external_catalogs: true
I20260928 14:50:48.706525 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_951f708456f94cd18c077cef81046c15" } modify_external_catalogs: true
I20260928 14:50:48.694790 9851 tablet_bootstrap.cc:654] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.708438 8955 catalog_manager.cc:5495] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:48.708899 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 5b171a26e7e643c9bc98c580b7bae60f (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]). Expected version 2 got 0
I20260928 14:50:48.709152 8955 catalog_manager.cc:5495] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:48.709563 8955 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6aa393b1fc2b40ebb87df86180717db8 (table default.Table_0b822e5685d1472b8e5cb2ef43cd0f4d [id=a325eabc142d47b88dae65aaba6082c1]). Expected version 1 got 0
I20260928 14:50:48.710400 8953 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_38b8fb0e45f647cd87ab318cd0df691c [id=60a3f0e030a14328954dec3e57514b83] alter complete (version 1)
I20260928 14:50:48.710959 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf" } modify_external_catalogs: true
I20260928 14:50:48.711042 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ef1340deca4f00a250c390afcb5064 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.711125 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_cf7c5f32aea54e83aab4ab6f81d7b7bf" } modify_external_catalogs: true
W20260928 14:50:48.711635 8939 catalog_manager.cc:4808] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 69ef1340deca4f00a250c390afcb5064 because the tablet was not found. No further retry: Not found: Tablet not found: 69ef1340deca4f00a250c390afcb5064
I20260928 14:50:48.712215 8946 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_a78b821ee2e0447fba1bd3b49e74e732 [id=b59cd90b4cc5420fbf378dc148eb2278] alter complete (version 2)
I20260928 14:50:48.715068 9814 ts_tablet_manager.cc:1918] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.716392 9814 log.cc:1196] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8af72ac7bedb4cd7aed28cffda867c96
I20260928 14:50:48.716732 9814 ts_tablet_manager.cc:1939] T 8af72ac7bedb4cd7aed28cffda867c96 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.717375 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1305) took 1205 ms. Trace:
I20260928 14:50:48.718726 9267 tablet_service.cc:1467] Processing CreateTablet for tablet d1fa2499d2f44392ae11f2f88854545d (DEFAULT_TABLE table=default.Table_d2bb4944eca84689ba20b5d635022eac [id=13508ea598e74cee9c6bc0c2a3a90d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.722594 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fa2499d2f44392ae11f2f88854545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.734197 9814 rpcz_store.cc:276] 0928 14:50:47.512162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512401 (+ 239us) service_pool.cc:227] Handling call
0928 14:50:48.701686 (+1189285us) ts_tablet_manager.cc:1145] Deleting tablet 8af72ac7bedb4cd7aed28cffda867c96
0928 14:50:48.701696 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.710285 (+ 8589us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.714987 (+ 4702us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.717346 (+ 2359us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189108}
I20260928 14:50:48.734628 9851 tablet_bootstrap.cc:492] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.734700 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8af72ac7bedb4cd7aed28cffda867c96 (table default.Table_cea129f875fa43ee92facec9a977a47e [id=a4802fba8b2c4291864aaa9ce687f468]) successfully deleted
I20260928 14:50:48.734758 9851 ts_tablet_manager.cc:1397] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.004s
I20260928 14:50:48.735395 9851 raft_consensus.cc:348] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.735612 9851 raft_consensus.cc:374] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.735680 9851 raft_consensus.cc:729] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.735796 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1302) took 1223 ms. Trace:
I20260928 14:50:48.735857 9851 consensus_queue.cc:260] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.735903 9814 rpcz_store.cc:276] 0928 14:50:47.511848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512584 (+ 736us) service_pool.cc:227] Handling call
0928 14:50:48.735003 (+1222419us) ts_tablet_manager.cc:1145] Deleting tablet 7aa9167742a94a0ab586e15205a0ccdc
0928 14:50:48.735013 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.735780 (+ 767us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1222300}
I20260928 14:50:48.736338 9851 ts_tablet_manager.cc:1428] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260928 14:50:48.736399 8939 catalog_manager.cc:4808] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 7aa9167742a94a0ab586e15205a0ccdc because the tablet was not found. No further retry: Not found: Tablet not found: 7aa9167742a94a0ab586e15205a0ccdc
I20260928 14:50:48.736572 9851 tablet_bootstrap.cc:492] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.736673 8956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 07eecd79a28446f49ecc3c931ffb8b67
I20260928 14:50:48.736732 9814 tablet_replica.cc:330] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.737108 8952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 546a0b9b92404b9db1e02cf3f77feda1
I20260928 14:50:48.737504 8952 catalog_manager.cc:6565] ReplaceTablet: tablet 546a0b9b92404b9db1e02cf3f77feda1 deleted and replaced by tablet aca84539ca214cfcaa8de40f7cec38fe
I20260928 14:50:48.738632 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 with delete_type TABLET_DATA_DELETED (replaced by tablet aca84539ca214cfcaa8de40f7cec38fe) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.739625 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.739702 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 546a0b9b92404b9db1e02cf3f77feda1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 546a0b9b92404b9db1e02cf3f77feda1 already in progress: creating tablet
W20260928 14:50:48.740224 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f421b29c12cb4b5989de6bebcf04639f consensus state has no leader
W20260928 14:50:48.740603 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 07eecd79a28446f49ecc3c931ffb8b67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07eecd79a28446f49ecc3c931ffb8b67 already in progress: creating tablet
I20260928 14:50:48.737953 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.739075 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 with delete_type TABLET_DATA_DELETED (replaced by tablet aca84539ca214cfcaa8de40f7cec38fe) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.740255 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cf2eb5b59649e099da1947c4ccf430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:40 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.740295 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet c163d657ec4f40598d7f4f3879e6d817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.736963 9814 raft_consensus.cc:2229] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.740300 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet e5cb151d58f545d9b1e6f652a0627ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:37 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.742481 9814 raft_consensus.cc:2258] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.742924 9814 ts_tablet_manager.cc:1905] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.747893 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet ab6ccac2580049a5a615d8d36a44f373 (table default.Table_80bae2129fb24491b999a368ecb99d3f [id=9793280eca254a92865bde9e52fe4588]). Expected version 1 got 0
I20260928 14:50:48.748097 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b14339044619424c9be020fa99ad681e (table default.Table_3f7ee04cf1f44625a52bf577f216c98b [id=921a3c5cf74b41b6bde6987563b81319]). Expected version 2 got 0
I20260928 14:50:48.749603 9258 tablet_service.cc:1514] Processing DeleteTablet for tablet 58bb9c7fc599425484fd3fc0b94f3a8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.749686 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 1016ad6219294ccd829fca9b264ab06f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:29 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.752053 9851 tablet_bootstrap.cc:654] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.755203 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 3b5fa33bfc194aafa72f79656f8492d2
I20260928 14:50:48.756342 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.756780 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:48.757138 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 3b5fa33bfc194aafa72f79656f8492d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5fa33bfc194aafa72f79656f8492d2 already in progress: creating tablet
I20260928 14:50:48.762015 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7172211cb181487a98a1562c371635ef
I20260928 14:50:48.763212 8953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b6854864679c4e3e97698d1c59b9cc58" } new_table_name: "default.Table_755b7e0a8a6d4f8bbe31f925442274a1" modify_external_catalogs: true
I20260928 14:50:48.763589 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet 7172211cb181487a98a1562c371635ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.764334 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet 7172211cb181487a98a1562c371635ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7172211cb181487a98a1562c371635ef already in progress: creating tablet
I20260928 14:50:48.764497 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet f6a7726d4ce54195825969142808210a
I20260928 14:50:48.765002 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet 7172211cb181487a98a1562c371635ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.765347 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2425395ba970422da86c42de4d7496e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.765787 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a7726d4ce54195825969142808210a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.765901 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2425395ba970422da86c42de4d7496e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.766654 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a7726d4ce54195825969142808210a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
W20260928 14:50:48.766906 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet f6a7726d4ce54195825969142808210a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6a7726d4ce54195825969142808210a already in progress: creating tablet
I20260928 14:50:48.767395 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_0d658ac8d0b744e69be107b6c5646703"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.768097 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d658ac8d0b744e69be107b6c5646703 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.769335 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_e4fe80af08274e86b760363cd4099d45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.769912 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4fe80af08274e86b760363cd4099d45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.770725 9814 ts_tablet_manager.cc:1918] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.771104 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bb09b496476948e2a4f3652c75800e36
I20260928 14:50:48.771219 9814 log.cc:1196] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/8a06859c8dcc41d99d29365aae350afa
I20260928 14:50:48.771754 9262 tablet_service.cc:1514] Processing DeleteTablet for tablet bb09b496476948e2a4f3652c75800e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.772073 9530 tablet_service.cc:1514] Processing DeleteTablet for tablet bb09b496476948e2a4f3652c75800e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.772753 8939 catalog_manager.cc:4821] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): delete failed for tablet bb09b496476948e2a4f3652c75800e36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb09b496476948e2a4f3652c75800e36 already in progress: creating tablet
I20260928 14:50:48.773192 9814 ts_tablet_manager.cc:1939] T 8a06859c8dcc41d99d29365aae350afa P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.775961 9530 tablet_service.cc:1467] Processing CreateTablet for tablet d1fa2499d2f44392ae11f2f88854545d (DEFAULT_TABLE table=default.Table_d2bb4944eca84689ba20b5d635022eac [id=13508ea598e74cee9c6bc0c2a3a90d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.776330 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fa2499d2f44392ae11f2f88854545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.779904 9258 tablet_service.cc:1467] Processing CreateTablet for tablet bf30604c9f8744f0b50a695d6d66f636 (DEFAULT_TABLE table=default.Table_69dc3a6a9ade4bc3b50d2dc2dbb46e56 [id=b6c94d5fac884d2eae90563ace7059dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.780061 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 344d170958304a4696ed7be6ba31ec5d (DEFAULT_TABLE table=default.Table_75304f55867447f7ada1e41743a14d80 [id=a69899be25e041f3aecd42c9aca09172]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.780321 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf30604c9f8744f0b50a695d6d66f636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.780596 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 2ae2527cacfb47beac5a7c1c18c7de66 (DEFAULT_TABLE table=default.Table_2e9567134a664658bb9e2dc94673889d [id=3d2cc890761841188f05826f6d2f71c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.780870 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ae2527cacfb47beac5a7c1c18c7de66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.782511 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 344d170958304a4696ed7be6ba31ec5d (DEFAULT_TABLE table=default.Table_75304f55867447f7ada1e41743a14d80 [id=a69899be25e041f3aecd42c9aca09172]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.782859 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d170958304a4696ed7be6ba31ec5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.784927 11567 raft_consensus.cc:482] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.785054 11567 raft_consensus.cc:504] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.785243 8953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1ec95a7fd4a41ebab4e7adc1da2f06a consensus state has no leader
I20260928 14:50:48.785737 11567 leader_election.cc:288] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.785770 9545 tablet_service.cc:1467] Processing CreateTablet for tablet bf30604c9f8744f0b50a695d6d66f636 (DEFAULT_TABLE table=default.Table_69dc3a6a9ade4bc3b50d2dc2dbb46e56 [id=b6c94d5fac884d2eae90563ace7059dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.786052 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf30604c9f8744f0b50a695d6d66f636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.786860 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8738a1591f644758f44fc720fd694a3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:48.787374 9497 leader_election.cc:341] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.789750 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 2ae2527cacfb47beac5a7c1c18c7de66 (DEFAULT_TABLE table=default.Table_2e9567134a664658bb9e2dc94673889d [id=3d2cc890761841188f05826f6d2f71c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.790019 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ae2527cacfb47beac5a7c1c18c7de66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.795569 9855 tablet_bootstrap.cc:492] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.795778 9855 ts_tablet_manager.cc:1397] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.208s user 0.003s sys 0.003s
I20260928 14:50:48.796955 9855 raft_consensus.cc:348] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.797254 9855 raft_consensus.cc:374] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.797369 9855 raft_consensus.cc:729] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.798133 9258 tablet_service.cc:1467] Processing CreateTablet for tablet e6796992a4af4d058aaea6267476ebb1 (DEFAULT_TABLE table=default.Table_1c39903274b94d039d5579a95fe7b43f [id=54e2515b614c4148a46308ef4e59c38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.798285 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d170958304a4696ed7be6ba31ec5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.798444 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6796992a4af4d058aaea6267476ebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.801800 9541 tablet_service.cc:1467] Processing CreateTablet for tablet e6796992a4af4d058aaea6267476ebb1 (DEFAULT_TABLE table=default.Table_1c39903274b94d039d5579a95fe7b43f [id=54e2515b614c4148a46308ef4e59c38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.802135 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6796992a4af4d058aaea6267476ebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.809897 9265 tablet_service.cc:1467] Processing CreateTablet for tablet ebe7ad56a6474fe590b6f609cb65a22a (DEFAULT_TABLE table=default.Table_4787d935cdb34bb896342dfcc4554ff4 [id=48db5abbdff04adc8dff1d0b55d44665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.810302 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebe7ad56a6474fe590b6f609cb65a22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.825412 9616 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:48.827206 9851 tablet_bootstrap.cc:492] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.827347 9851 ts_tablet_manager.cc:1397] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.091s user 0.014s sys 0.018s
I20260928 14:50:48.797715 9855 consensus_queue.cc:260] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.830035 9855 ts_tablet_manager.cc:1428] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260928 14:50:48.830436 9855 tablet_bootstrap.cc:492] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:48.833110 9855 tablet_bootstrap.cc:654] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.839252 9851 raft_consensus.cc:348] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.839469 9851 raft_consensus.cc:374] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.839540 9851 raft_consensus.cc:729] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.839728 9851 consensus_queue.cc:260] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.840265 9851 ts_tablet_manager.cc:1428] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260928 14:50:48.840571 9851 tablet_bootstrap.cc:492] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.850535 9851 tablet_bootstrap.cc:654] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.860154 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet baa80c213f3f4aa9976cc285f6564e0f (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0]). Expected version 1 got 0
I20260928 14:50:48.860356 8949 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:48.860643 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c03ebae35c8140d3a70d796eaea31cf5" } new_table_name: "default.Table_0da21ec58a7a47c2a2d3a2c03014f64e" modify_external_catalogs: true
W20260928 14:50:48.861222 8949 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet baa80c213f3f4aa9976cc285f6564e0f (table default.Table_5691c7f9b2304012b66ce7f4b04cf947 [id=8e08aed3de5c419d93d07f973b1baef0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet baa80c213f3f4aa9976cc285f6564e0f consensus state has no leader
I20260928 14:50:48.860317 9855 tablet_bootstrap.cc:492] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:48.861935 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_81ba7c5a39da4e10a05e04cc6b22a618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.862257 9855 ts_tablet_manager.cc:1397] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
W20260928 14:50:48.862502 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81ba7c5a39da4e10a05e04cc6b22a618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.863662 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet b6fed86d9eda45cab2083fca73825383 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:46 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.863637 9855 raft_consensus.cc:348] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.864015 9855 raft_consensus.cc:374] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.865618 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1303) took 1353 ms. Trace:
I20260928 14:50:48.867266 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_c7e20b9cfeb940d89fd784f8f893b26a" } new_table_name: "default.Table_ce368de55c6b4956abbfdb93e74eed7c" modify_external_catalogs: true
I20260928 14:50:48.867326 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_b13e44d3602a48cb8cc1c98a74ca52a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.867957 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b13e44d3602a48cb8cc1c98a74ca52a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.643590 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b75816a9816497ca6bc6ba8e5c5eb3d" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.649946 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c163d657ec4f40598d7f4f3879e6d817" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.869741 9848 consensus_queue.cc:260] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.739876 9395 tablet_service.cc:1514] Processing DeleteTablet for tablet 07eecd79a28446f49ecc3c931ffb8b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.740010 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 546a0b9b92404b9db1e02cf3f77feda1 with delete_type TABLET_DATA_DELETED (replaced by tablet aca84539ca214cfcaa8de40f7cec38fe) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.870376 9848 ts_tablet_manager.cc:1428] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.235s user 0.001s sys 0.000s
I20260928 14:50:48.870428 8955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_be7c0956d81c441ebf7a933d90801c93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.756111 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5fa33bfc194aafa72f79656f8492d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.763020 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 7172211cb181487a98a1562c371635ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.765048 9389 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a7726d4ce54195825969142808210a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.771963 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet bb09b496476948e2a4f3652c75800e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:48.776371 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 344d170958304a4696ed7be6ba31ec5d (DEFAULT_TABLE table=default.Table_75304f55867447f7ada1e41743a14d80 [id=a69899be25e041f3aecd42c9aca09172]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:48.870879 8955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be7c0956d81c441ebf7a933d90801c93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:48.871003 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 07eecd79a28446f49ecc3c931ffb8b67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07eecd79a28446f49ecc3c931ffb8b67 already in progress: creating tablet
I20260928 14:50:48.871106 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d170958304a4696ed7be6ba31ec5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:48.871258 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 546a0b9b92404b9db1e02cf3f77feda1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 546a0b9b92404b9db1e02cf3f77feda1 already in progress: creating tablet
I20260928 14:50:48.871637 9814 rpcz_store.cc:276] 0928 14:50:47.511955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.512724 (+ 769us) service_pool.cc:227] Handling call
0928 14:50:48.736697 (+1223973us) ts_tablet_manager.cc:1145] Deleting tablet 8a06859c8dcc41d99d29365aae350afa
0928 14:50:48.736706 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.748549 (+ 11843us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.770636 (+ 22087us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.865597 (+ 94961us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223872}
I20260928 14:50:48.871964 9814 tablet_replica.cc:330] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.872174 9814 raft_consensus.cc:2229] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 14:50:48.872503 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 3b5fa33bfc194aafa72f79656f8492d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5fa33bfc194aafa72f79656f8492d2 already in progress: creating tablet
W20260928 14:50:48.872707 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7172211cb181487a98a1562c371635ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7172211cb181487a98a1562c371635ef already in progress: creating tablet
W20260928 14:50:48.872881 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet f6a7726d4ce54195825969142808210a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6a7726d4ce54195825969142808210a already in progress: creating tablet
W20260928 14:50:48.873059 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bb09b496476948e2a4f3652c75800e36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb09b496476948e2a4f3652c75800e36 already in progress: creating tablet
I20260928 14:50:48.777597 9398 tablet_service.cc:1467] Processing CreateTablet for tablet bf30604c9f8744f0b50a695d6d66f636 (DEFAULT_TABLE table=default.Table_69dc3a6a9ade4bc3b50d2dc2dbb46e56 [id=b6c94d5fac884d2eae90563ace7059dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.873804 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf30604c9f8744f0b50a695d6d66f636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.873733 9408 tablet_service.cc:1467] Processing CreateTablet for tablet ee1a4d70f58740f3931b572ad011d7f0 (DEFAULT_TABLE table=default.Table_a9c5bc4389eb4abcae54f80fa93ea23b [id=7d68deb14500457eae7002f51650e26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.779004 9399 tablet_service.cc:1467] Processing CreateTablet for tablet 2ae2527cacfb47beac5a7c1c18c7de66 (DEFAULT_TABLE table=default.Table_2e9567134a664658bb9e2dc94673889d [id=3d2cc890761841188f05826f6d2f71c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.781270 9402 tablet_service.cc:1467] Processing CreateTablet for tablet e6796992a4af4d058aaea6267476ebb1 (DEFAULT_TABLE table=default.Table_1c39903274b94d039d5579a95fe7b43f [id=54e2515b614c4148a46308ef4e59c38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.786299 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8738a1591f644758f44fc720fd694a3" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.799839 9396 tablet_service.cc:1467] Processing CreateTablet for tablet ebe7ad56a6474fe590b6f609cb65a22a (DEFAULT_TABLE table=default.Table_4787d935cdb34bb896342dfcc4554ff4 [id=48db5abbdff04adc8dff1d0b55d44665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.717741 9388 tablet_service.cc:1467] Processing CreateTablet for tablet d1fa2499d2f44392ae11f2f88854545d (DEFAULT_TABLE table=default.Table_d2bb4944eca84689ba20b5d635022eac [id=13508ea598e74cee9c6bc0c2a3a90d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.874068 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1a4d70f58740f3931b572ad011d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.876919 9851 tablet_bootstrap.cc:492] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.877045 9851 ts_tablet_manager.cc:1397] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.004s
I20260928 14:50:48.877849 9851 raft_consensus.cc:348] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.878055 9851 raft_consensus.cc:374] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.878114 9851 raft_consensus.cc:729] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.878310 9851 consensus_queue.cc:260] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.880522 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebe7ad56a6474fe590b6f609cb65a22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.881639 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fa2499d2f44392ae11f2f88854545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.883529 9848 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.872331 9814 raft_consensus.cc:2258] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.884969 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 19a647f5070a4941b8a323cff888d9ba (DEFAULT_TABLE table=default.Table_6f880fe191e64e179c0759d9af7a04ef [id=a5415df22523452185584443a54fc563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.885257 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a647f5070a4941b8a323cff888d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.885270 9851 ts_tablet_manager.cc:1428] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260928 14:50:48.888722 9851 tablet_bootstrap.cc:492] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:48.889674 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6796992a4af4d058aaea6267476ebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.890796 9851 tablet_bootstrap.cc:654] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.894289 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ae2527cacfb47beac5a7c1c18c7de66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.894397 9814 ts_tablet_manager.cc:1905] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 14:50:48.895679 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5948def5cf7412da8cc128382a93854 consensus state has no leader
I20260928 14:50:48.897928 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 15b6525b5aa3418493a4f6784c844da8 (DEFAULT_TABLE table=default.Table_81003e03666547ae85a4f991627f4342 [id=ffca2f8cab6d42288f7ed8eb5b803c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.898254 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b6525b5aa3418493a4f6784c844da8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:48.899652 9219 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.3:44119, user_credentials={real_user=slave}} blocked reactor thread for 60468.4us
I20260928 14:50:48.899891 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_913562ddcab248f1a1110fa7c294555e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:48.900203 11519 raft_consensus.cc:482] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.900323 11519 raft_consensus.cc:504] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:48.900417 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_913562ddcab248f1a1110fa7c294555e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.901054 11519 leader_election.cc:288] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.901160 11519 raft_consensus.cc:482] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.901280 11519 raft_consensus.cc:504] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.901949 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 595e389927344db39efef82d720c6cf5 (DEFAULT_TABLE table=default.Table_d4d3fae1326a4235b6726c1a426933b0 [id=e309736c2c3b4da1a77ce74ffc91afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.902256 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595e389927344db39efef82d720c6cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.905033 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 5169a160d9344439b4feafa2956d6e4e (DEFAULT_TABLE table=default.Table_268a79e835004ddaa114b663c8be3a9c [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.905325 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5169a160d9344439b4feafa2956d6e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.906203 8950 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:48.906309 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 63f76308689b41a99e06155e1faf6c9e (DEFAULT_TABLE table=default.Table_5d170acaccec431ea5615b6d6a5b1dc8 [id=53d4a02091024310a11ea6be1b8b4ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.906601 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f76308689b41a99e06155e1faf6c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.907022 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_60c73d25d3054ca993b1265a0f1b07ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.907506 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60c73d25d3054ca993b1265a0f1b07ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.910240 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 7a8dc216f5ed4f55aad81a7d062d65e5 (DEFAULT_TABLE table=default.Table_15d64ced631d4320b048b959d33ffc95 [id=396495b594e8402ab6b46849707f8196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.910511 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a8dc216f5ed4f55aad81a7d062d65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.910977 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_49c6b3a78d8c4a1884368286ae9121ce" } new_table_name: "default.Table_ce7410694ef448d297fc74f314ddf997" modify_external_catalogs: true
W20260928 14:50:48.916765 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5 consensus state has no leader
I20260928 14:50:48.917587 11519 leader_election.cc:288] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:48.917649 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_42f0f2137f854376a68246c5f0a9ddf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.918134 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42f0f2137f854376a68246c5f0a9ddf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.921856 9848 tablet_bootstrap.cc:654] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:48.870345 9220 leader_election.cc:341] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.922071 9220 leader_election.cc:302] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:48.922349 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 52014.8us
W20260928 14:50:48.922582 9220 leader_election.cc:341] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.922695 9220 leader_election.cc:302] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.923202 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 8a06859c8dcc41d99d29365aae350afa (table default.Table_0a630d2e9d7646848b9fb2eb0cf2afb6 [id=f196eca6e1684226838473c20f860ae7]) successfully deleted
I20260928 14:50:48.924675 11223 raft_consensus.cc:2726] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.924800 11223 raft_consensus.cc:2726] T c163d657ec4f40598d7f4f3879e6d817 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.924902 11223 consensus_queue.cc:1035] T 9df6b94b5aa24ff8a7fce8ba397e51e8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:48.925441 11223 consensus_queue.cc:1035] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 14:50:48.926478 9219 leader_election.cc:341] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: d7cf2eb5b59649e099da1947c4ccf430
W20260928 14:50:48.926652 9219 leader_election.cc:341] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: e5cb151d58f545d9b1e6f652a0627ab9
I20260928 14:50:48.926836 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cf2eb5b59649e099da1947c4ccf430" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.928498 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5cb151d58f545d9b1e6f652a0627ab9" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:48.929692 9253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a70f70162c2433aab5136514bd5fc03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:28 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:48.930680 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 19a647f5070a4941b8a323cff888d9ba (DEFAULT_TABLE table=default.Table_6f880fe191e64e179c0759d9af7a04ef [id=a5415df22523452185584443a54fc563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.931046 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a647f5070a4941b8a323cff888d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.934147 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 595e389927344db39efef82d720c6cf5 (DEFAULT_TABLE table=default.Table_d4d3fae1326a4235b6726c1a426933b0 [id=e309736c2c3b4da1a77ce74ffc91afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.934264 9406 tablet_service.cc:1467] Processing CreateTablet for tablet 07edb0fbdaec4ab4a1b6d15928371875 (DEFAULT_TABLE table=default.Table_dc898131e89843239e49e12bc33e2f16 [id=20e56ef1f0de41d28c4fd4dfcdafd10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.934497 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595e389927344db39efef82d720c6cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.934573 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07edb0fbdaec4ab4a1b6d15928371875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.935706 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 544214fc046e4fb198ad7882c7bdb5ce (DEFAULT_TABLE table=default.Table_bdb5e6bdf6c2409083a9005843fd5038 [id=efc12307397e48c4825d93e3c0b3fb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.935988 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544214fc046e4fb198ad7882c7bdb5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.936564 9267 tablet_service.cc:1467] Processing CreateTablet for tablet ee1a4d70f58740f3931b572ad011d7f0 (DEFAULT_TABLE table=default.Table_a9c5bc4389eb4abcae54f80fa93ea23b [id=7d68deb14500457eae7002f51650e26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.936875 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1a4d70f58740f3931b572ad011d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.938508 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 15b6525b5aa3418493a4f6784c844da8 (DEFAULT_TABLE table=default.Table_81003e03666547ae85a4f991627f4342 [id=ffca2f8cab6d42288f7ed8eb5b803c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.938851 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b6525b5aa3418493a4f6784c844da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.940099 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7be75ca96434082812ba760c0927f0c" } modify_external_catalogs: true
I20260928 14:50:48.940280 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b7be75ca96434082812ba760c0927f0c" } modify_external_catalogs: true
W20260928 14:50:48.944115 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca9a7f49a6f04e9b876b30058453bd53 consensus state has no leader
I20260928 14:50:48.947659 8952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_418b08bd5d904c26a7bcaab5e001e951" } new_table_name: "default.Table_559e238acd7443cf9f83d42f7f324660" modify_external_catalogs: true
I20260928 14:50:48.948915 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_1711c965c5d349e3bc63dfe7f2f99ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:48.949394 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1711c965c5d349e3bc63dfe7f2f99ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:48.951282 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 0c2e009d7583468aa27edab707d3bd08 (DEFAULT_TABLE table=default.Table_0b0b0c911845433ab88161b3e5a54baa [id=d8c7d87804d7423fb46269ddcac89cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.951584 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c2e009d7583468aa27edab707d3bd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.953775 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet bda4f5da7a6b4a4e867d4e260a274d2a
I20260928 14:50:48.955015 9396 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:48.955585 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet bda4f5da7a6b4a4e867d4e260a274d2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda4f5da7a6b4a4e867d4e260a274d2a already in progress: creating tablet
I20260928 14:50:48.958498 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a235a0c6603143439c7a545281e9754a" } modify_external_catalogs: true
I20260928 14:50:48.958719 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a235a0c6603143439c7a545281e9754a" } modify_external_catalogs: true
W20260928 14:50:48.960173 8952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eb46d0ad95c4deaa95ef0205578aabc consensus state has no leader
I20260928 14:50:48.961342 9848 tablet_bootstrap.cc:492] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:48.961447 9848 ts_tablet_manager.cc:1397] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.000s
I20260928 14:50:48.962126 9848 raft_consensus.cc:348] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.962307 9848 raft_consensus.cc:374] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:48.962353 9848 raft_consensus.cc:729] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.962527 9848 consensus_queue.cc:260] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:48.962996 9848 ts_tablet_manager.cc:1428] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:48.963207 9848 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:48.964718 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a7c87abccc9e4738a131a19f0fd15b13" } modify_external_catalogs: true
I20260928 14:50:48.964880 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a7c87abccc9e4738a131a19f0fd15b13" } modify_external_catalogs: true
I20260928 14:50:48.966259 9851 tablet_bootstrap.cc:492] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:48.966384 9851 ts_tablet_manager.cc:1397] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.003s
I20260928 14:50:48.966961 8951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b60092af06a64e498cebe5e021e56247" } modify_external_catalogs: true
I20260928 14:50:48.967109 8951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_b60092af06a64e498cebe5e021e56247" } modify_external_catalogs: true
I20260928 14:50:48.967932 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 5169a160d9344439b4feafa2956d6e4e (DEFAULT_TABLE table=default.Table_268a79e835004ddaa114b663c8be3a9c [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.864321 9541 tablet_service.cc:1514] Processing DeleteTablet for tablet b8738a1591f644758f44fc720fd694a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:32 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.968319 8952 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:48.871436 9533 tablet_service.cc:1467] Processing CreateTablet for tablet ebe7ad56a6474fe590b6f609cb65a22a (DEFAULT_TABLE table=default.Table_4787d935cdb34bb896342dfcc4554ff4 [id=48db5abbdff04adc8dff1d0b55d44665]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:48.874962 9617 tablet.cc:2369] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:48.874940 9545 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9cedadc7184013a37857206bec2ff0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:30 UTC) from {username='slave'} at 127.0.0.1:37336
W20260928 14:50:48.875233 9498 leader_election.cc:341] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.880667 9537 tablet_service.cc:1467] Processing CreateTablet for tablet ee1a4d70f58740f3931b572ad011d7f0 (DEFAULT_TABLE table=default.Table_a9c5bc4389eb4abcae54f80fa93ea23b [id=7d68deb14500457eae7002f51650e26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.891839 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 19a647f5070a4941b8a323cff888d9ba (DEFAULT_TABLE table=default.Table_6f880fe191e64e179c0759d9af7a04ef [id=a5415df22523452185584443a54fc563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.969405 9848 tablet_bootstrap.cc:654] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:48.904453 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 7a8dc216f5ed4f55aad81a7d062d65e5 (DEFAULT_TABLE table=default.Table_15d64ced631d4320b048b959d33ffc95 [id=396495b594e8402ab6b46849707f8196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.909193 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 15b6525b5aa3418493a4f6784c844da8 (DEFAULT_TABLE table=default.Table_81003e03666547ae85a4f991627f4342 [id=ffca2f8cab6d42288f7ed8eb5b803c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.909776 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 5169a160d9344439b4feafa2956d6e4e (DEFAULT_TABLE table=default.Table_268a79e835004ddaa114b663c8be3a9c [id=6c0247f77b83490b90d1f7ccbfa55ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.909907 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 595e389927344db39efef82d720c6cf5 (DEFAULT_TABLE table=default.Table_d4d3fae1326a4235b6726c1a426933b0 [id=e309736c2c3b4da1a77ce74ffc91afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.968804 9815 tablet_replica.cc:330] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.933669 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 63f76308689b41a99e06155e1faf6c9e (DEFAULT_TABLE table=default.Table_5d170acaccec431ea5615b6d6a5b1dc8 [id=53d4a02091024310a11ea6be1b8b4ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.934862 9546 tablet_service.cc:1467] Processing CreateTablet for tablet 07edb0fbdaec4ab4a1b6d15928371875 (DEFAULT_TABLE table=default.Table_dc898131e89843239e49e12bc33e2f16 [id=20e56ef1f0de41d28c4fd4dfcdafd10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.969193 9498 leader_election.cc:302] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
W20260928 14:50:48.970093 9498 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 94861.2us
I20260928 14:50:48.935946 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 544214fc046e4fb198ad7882c7bdb5ce (DEFAULT_TABLE table=default.Table_bdb5e6bdf6c2409083a9005843fd5038 [id=efc12307397e48c4825d93e3c0b3fb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.970103 11567 raft_consensus.cc:2726] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.954736 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:48.960484 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 0c2e009d7583468aa27edab707d3bd08 (DEFAULT_TABLE table=default.Table_0b0b0c911845433ab88161b3e5a54baa [id=d8c7d87804d7423fb46269ddcac89cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.968819 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebe7ad56a6474fe590b6f609cb65a22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971040 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07edb0fbdaec4ab4a1b6d15928371875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971213 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a647f5070a4941b8a323cff888d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971361 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f76308689b41a99e06155e1faf6c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971517 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544214fc046e4fb198ad7882c7bdb5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971688 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595e389927344db39efef82d720c6cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.971884 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1a4d70f58740f3931b572ad011d7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.972209 9815 raft_consensus.cc:2229] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.972368 9815 raft_consensus.cc:2258] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.973096 9815 ts_tablet_manager.cc:1905] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.976195 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b6525b5aa3418493a4f6784c844da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.978263 9814 ts_tablet_manager.cc:1918] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.978372 9814 log.cc:1196] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/c51f5944c6534e9492594c39ae9796b2
I20260928 14:50:48.978336 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b5b1ad677744d51b5be2baf87461889" } modify_external_catalogs: true
I20260928 14:50:48.978514 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6b5b1ad677744d51b5be2baf87461889" } modify_external_catalogs: true
I20260928 14:50:48.978645 9814 ts_tablet_manager.cc:1939] T c51f5944c6534e9492594c39ae9796b2 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:48.979365 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1306) took 1457 ms. Trace:
I20260928 14:50:48.979447 9814 rpcz_store.cc:276] 0928 14:50:47.521946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.522002 (+ 56us) service_pool.cc:227] Handling call
0928 14:50:48.871920 (+1349918us) ts_tablet_manager.cc:1145] Deleting tablet c51f5944c6534e9492594c39ae9796b2
0928 14:50:48.871932 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:48.920243 (+ 48311us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.971750 (+ 51507us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:48.979345 (+ 7595us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346611}
I20260928 14:50:48.979749 9814 tablet_replica.cc:330] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:48.979918 9814 raft_consensus.cc:2229] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.980755 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 1d992e3183594ffaaa78781850640400 (DEFAULT_TABLE table=default.Table_1d6cb51e302f48d7829c53826ac9934c [id=95de15e1c5f34abd845f1faed5501229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.980816 9815 ts_tablet_manager.cc:1918] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:48.980922 9815 log.cc:1196] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/b8738a1591f644758f44fc720fd694a3
I20260928 14:50:48.981056 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d992e3183594ffaaa78781850640400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.981211 9815 ts_tablet_manager.cc:1939] T b8738a1591f644758f44fc720fd694a3 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:48.982623 9815 tablet_replica.cc:330] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:48.982698 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet b8738a1591f644758f44fc720fd694a3 (table default.Table_f98e79eee4ac4e55b37d2047d1e36684 [id=3d81c2e3d4c5408fa4dc665399cbfa6d]) successfully deleted
I20260928 14:50:48.983029 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a8dc216f5ed4f55aad81a7d062d65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.982966 9815 raft_consensus.cc:2229] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:48.968469 9855 raft_consensus.cc:729] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:48.983729 9815 raft_consensus.cc:2258] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:48.984174 9855 consensus_queue.cc:260] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.985675 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c2e009d7583468aa27edab707d3bd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.986918 9815 ts_tablet_manager.cc:1905] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:48.987075 9408 tablet_service.cc:1467] Processing CreateTablet for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5 (DEFAULT_TABLE table=default.Table_ce368de55c6b4956abbfdb93e74eed7c [id=c0ac6e3f149e4a8d9acd0afef7310270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.987416 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.987257 9855 ts_tablet_manager.cc:1428] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.125s user 0.001s sys 0.001s
I20260928 14:50:48.988176 9855 tablet_bootstrap.cc:492] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:48.988901 11454 raft_consensus.cc:482] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:48.989006 11454 raft_consensus.cc:504] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:48.989713 11454 leader_election.cc:288] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:48.990343 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f385d804a10442e3b725a86e201dd6a5" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:48.991230 9497 leader_election.cc:341] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.991423 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5169a160d9344439b4feafa2956d6e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.992231 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f385d804a10442e3b725a86e201dd6a5" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:48.992671 9498 leader_election.cc:341] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:48.992760 9498 leader_election.cc:302] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:48.993042 11567 raft_consensus.cc:2726] T f385d804a10442e3b725a86e201dd6a5 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:48.995191 9855 tablet_bootstrap.cc:654] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:48.996881 9480 tablet.cc:2369] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:48.996996 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 89ef9ecfacfc4058b067652068f79186 (DEFAULT_TABLE table=default.Table_b420ef1d93fa4866b52a1349c88b5880 [id=96ac9a70447b4a8cbbc8174e97f2a2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:48.997278 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89ef9ecfacfc4058b067652068f79186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.002970 8954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_1cce0e105c224511a8e0a5ca3eb55723" } new_table_name: "default.Table_6a2298316caa41ffb88b8919b53561b1" modify_external_catalogs: true
I20260928 14:50:49.003434 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad472e1c70c4e78b024a72dbca5b7d7 (DEFAULT_TABLE table=default.Table_a239d341814249fbb930541b906daa2f [id=c0f297826f7d4bc18fa90f1628be7ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.003733 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad472e1c70c4e78b024a72dbca5b7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.008513 11526 raft_consensus.cc:482] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.008625 11526 raft_consensus.cc:504] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.009104 11526 leader_election.cc:288] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.009750 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_55ae2cfecc6142df905f54fa526fbde8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.009951 9360 leader_election.cc:341] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 52993ae8b63d4fbaa8cf38720af3dea5
W20260928 14:50:49.010313 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ae2cfecc6142df905f54fa526fbde8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.012719 9535 tablet_service.cc:1467] Processing CreateTablet for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5 (DEFAULT_TABLE table=default.Table_ce368de55c6b4956abbfdb93e74eed7c [id=c0ac6e3f149e4a8d9acd0afef7310270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.015009 8953 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:49.014932 9533 tablet_service.cc:1467] Processing CreateTablet for tablet 89ef9ecfacfc4058b067652068f79186 (DEFAULT_TABLE table=default.Table_b420ef1d93fa4866b52a1349c88b5880 [id=96ac9a70447b4a8cbbc8174e97f2a2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.016378 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.016587 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89ef9ecfacfc4058b067652068f79186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.016040 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad472e1c70c4e78b024a72dbca5b7d7 (DEFAULT_TABLE table=default.Table_a239d341814249fbb930541b906daa2f [id=c0f297826f7d4bc18fa90f1628be7ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.016924 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbcb809b8e9453d8c98917df5424d07 (DEFAULT_TABLE table=default.Table_6c8e66901e6e453085b42e3a7274bbdb [id=60d84c41a3274a7da548f67822d3aadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.018345 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5169a160d9344439b4feafa2956d6e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.019707 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d8c20a70834344c7937f96ab5fae2049
I20260928 14:50:49.020001 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:49.020151 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet f385d804a10442e3b725a86e201dd6a5 (table default.Table_659002d3409c4d7498f6fed3d1657dfa [id=efe7bcff144d4a8b87d5cfc0545b55a0]). Expected version 3 got 0
I20260928 14:50:49.020447 9532 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c20a70834344c7937f96ab5fae2049 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:49.020717 8953 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:49.022878 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 63f76308689b41a99e06155e1faf6c9e (DEFAULT_TABLE table=default.Table_5d170acaccec431ea5615b6d6a5b1dc8 [id=53d4a02091024310a11ea6be1b8b4ab8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.023218 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f76308689b41a99e06155e1faf6c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.025695 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad472e1c70c4e78b024a72dbca5b7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.025907 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbcb809b8e9453d8c98917df5424d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.969590 9851 raft_consensus.cc:348] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.026082 9851 raft_consensus.cc:374] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.026150 9851 raft_consensus.cc:729] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.026301 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 0c2e009d7583468aa27edab707d3bd08 (DEFAULT_TABLE table=default.Table_0b0b0c911845433ab88161b3e5a54baa [id=d8c7d87804d7423fb46269ddcac89cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.026364 9851 consensus_queue.cc:260] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.026500 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 1d992e3183594ffaaa78781850640400 (DEFAULT_TABLE table=default.Table_1d6cb51e302f48d7829c53826ac9934c [id=95de15e1c5f34abd845f1faed5501229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.026584 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c2e009d7583468aa27edab707d3bd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.026824 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d992e3183594ffaaa78781850640400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.026851 9851 ts_tablet_manager.cc:1428] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260928 14:50:49.027076 9851 tablet_bootstrap.cc:492] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.029477 9264 tablet_service.cc:1467] Processing CreateTablet for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5 (DEFAULT_TABLE table=default.Table_ce368de55c6b4956abbfdb93e74eed7c [id=c0ac6e3f149e4a8d9acd0afef7310270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.029784 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbbe2c19e8c4b7ab8f06c90d98cd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.033927 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad472e1c70c4e78b024a72dbca5b7d7 (DEFAULT_TABLE table=default.Table_a239d341814249fbb930541b906daa2f [id=c0f297826f7d4bc18fa90f1628be7ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.034036 9255 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c20a70834344c7937f96ab5fae2049 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:49.034227 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad472e1c70c4e78b024a72dbca5b7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.034287 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 89ef9ecfacfc4058b067652068f79186 (DEFAULT_TABLE table=default.Table_b420ef1d93fa4866b52a1349c88b5880 [id=96ac9a70447b4a8cbbc8174e97f2a2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.034680 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89ef9ecfacfc4058b067652068f79186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.034648 9255 tablet_service.cc:1467] Processing CreateTablet for tablet c72024e6faf049d68763a4e6f26f9ade (DEFAULT_TABLE table=default.Table_ac66409422f84d7dba7e34649494aba8 [id=6c9e673c353645adbefbefde5ff3e790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.034917 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72024e6faf049d68763a4e6f26f9ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:48.980042 9814 raft_consensus.cc:2258] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.042816 9814 ts_tablet_manager.cc:1905] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.043040 9535 tablet_service.cc:1467] Processing CreateTablet for tablet c72024e6faf049d68763a4e6f26f9ade (DEFAULT_TABLE table=default.Table_ac66409422f84d7dba7e34649494aba8 [id=6c9e673c353645adbefbefde5ff3e790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.043440 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72024e6faf049d68763a4e6f26f9ade. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.044059 9220 leader_election.cc:341] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.044239 9220 leader_election.cc:302] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.044684 11519 raft_consensus.cc:2726] T d7cf2eb5b59649e099da1947c4ccf430 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:49.045413 9220 leader_election.cc:341] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.045590 9220 leader_election.cc:302] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.046031 9399 tablet_service.cc:1467] Processing CreateTablet for tablet c72024e6faf049d68763a4e6f26f9ade (DEFAULT_TABLE table=default.Table_ac66409422f84d7dba7e34649494aba8 [id=6c9e673c353645adbefbefde5ff3e790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.046442 9399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72024e6faf049d68763a4e6f26f9ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.046613 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 0c5d12b6e1774b7f8a02fc906c9a417e
I20260928 14:50:49.047886 9851 tablet_bootstrap.cc:654] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.049117 9406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.049664 9393 tablet_service.cc:1467] Processing CreateTablet for tablet 871bab89388944edb6e99f15db558787 (DEFAULT_TABLE table=default.Table_6c4fdd9cb2d642be81fc146a1994dce7 [id=3ec74622471f43c7b1e4a80a9a1bfe6b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:49.049770 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 0c5d12b6e1774b7f8a02fc906c9a417e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c5d12b6e1774b7f8a02fc906c9a417e already in progress: creating tablet
I20260928 14:50:49.049758 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbcb809b8e9453d8c98917df5424d07 (DEFAULT_TABLE table=default.Table_6c8e66901e6e453085b42e3a7274bbdb [id=60d84c41a3274a7da548f67822d3aadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.050034 9393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871bab89388944edb6e99f15db558787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.050034 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbcb809b8e9453d8c98917df5424d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.050562 9253 tablet_service.cc:1467] Processing CreateTablet for tablet 07edb0fbdaec4ab4a1b6d15928371875 (DEFAULT_TABLE table=default.Table_dc898131e89843239e49e12bc33e2f16 [id=20e56ef1f0de41d28c4fd4dfcdafd10e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.050556 9406 tablet_service.cc:1467] Processing CreateTablet for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a (DEFAULT_TABLE table=default.Table_755b7e0a8a6d4f8bbe31f925442274a1 [id=0e442f9199ff463082ec59cdf4085df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.050661 9390 tablet_service.cc:1467] Processing CreateTablet for tablet ac112ad5897549a695419780d329badd (DEFAULT_TABLE table=default.Table_ae33cb6de9e7435eb8bf7f71d4fd502a [id=2723ab33994c416b8e6bd1ee839a1bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.050866 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.051059 9389 tablet_service.cc:1467] Processing CreateTablet for tablet 1d992e3183594ffaaa78781850640400 (DEFAULT_TABLE table=default.Table_1d6cb51e302f48d7829c53826ac9934c [id=95de15e1c5f34abd845f1faed5501229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.051205 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac112ad5897549a695419780d329badd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.051364 9389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d992e3183594ffaaa78781850640400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.051762 9398 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbcb809b8e9453d8c98917df5424d07 (DEFAULT_TABLE table=default.Table_6c8e66901e6e453085b42e3a7274bbdb [id=60d84c41a3274a7da548f67822d3aadf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:49.052970 9360 leader_election.cc:341] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:49.053084 9360 leader_election.cc:302] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.053299 11526 raft_consensus.cc:2726] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.053649 9408 tablet_service.cc:1467] Processing CreateTablet for tablet d6f51bd787614413a9647259483eb82f (DEFAULT_TABLE table=default.Table_ef589de9756d4a71a55a6beeb91a9638 [id=f0aa04138614468f8c387f34699251b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.054512 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 63d7434c59964b1ab6a820b4ca2be233 (DEFAULT_TABLE table=default.Table_ecf600acee5f4ac5abaa25dd47418b19 [id=398a8405fa9f4b8db98dc7f599e9849c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.054988 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07edb0fbdaec4ab4a1b6d15928371875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.055538 9396 tablet_service.cc:1467] Processing CreateTablet for tablet 21610358b2944018ad3c24bb5b291b15 (DEFAULT_TABLE table=default.Table_1e5f82ac6fba495687756de9850b7f80 [id=ea8abb85220744e2a7264748cc662da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.056897 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 17966b75e3c84d739a68abdd0469cb00 (DEFAULT_TABLE table=default.Table_2df71ab27d7e4f568604ebbeffbff6c2 [id=53f2f451a7d7498ea22d57671f8d0cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.057746 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 223da3009be84bf59a01885260d3a871 (DEFAULT_TABLE table=default.Table_5cb7ed2d61594e3f8f89fad9dc558779 [id=eb29d983f3f5481cb4fee86f8ebbcced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.057865 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 7a8dc216f5ed4f55aad81a7d062d65e5 (DEFAULT_TABLE table=default.Table_15d64ced631d4320b048b959d33ffc95 [id=396495b594e8402ab6b46849707f8196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.058854 9566 raft_consensus.cc:1261] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Refusing update from remote peer 9b4626c584ad47ffaf346e81daff846b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 14:50:49.058964 9405 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa5a82b17854a6fb492f26b5c06b87d (DEFAULT_TABLE table=default.Table_0659f81357de42b29d4b17dd6646da41 [id=ef3e9de6c794421cba634eb97ff62b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.059939 9401 tablet_service.cc:1467] Processing CreateTablet for tablet decd6b008c974669b1b56b67268ae3ae (DEFAULT_TABLE table=default.Table_dd9786bbfc614618932b01eecc57b575 [id=d1467019680d44b0ba8d25f2472fa27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.060456 9404 tablet_service.cc:1467] Processing CreateTablet for tablet ce2eb688cc9c4105b4098b501514f841 (DEFAULT_TABLE table=default.Table_b0615b2e32d0400ea74a88f979b33a0b [id=975b5080545a4de48f733c25361310f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.061801 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89 (DEFAULT_TABLE table=default.Table_19e3b64975594b399bb53a0ea6789975 [id=fe5134e95a6a437287d867c2b176d731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.062427 9402 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c20a70834344c7937f96ab5fae2049 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.063684 9392 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9162c19d0846259233ec54e4888349 (DEFAULT_TABLE table=default.Table_c475aca8beed4eba9f29365eb5fc8b10 [id=d5e1b85efce34ffc8bf1c07eabd075bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.064841 9397 tablet_service.cc:1467] Processing CreateTablet for tablet f9d20bd3ed5e491697871fd39d50160b (DEFAULT_TABLE table=default.Table_6d9a1b754f5e47bba1ed6cb4b33851f7 [id=5cd5eb20d9e34f7b99076e4610de7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.065156 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 98d79325e54640ab8ec5ad0f8c65be78 (DEFAULT_TABLE table=default.Table_1e5eb50d61054346a2fc6a9ba4ee3ca6 [id=ba181d3c13a84e958cf21c50e259a9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.066409 9391 tablet_service.cc:1467] Processing CreateTablet for tablet 8a263955e57c4783acd247ae28dadc7f (DEFAULT_TABLE table=default.Table_9908b80bb25c42bc9a2cf59e024c375d [id=e0a24d7d64854a0495f9ef6160b5aa97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.068427 8948 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 9ca013d1c5b44730b7163e71dc408b04 (table default.Table_fc40bc4e324e44b79c283937cc1639f8 [id=406fbbcbe232457bbe03bfe66ec127f3]). Expected version 4 got 0
I20260928 14:50:49.074329 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:49.075501 9533 tablet_service.cc:1467] Processing CreateTablet for tablet ac112ad5897549a695419780d329badd (DEFAULT_TABLE table=default.Table_ae33cb6de9e7435eb8bf7f71d4fd502a [id=2723ab33994c416b8e6bd1ee839a1bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.075855 9533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac112ad5897549a695419780d329badd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.076433 9532 tablet_service.cc:1467] Processing CreateTablet for tablet 63d7434c59964b1ab6a820b4ca2be233 (DEFAULT_TABLE table=default.Table_ecf600acee5f4ac5abaa25dd47418b19 [id=398a8405fa9f4b8db98dc7f599e9849c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.076694 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 544214fc046e4fb198ad7882c7bdb5ce (DEFAULT_TABLE table=default.Table_bdb5e6bdf6c2409083a9005843fd5038 [id=efc12307397e48c4825d93e3c0b3fb46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.077212 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 871bab89388944edb6e99f15db558787 (DEFAULT_TABLE table=default.Table_6c4fdd9cb2d642be81fc146a1994dce7 [id=3ec74622471f43c7b1e4a80a9a1bfe6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.077678 9542 tablet_service.cc:1467] Processing CreateTablet for tablet 17966b75e3c84d739a68abdd0469cb00 (DEFAULT_TABLE table=default.Table_2df71ab27d7e4f568604ebbeffbff6c2 [id=53f2f451a7d7498ea22d57671f8d0cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.078410 9531 tablet_service.cc:1467] Processing CreateTablet for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a (DEFAULT_TABLE table=default.Table_755b7e0a8a6d4f8bbe31f925442274a1 [id=0e442f9199ff463082ec59cdf4085df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.078640 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 21610358b2944018ad3c24bb5b291b15 (DEFAULT_TABLE table=default.Table_1e5f82ac6fba495687756de9850b7f80 [id=ea8abb85220744e2a7264748cc662da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.079541 9536 tablet_service.cc:1467] Processing CreateTablet for tablet d6f51bd787614413a9647259483eb82f (DEFAULT_TABLE table=default.Table_ef589de9756d4a71a55a6beeb91a9638 [id=f0aa04138614468f8c387f34699251b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.079768 11519 raft_consensus.cc:2726] T e5cb151d58f545d9b1e6f652a0627ab9 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.079789 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
I20260928 14:50:49.080883 11519 consensus_queue.cc:1035] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:49.082556 9546 tablet_service.cc:1467] Processing CreateTablet for tablet decd6b008c974669b1b56b67268ae3ae (DEFAULT_TABLE table=default.Table_dd9786bbfc614618932b01eecc57b575 [id=d1467019680d44b0ba8d25f2472fa27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.083055 9813 tablet_replica.cc:330] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:49.083246 9813 raft_consensus.cc:2229] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 1 LEADER]: Raft consensus shutting down.
I20260928 14:50:49.083381 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89 (DEFAULT_TABLE table=default.Table_19e3b64975594b399bb53a0ea6789975 [id=fe5134e95a6a437287d867c2b176d731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.083513 9813 raft_consensus.cc:2258] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.084097 9548 tablet_service.cc:1467] Processing CreateTablet for tablet ce2eb688cc9c4105b4098b501514f841 (DEFAULT_TABLE table=default.Table_b0615b2e32d0400ea74a88f979b33a0b [id=975b5080545a4de48f733c25361310f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.084162 9541 tablet_service.cc:1467] Processing CreateTablet for tablet 98d79325e54640ab8ec5ad0f8c65be78 (DEFAULT_TABLE table=default.Table_1e5eb50d61054346a2fc6a9ba4ee3ca6 [id=ba181d3c13a84e958cf21c50e259a9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.084962 9543 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9162c19d0846259233ec54e4888349 (DEFAULT_TABLE table=default.Table_c475aca8beed4eba9f29365eb5fc8b10 [id=d5e1b85efce34ffc8bf1c07eabd075bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.085372 9538 tablet_service.cc:1467] Processing CreateTablet for tablet f9d20bd3ed5e491697871fd39d50160b (DEFAULT_TABLE table=default.Table_6d9a1b754f5e47bba1ed6cb4b33851f7 [id=5cd5eb20d9e34f7b99076e4610de7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.085819 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 8a263955e57c4783acd247ae28dadc7f (DEFAULT_TABLE table=default.Table_9908b80bb25c42bc9a2cf59e024c375d [id=e0a24d7d64854a0495f9ef6160b5aa97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.086246 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 8eb46d0ad95c4deaa95ef0205578aabc (DEFAULT_TABLE table=default.Table_559e238acd7443cf9f83d42f7f324660 [id=d683d809347f491f80c8e4fd129b2d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.086740 9529 tablet_service.cc:1467] Processing CreateTablet for tablet a48e60d58a0940a9ba95c34f2848b922 (DEFAULT_TABLE table=default.Table_656ab0d209744b68a38ca823493c2777 [id=8afd61df67674a85a8ba12cd13a36e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.087415 9530 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa5a82b17854a6fb492f26b5c06b87d (DEFAULT_TABLE table=default.Table_0659f81357de42b29d4b17dd6646da41 [id=ef3e9de6c794421cba634eb97ff62b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.087503 9549 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd8cb929d134be9b07fc7ba08498280 (DEFAULT_TABLE table=default.Table_9cffef22d0c94e28aac3909d4c77759a [id=7aa0d730a0764810af392545a0ca0f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.087915 9534 tablet_service.cc:1467] Processing CreateTablet for tablet 223da3009be84bf59a01885260d3a871 (DEFAULT_TABLE table=default.Table_5cb7ed2d61594e3f8f89fad9dc558779 [id=eb29d983f3f5481cb4fee86f8ebbcced]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:49.094349 9335 tablet.cc:2369] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 14:50:49.094349 9813 ts_tablet_manager.cc:1905] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.096477 9532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d7434c59964b1ab6a820b4ca2be233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.096911 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871bab89388944edb6e99f15db558787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.097267 9542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17966b75e3c84d739a68abdd0469cb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.097569 9541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d79325e54640ab8ec5ad0f8c65be78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.097779 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21610358b2944018ad3c24bb5b291b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.098515 9543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9162c19d0846259233ec54e4888349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.098901 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eb46d0ad95c4deaa95ef0205578aabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.099261 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a263955e57c4783acd247ae28dadc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.099627 9538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d20bd3ed5e491697871fd39d50160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.099959 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2eb688cc9c4105b4098b501514f841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.100553 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 8eb46d0ad95c4deaa95ef0205578aabc (DEFAULT_TABLE table=default.Table_559e238acd7443cf9f83d42f7f324660 [id=d683d809347f491f80c8e4fd129b2d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.100868 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eb46d0ad95c4deaa95ef0205578aabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.101051 9530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa5a82b17854a6fb492f26b5c06b87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.101418 9534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223da3009be84bf59a01885260d3a871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.101635 9546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decd6b008c974669b1b56b67268ae3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.102069 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd8cb929d134be9b07fc7ba08498280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.102478 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48e60d58a0940a9ba95c34f2848b922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.102540 9848 tablet_bootstrap.cc:492] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.102644 9848 ts_tablet_manager.cc:1397] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.139s user 0.003s sys 0.000s
I20260928 14:50:49.102609 9406 tablet_service.cc:1467] Processing CreateTablet for tablet a48e60d58a0940a9ba95c34f2848b922 (DEFAULT_TABLE table=default.Table_656ab0d209744b68a38ca823493c2777 [id=8afd61df67674a85a8ba12cd13a36e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.102815 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.102896 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48e60d58a0940a9ba95c34f2848b922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.103281 9848 raft_consensus.cc:348] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.103469 9848 raft_consensus.cc:374] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.103514 9848 raft_consensus.cc:729] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.103677 9848 consensus_queue.cc:260] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.104177 9848 ts_tablet_manager.cc:1428] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260928 14:50:49.104333 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbcb809b8e9453d8c98917df5424d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.104487 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a263955e57c4783acd247ae28dadc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.104948 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.104945 8951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 654698224424484baaee5410c12a1016
I20260928 14:50:49.105489 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d20bd3ed5e491697871fd39d50160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.105593 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f51bd787614413a9647259483eb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.105686 9396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21610358b2944018ad3c24bb5b291b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.105988 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9162c19d0846259233ec54e4888349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.106313 9405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa5a82b17854a6fb492f26b5c06b87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.106464 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2eb688cc9c4105b4098b501514f841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.106745 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17966b75e3c84d739a68abdd0469cb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.106902 9401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decd6b008c974669b1b56b67268ae3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.107079 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f51bd787614413a9647259483eb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.107232 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223da3009be84bf59a01885260d3a871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.107404 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.108209 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 8d5905e89144477eb0e9ca76665b6572
I20260928 14:50:49.112334 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 30aa30400a704f6e900025ea804a2d32 (DEFAULT_TABLE table=default.Table_4efa6fc9e7894476b38331ffd75744e3 [id=784fb64a83de4b1cafd7ed8e827af3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.112568 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d7434c59964b1ab6a820b4ca2be233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.112628 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30aa30400a704f6e900025ea804a2d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.116112 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544214fc046e4fb198ad7882c7bdb5ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.116684 11573 log.cc:924] Time spent T f4eeb2aa92a24b628156d34129f1381c P ae832871bd1142f7af10c084115ffc12: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260928 14:50:49.120790 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a8dc216f5ed4f55aad81a7d062d65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.122925 9815 ts_tablet_manager.cc:1918] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.123032 9815 log.cc:1196] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/bd9cedadc7184013a37857206bec2ff0
I20260928 14:50:49.126619 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4f5da7a6b4a4e867d4e260a274d2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:49.128108 9813 ts_tablet_manager.cc:1918] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:49.128283 9813 log.cc:1196] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/d8c20a70834344c7937f96ab5fae2049
I20260928 14:50:49.128685 9813 ts_tablet_manager.cc:1939] T d8c20a70834344c7937f96ab5fae2049 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:49.132622 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d79325e54640ab8ec5ad0f8c65be78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.134891 9814 ts_tablet_manager.cc:1918] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.134986 9814 log.cc:1196] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/846a96509f32416087ee4667458c367e
I20260928 14:50:49.135241 9814 ts_tablet_manager.cc:1939] T 846a96509f32416087ee4667458c367e P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.135265 11519 raft_consensus.cc:482] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.135383 11519 raft_consensus.cc:504] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.135910 11519 leader_election.cc:288] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.135943 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1307) took 1613 ms. Trace:
W20260928 14:50:49.136003 8954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c394e5be225f41ad9ea26c87ba74400e consensus state has no leader
I20260928 14:50:49.136022 9814 rpcz_store.cc:276] 0928 14:50:47.522376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.522426 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:48.979698 (+1457272us) ts_tablet_manager.cc:1145] Deleting tablet 846a96509f32416087ee4667458c367e
0928 14:50:48.979709 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.046151 (+ 66442us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.134818 (+ 88667us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.135924 (+ 1106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1454301}
I20260928 14:50:49.136305 9814 tablet_replica.cc:330] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.136471 9814 raft_consensus.cc:2229] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.136595 9814 raft_consensus.cc:2258] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.137094 9814 ts_tablet_manager.cc:1905] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.138010 9851 tablet_bootstrap.cc:492] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:49.138131 9851 ts_tablet_manager.cc:1397] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.000s
I20260928 14:50:49.138757 9851 raft_consensus.cc:348] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.138940 9851 raft_consensus.cc:374] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.139015 9851 raft_consensus.cc:729] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.139182 9851 consensus_queue.cc:260] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.139648 9851 ts_tablet_manager.cc:1428] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 14:50:49.139899 9851 tablet_bootstrap.cc:492] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.141113 9851 tablet_bootstrap.cc:654] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.142864 9848 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.144282 9848 tablet_bootstrap.cc:654] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.146811 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 67956e8ba12d4411bfca6263b84aa93e (table default.Table_36f9ea2f519041849b89dbd20ddf871e [id=8c5f014cd2f545abb221b135a4477b53]). Expected version 2 got 0
I20260928 14:50:49.152875 9395 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd8cb929d134be9b07fc7ba08498280 (DEFAULT_TABLE table=default.Table_9cffef22d0c94e28aac3909d4c77759a [id=7aa0d730a0764810af392545a0ca0f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.156057 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 826a00c6117c4e62a7f7cb508b06d693 (DEFAULT_TABLE table=default.Table_f0adc71d3809448c921b182cbe7be0a4 [id=f94b61b8d47045248a89e40ecca0acfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.156395 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 826a00c6117c4e62a7f7cb508b06d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.156628 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 30aa30400a704f6e900025ea804a2d32 (DEFAULT_TABLE table=default.Table_4efa6fc9e7894476b38331ffd75744e3 [id=784fb64a83de4b1cafd7ed8e827af3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.158267 9403 tablet_service.cc:1467] Processing CreateTablet for tablet 826a00c6117c4e62a7f7cb508b06d693 (DEFAULT_TABLE table=default.Table_f0adc71d3809448c921b182cbe7be0a4 [id=f94b61b8d47045248a89e40ecca0acfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.160706 9394 tablet_service.cc:1467] Processing CreateTablet for tablet 4679f2baa9864f5a918d674ad41250fa (DEFAULT_TABLE table=default.Table_11be47a99ffa4016815da97700aa17f9 [id=066403352fc341b792a58a2da4b89003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.161921 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 9d851bd7e57d42b998c1f9041b10ed10 (DEFAULT_TABLE table=default.Table_86f0f4bd53e04e22989845f367f3bd90 [id=e27395b4f5254833853692ea51d34bd2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 14:50:49.165683 9219 leader_election.cc:341] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1016ad6219294ccd829fca9b264ab06f
I20260928 14:50:49.165870 9815 ts_tablet_manager.cc:1939] T bd9cedadc7184013a37857206bec2ff0 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
I20260928 14:50:49.166831 9815 tablet_replica.cc:330] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:49.167995 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 1da833893a6346b79ff08562432c9095 (DEFAULT_TABLE table=default.Table_59cfabba7ef24617ac07ed3158699d74 [id=798e5e12394447d29a55f240686d342a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.168499 9395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd8cb929d134be9b07fc7ba08498280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.168720 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 1da833893a6346b79ff08562432c9095 (DEFAULT_TABLE table=default.Table_59cfabba7ef24617ac07ed3158699d74 [id=798e5e12394447d29a55f240686d342a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.170979 9402 tablet_service.cc:1467] Processing CreateTablet for tablet cf453078b4414598a07510e415e57397 (DEFAULT_TABLE table=default.Table_b5725df8a2fe4126b251c6d6008d8e5c [id=a8e9d1dc802d469f907e44cac27d55b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.171263 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf453078b4414598a07510e415e57397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.171505 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30aa30400a704f6e900025ea804a2d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.172341 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da833893a6346b79ff08562432c9095. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.173935 9219 consensus_peers.cc:487] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b -> Peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Couldn't send request to peer 658e483a10314e8d93c2f6e9084f2a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:49.174611 8954 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet eb9c9ea18f2046a080aca899f51f6759 (table default.Table_52258893962143c899c6c1266d78916f [id=62ae0752cb544610aa2f7645bbcd92d6]). Expected version 2 got 0
I20260928 14:50:49.181634 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 654698224424484baaee5410c12a1016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.181879 9398 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d5905e89144477eb0e9ca76665b6572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.185045 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da833893a6346b79ff08562432c9095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.188845 9815 raft_consensus.cc:2229] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.189014 9815 raft_consensus.cc:2258] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.189512 9815 ts_tablet_manager.cc:1905] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.193095 11526 raft_consensus.cc:482] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:49.079779 9220 consensus_peers.cc:487] T eb9c9ea18f2046a080aca899f51f6759 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:49.193244 11526 raft_consensus.cc:504] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:49.193602 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 113849us
W20260928 14:50:49.193812 9220 consensus_peers.cc:487] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:49.193974 11526 leader_election.cc:288] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:49.194911 9360 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 1c54cb0e8f2347d9b139c8766fb61ab1
W20260928 14:50:49.195132 9360 leader_election.cc:341] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 1c54cb0e8f2347d9b139c8766fb61ab1
I20260928 14:50:49.195233 9360 leader_election.cc:302] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.195621 11526 raft_consensus.cc:2726] T 1c54cb0e8f2347d9b139c8766fb61ab1 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.200433 9403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 826a00c6117c4e62a7f7cb508b06d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.201634 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4679f2baa9864f5a918d674ad41250fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.202364 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet bd9cedadc7184013a37857206bec2ff0 (table default.Table_c17c1cbf98644dbbac8e9d0865546c51 [id=4c915e1e70fc416eadaec3c812915746]) successfully deleted
I20260928 14:50:49.208056 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d851bd7e57d42b998c1f9041b10ed10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.208673 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1016ad6219294ccd829fca9b264ab06f" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.209024 8952 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:49.212538 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 4679f2baa9864f5a918d674ad41250fa (DEFAULT_TABLE table=default.Table_11be47a99ffa4016815da97700aa17f9 [id=066403352fc341b792a58a2da4b89003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.212960 9529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4679f2baa9864f5a918d674ad41250fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.163976 9540 tablet_service.cc:1467] Processing CreateTablet for tablet 9d851bd7e57d42b998c1f9041b10ed10 (DEFAULT_TABLE table=default.Table_86f0f4bd53e04e22989845f367f3bd90 [id=e27395b4f5254833853692ea51d34bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.214061 9540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d851bd7e57d42b998c1f9041b10ed10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.219936 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet c51f5944c6534e9492594c39ae9796b2 (table default.Table_fcb75edccb944c8e9c4197334aad550b [id=78c92c0f91654a3ba8ee67e415384139]) successfully deleted
I20260928 14:50:49.221251 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 846a96509f32416087ee4667458c367e (table default.Table_e255f8403baa437f9a75d582b7d9a26a [id=e3245a6434d14aefa17fe1850ad54e7c]) successfully deleted
I20260928 14:50:49.224654 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet d8c20a70834344c7937f96ab5fae2049 (table default.Table_a235a0c6603143439c7a545281e9754a [id=c90173a37f6f4615a34f85216ec6d750]) successfully deleted
W20260928 14:50:49.225113 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 654698224424484baaee5410c12a1016 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654698224424484baaee5410c12a1016 already in progress: creating tablet
W20260928 14:50:49.225390 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 8d5905e89144477eb0e9ca76665b6572 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d5905e89144477eb0e9ca76665b6572 already in progress: creating tablet
I20260928 14:50:49.227602 11519 raft_consensus.cc:482] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.227777 11519 raft_consensus.cc:504] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.228509 11519 leader_election.cc:288] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.229169 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.229350 9567 raft_consensus.cc:2454] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.229796 9219 leader_election.cc:302] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.230062 11223 raft_consensus.cc:2781] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.230131 11223 raft_consensus.cc:482] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.230185 11223 raft_consensus.cc:3037] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.230337 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 871bab89388944edb6e99f15db558787 (DEFAULT_TABLE table=default.Table_6c4fdd9cb2d642be81fc146a1994dce7 [id=3ec74622471f43c7b1e4a80a9a1bfe6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.230973 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871bab89388944edb6e99f15db558787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.232496 11223 raft_consensus.cc:504] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.232668 9814 ts_tablet_manager.cc:1918] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.232751 9814 log.cc:1196] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/7a2f051a09e143b8bb0ba3be81406b98
I20260928 14:50:49.233004 9814 ts_tablet_manager.cc:1939] T 7a2f051a09e143b8bb0ba3be81406b98 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.232985 11223 leader_election.cc:288] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.233287 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1308) took 1710 ms. Trace:
I20260928 14:50:49.233759 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.233928 9567 raft_consensus.cc:3037] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.234292 9265 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c5d12b6e1774b7f8a02fc906c9a417e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:49.234855 9855 tablet_bootstrap.cc:492] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.234973 9855 ts_tablet_manager.cc:1397] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.247s user 0.006s sys 0.000s
I20260928 14:50:49.235311 9851 tablet_bootstrap.cc:492] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:49.235690 9851 ts_tablet_manager.cc:1397] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.003s
I20260928 14:50:49.236370 9851 raft_consensus.cc:348] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.236701 9851 raft_consensus.cc:374] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.236804 9851 raft_consensus.cc:729] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.236760 9855 raft_consensus.cc:348] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.236941 9855 raft_consensus.cc:374] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.237038 9855 raft_consensus.cc:729] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.237124 9851 consensus_queue.cc:260] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.240154 9851 ts_tablet_manager.cc:1428] T 43c887b7c4e8434a9342d49145fde3ae P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260928 14:50:49.240459 9851 tablet_bootstrap.cc:492] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.241741 9851 tablet_bootstrap.cc:654] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.246001 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 654698224424484baaee5410c12a1016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:49.246127 9848 tablet_bootstrap.cc:492] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.246272 9848 ts_tablet_manager.cc:1397] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.103s user 0.009s sys 0.000s
I20260928 14:50:49.247061 9848 raft_consensus.cc:348] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.247295 9848 raft_consensus.cc:374] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.247350 9848 raft_consensus.cc:729] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.247342 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6b1cb1e20d5d4c02b427b750d08912ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:49.247527 9848 consensus_queue.cc:260] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:49.247906 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b1cb1e20d5d4c02b427b750d08912ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.248045 9848 ts_tablet_manager.cc:1428] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:49.249967 9848 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.253248 9848 tablet_bootstrap.cc:654] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.254649 9567 raft_consensus.cc:2454] T 77396c87dbe84f38967ee0d7c898fa9c P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.255038 9219 leader_election.cc:302] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.255286 11223 raft_consensus.cc:2781] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.255300 9549 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d5905e89144477eb0e9ca76665b6572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:37336
I20260928 14:50:49.255391 11223 raft_consensus.cc:686] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.255601 11223 consensus_queue.cc:237] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.256464 9544 tablet_service.cc:1467] Processing CreateTablet for tablet cf453078b4414598a07510e415e57397 (DEFAULT_TABLE table=default.Table_b5725df8a2fe4126b251c6d6008d8e5c [id=a8e9d1dc802d469f907e44cac27d55b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.257021 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf453078b4414598a07510e415e57397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.233371 9814 rpcz_store.cc:276] 0928 14:50:47.522723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.522769 (+ 46us) service_pool.cc:227] Handling call
0928 14:50:49.136264 (+1613495us) ts_tablet_manager.cc:1145] Deleting tablet 7a2f051a09e143b8bb0ba3be81406b98
0928 14:50:49.136276 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.230071 (+ 93795us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.232596 (+ 2525us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.233273 (+ 677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1610853}
I20260928 14:50:49.263566 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1313) took 1601 ms. Trace:
I20260928 14:50:49.264343 11567 raft_consensus.cc:482] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.264396 9814 rpcz_store.cc:276] 0928 14:50:47.661933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.662226 (+ 293us) service_pool.cc:227] Handling call
0928 14:50:49.263439 (+1601213us) ts_tablet_manager.cc:1145] Deleting tablet d4ff58de6c794b5ba7b44201800592d2
0928 14:50:49.263452 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.263551 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1601053}
I20260928 14:50:49.264477 11567 raft_consensus.cc:504] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.264753 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1318) took 1522 ms. Trace:
I20260928 14:50:49.264838 9814 rpcz_store.cc:276] 0928 14:50:47.742339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.742382 (+ 43us) service_pool.cc:227] Handling call
0928 14:50:49.264647 (+1522265us) ts_tablet_manager.cc:1145] Deleting tablet e0c64096ca3c490a909131c92e0846a0
0928 14:50:49.264658 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.264740 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522050}
I20260928 14:50:49.265043 11567 leader_election.cc:288] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.265097 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1319) took 1522 ms. Trace:
I20260928 14:50:49.265154 9814 rpcz_store.cc:276] 0928 14:50:47.742468 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.742535 (+ 67us) service_pool.cc:227] Handling call
0928 14:50:49.265015 (+1522480us) ts_tablet_manager.cc:1145] Deleting tablet b8237f7d97304a98889bde6817358eda
0928 14:50:49.265024 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.265086 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522276}
I20260928 14:50:49.266928 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae8348f77764a5e8787a33f657ca80d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:49.267171 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1325) took 1439 ms. Trace:
W20260928 14:50:49.267489 9497 leader_election.cc:341] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.267644 9814 rpcz_store.cc:276] 0928 14:50:47.827302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.827529 (+ 227us) service_pool.cc:227] Handling call
0928 14:50:49.267031 (+1439502us) ts_tablet_manager.cc:1145] Deleting tablet f8b1156c1b4b437c98c07070452ee260
0928 14:50:49.267041 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.267159 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436296}
I20260928 14:50:49.239718 9855 consensus_queue.cc:260] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.268503 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1326) took 1433 ms. Trace:
I20260928 14:50:49.268738 9855 ts_tablet_manager.cc:1428] T 8a55156d0bf94b5fbd810d321e78b760 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260928 14:50:49.269004 9855 tablet_bootstrap.cc:492] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.269093 9814 rpcz_store.cc:276] 0928 14:50:47.835016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.835178 (+ 162us) service_pool.cc:227] Handling call
0928 14:50:49.268414 (+1433236us) ts_tablet_manager.cc:1145] Deleting tablet 1195380515774c9f9e004d10db9d6907
0928 14:50:49.268424 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.268491 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1433026}
I20260928 14:50:49.270614 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1327) took 1391 ms. Trace:
I20260928 14:50:49.273551 9814 rpcz_store.cc:276] 0928 14:50:47.878820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:47.890053 (+ 11233us) service_pool.cc:227] Handling call
0928 14:50:49.269403 (+1379350us) ts_tablet_manager.cc:1145] Deleting tablet a3c4cca0f2d148ccaa69cdfe09591cb5
0928 14:50:49.269413 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.270597 (+ 1184us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364356}
I20260928 14:50:49.273864 9814 tablet_replica.cc:330] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.273952 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ae8348f77764a5e8787a33f657ca80d" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.274551 9498 leader_election.cc:341] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.274663 9498 leader_election.cc:302] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.274075 9814 raft_consensus.cc:2229] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.275238 9814 raft_consensus.cc:2258] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.276832 11567 raft_consensus.cc:2726] T 7ae8348f77764a5e8787a33f657ca80d P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.279544 11526 raft_consensus.cc:482] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.279661 11526 raft_consensus.cc:504] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.279932 9814 ts_tablet_manager.cc:1905] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.280174 11526 leader_election.cc:288] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:49.281224 9360 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 622a7af04be44ddebc1af16fcc6325ae
W20260928 14:50:49.281926 9360 leader_election.cc:341] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 622a7af04be44ddebc1af16fcc6325ae
I20260928 14:50:49.282079 9360 leader_election.cc:302] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.282550 11526 raft_consensus.cc:2726] T 622a7af04be44ddebc1af16fcc6325ae P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.283552 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 63d7434c59964b1ab6a820b4ca2be233 (DEFAULT_TABLE table=default.Table_ecf600acee5f4ac5abaa25dd47418b19 [id=398a8405fa9f4b8db98dc7f599e9849c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.283800 9253 tablet_service.cc:1467] Processing CreateTablet for tablet ac112ad5897549a695419780d329badd (DEFAULT_TABLE table=default.Table_ae33cb6de9e7435eb8bf7f71d4fd502a [id=2723ab33994c416b8e6bd1ee839a1bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.283941 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d7434c59964b1ab6a820b4ca2be233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.284195 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac112ad5897549a695419780d329badd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.286000 9267 tablet_service.cc:1467] Processing CreateTablet for tablet d6f51bd787614413a9647259483eb82f (DEFAULT_TABLE table=default.Table_ef589de9756d4a71a55a6beeb91a9638 [id=f0aa04138614468f8c387f34699251b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.286310 9848 tablet_bootstrap.cc:492] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.286418 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f51bd787614413a9647259483eb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.286430 9848 ts_tablet_manager.cc:1397] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260928 14:50:49.286993 11526 raft_consensus.cc:482] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.287083 9848 raft_consensus.cc:348] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.287096 11526 raft_consensus.cc:504] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.287294 9848 raft_consensus.cc:374] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.287343 9848 raft_consensus.cc:729] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.287516 9848 consensus_queue.cc:260] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.287887 11526 leader_election.cc:288] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:49.292004 9360 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 66772fac8b3747f0983562195abcc64e
I20260928 14:50:49.292554 9814 ts_tablet_manager.cc:1918] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:49.292552 9360 leader_election.cc:341] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 66772fac8b3747f0983562195abcc64e
I20260928 14:50:49.292639 9360 leader_election.cc:302] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.293008 11526 raft_consensus.cc:2726] T 66772fac8b3747f0983562195abcc64e P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.302115 9855 tablet_bootstrap.cc:654] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.312999 9422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:49.316218 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77396c87dbe84f38967ee0d7c898fa9c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.322536 9814 log.cc:1196] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/79f4b20a5e784d909f7297cc7f1b05e6
I20260928 14:50:49.293352 9265 tablet_service.cc:1467] Processing CreateTablet for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a (DEFAULT_TABLE table=default.Table_755b7e0a8a6d4f8bbe31f925442274a1 [id=0e442f9199ff463082ec59cdf4085df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.299475 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 223da3009be84bf59a01885260d3a871 (DEFAULT_TABLE table=default.Table_5cb7ed2d61594e3f8f89fad9dc558779 [id=eb29d983f3f5481cb4fee86f8ebbcced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.322854 9814 ts_tablet_manager.cc:1939] T 79f4b20a5e784d909f7297cc7f1b05e6 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.322979 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223da3009be84bf59a01885260d3a871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.299943 9254 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa5a82b17854a6fb492f26b5c06b87d (DEFAULT_TABLE table=default.Table_0659f81357de42b29d4b17dd6646da41 [id=ef3e9de6c794421cba634eb97ff62b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.299993 9255 tablet_service.cc:1467] Processing CreateTablet for tablet decd6b008c974669b1b56b67268ae3ae (DEFAULT_TABLE table=default.Table_dd9786bbfc614618932b01eecc57b575 [id=d1467019680d44b0ba8d25f2472fa27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.300552 9256 tablet_service.cc:1467] Processing CreateTablet for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89 (DEFAULT_TABLE table=default.Table_19e3b64975594b399bb53a0ea6789975 [id=fe5134e95a6a437287d867c2b176d731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.301008 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 98d79325e54640ab8ec5ad0f8c65be78 (DEFAULT_TABLE table=default.Table_1e5eb50d61054346a2fc6a9ba4ee3ca6 [id=ba181d3c13a84e958cf21c50e259a9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.324345 9814 tablet_replica.cc:330] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.301127 9251 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9162c19d0846259233ec54e4888349 (DEFAULT_TABLE table=default.Table_c475aca8beed4eba9f29365eb5fc8b10 [id=d5e1b85efce34ffc8bf1c07eabd075bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.301620 9248 tablet_service.cc:1467] Processing CreateTablet for tablet f9d20bd3ed5e491697871fd39d50160b (DEFAULT_TABLE table=default.Table_6d9a1b754f5e47bba1ed6cb4b33851f7 [id=5cd5eb20d9e34f7b99076e4610de7bf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.330504 9814 raft_consensus.cc:2229] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.330646 9814 raft_consensus.cc:2258] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.329927 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decd6b008c974669b1b56b67268ae3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.331166 9814 ts_tablet_manager.cc:1905] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.331275 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d20bd3ed5e491697871fd39d50160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.331475 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d79325e54640ab8ec5ad0f8c65be78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.336735 9248 tablet_service.cc:1467] Processing CreateTablet for tablet cf453078b4414598a07510e415e57397 (DEFAULT_TABLE table=default.Table_b5725df8a2fe4126b251c6d6008d8e5c [id=a8e9d1dc802d469f907e44cac27d55b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.302090 9249 tablet_service.cc:1467] Processing CreateTablet for tablet ce2eb688cc9c4105b4098b501514f841 (DEFAULT_TABLE table=default.Table_b0615b2e32d0400ea74a88f979b33a0b [id=975b5080545a4de48f733c25361310f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.337067 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce2eb688cc9c4105b4098b501514f841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.301877 9250 tablet_service.cc:1467] Processing CreateTablet for tablet 17966b75e3c84d739a68abdd0469cb00 (DEFAULT_TABLE table=default.Table_2df71ab27d7e4f568604ebbeffbff6c2 [id=53f2f451a7d7498ea22d57671f8d0cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.337535 9256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e4be02b24f34c4fb7cfe3e46dc69c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.308169 9266 tablet_service.cc:1467] Processing CreateTablet for tablet 8eb46d0ad95c4deaa95ef0205578aabc (DEFAULT_TABLE table=default.Table_559e238acd7443cf9f83d42f7f324660 [id=d683d809347f491f80c8e4fd129b2d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.341688 9250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17966b75e3c84d739a68abdd0469cb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.310364 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 30aa30400a704f6e900025ea804a2d32 (DEFAULT_TABLE table=default.Table_4efa6fc9e7894476b38331ffd75744e3 [id=784fb64a83de4b1cafd7ed8e827af3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.310882 9247 tablet_service.cc:1467] Processing CreateTablet for tablet 826a00c6117c4e62a7f7cb508b06d693 (DEFAULT_TABLE table=default.Table_f0adc71d3809448c921b182cbe7be0a4 [id=f94b61b8d47045248a89e40ecca0acfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.311576 9259 tablet_service.cc:1467] Processing CreateTablet for tablet 4679f2baa9864f5a918d674ad41250fa (DEFAULT_TABLE table=default.Table_11be47a99ffa4016815da97700aa17f9 [id=066403352fc341b792a58a2da4b89003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.341929 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30aa30400a704f6e900025ea804a2d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.313500 9261 tablet_service.cc:1467] Processing CreateTablet for tablet a48e60d58a0940a9ba95c34f2848b922 (DEFAULT_TABLE table=default.Table_656ab0d209744b68a38ca823493c2777 [id=8afd61df67674a85a8ba12cd13a36e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.342238 9247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 826a00c6117c4e62a7f7cb508b06d693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.343110 9259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4679f2baa9864f5a918d674ad41250fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.345618 9266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eb46d0ad95c4deaa95ef0205578aabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.345803 9248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf453078b4414598a07510e415e57397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.348338 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 654698224424484baaee5410c12a1016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:49.348508 9250 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d5905e89144477eb0e9ca76665b6572 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:48 UTC) from {username='slave'} at 127.0.0.1:46824
I20260928 14:50:49.349643 9251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9162c19d0846259233ec54e4888349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.353896 11567 raft_consensus.cc:482] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.354027 11567 raft_consensus.cc:504] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.354595 11567 leader_election.cc:288] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.313884 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd8cb929d134be9b07fc7ba08498280 (DEFAULT_TABLE table=default.Table_9cffef22d0c94e28aac3909d4c77759a [id=7aa0d730a0764810af392545a0ca0f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.315411 11223 raft_consensus.cc:482] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.355149 11223 raft_consensus.cc:504] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.355218 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa80c213f3f4aa9976cc285f6564e0f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:49.355649 11223 leader_election.cc:288] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:49.355726 9497 leader_election.cc:341] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.356859 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd8cb929d134be9b07fc7ba08498280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.357488 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.357719 9567 raft_consensus.cc:2454] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.358112 9219 leader_election.cc:302] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.358383 11223 raft_consensus.cc:2781] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.358449 11223 raft_consensus.cc:482] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.358507 11223 raft_consensus.cc:3037] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.361222 11223 raft_consensus.cc:504] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.361608 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa80c213f3f4aa9976cc285f6564e0f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.362198 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.362362 9567 raft_consensus.cc:3037] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.362534 11223 leader_election.cc:288] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.362802 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48e60d58a0940a9ba95c34f2848b922. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.363569 9498 leader_election.cc:341] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.363684 9498 leader_election.cc:302] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.364137 11567 raft_consensus.cc:2726] T baa80c213f3f4aa9976cc285f6564e0f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.366945 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa5a82b17854a6fb492f26b5c06b87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.329303 9264 tablet_service.cc:1467] Processing CreateTablet for tablet 9d851bd7e57d42b998c1f9041b10ed10 (DEFAULT_TABLE table=default.Table_86f0f4bd53e04e22989845f367f3bd90 [id=e27395b4f5254833853692ea51d34bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.372269 9264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d851bd7e57d42b998c1f9041b10ed10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.372582 9567 raft_consensus.cc:2454] T ab6ccac2580049a5a615d8d36a44f373 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.373103 9219 leader_election.cc:302] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.373715 11519 raft_consensus.cc:2781] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.373865 11519 raft_consensus.cc:686] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.374116 11519 consensus_queue.cc:237] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:49.315644 9220 leader_election.cc:341] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.317576 11498 consensus_queue.cc:1035] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:49.378258 9220 leader_election.cc:302] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.379072 11498 raft_consensus.cc:2726] T 1016ad6219294ccd829fca9b264ab06f P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.379305 9855 tablet_bootstrap.cc:492] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.301879 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 21610358b2944018ad3c24bb5b291b15 (DEFAULT_TABLE table=default.Table_1e5f82ac6fba495687756de9850b7f80 [id=ea8abb85220744e2a7264748cc662da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.303958 9252 tablet_service.cc:1467] Processing CreateTablet for tablet 8a263955e57c4783acd247ae28dadc7f (DEFAULT_TABLE table=default.Table_9908b80bb25c42bc9a2cf59e024c375d [id=e0a24d7d64854a0495f9ef6160b5aa97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.379432 9855 ts_tablet_manager.cc:1397] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.000s
W20260928 14:50:49.379348 9220 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 63711.9us
I20260928 14:50:49.379374 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ec95a7fd4a41ebab4e7adc1da2f06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.380172 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a263955e57c4783acd247ae28dadc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.380115 9855 raft_consensus.cc:348] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.380300 9855 raft_consensus.cc:374] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.380347 9855 raft_consensus.cc:729] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.336781 9257 tablet_service.cc:1467] Processing CreateTablet for tablet 1da833893a6346b79ff08562432c9095 (DEFAULT_TABLE table=default.Table_59cfabba7ef24617ac07ed3158699d74 [id=798e5e12394447d29a55f240686d342a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.380534 9855 consensus_queue.cc:260] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.380764 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da833893a6346b79ff08562432c9095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.381063 9855 ts_tablet_manager.cc:1428] T 1d6a9e78b3fe43389ac91de1329ced8f P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260928 14:50:49.381337 9855 tablet_bootstrap.cc:492] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.388411 9855 tablet_bootstrap.cc:654] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.388628 9815 ts_tablet_manager.cc:1918] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.389118 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21610358b2944018ad3c24bb5b291b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.389232 9815 log.cc:1196] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/bda4f5da7a6b4a4e867d4e260a274d2a
I20260928 14:50:49.391350 9815 ts_tablet_manager.cc:1939] T bda4f5da7a6b4a4e867d4e260a274d2a P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:49.380154 9220 consensus_peers.cc:487] T bda4f5da7a6b4a4e867d4e260a274d2a P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:49.393263 9220 consensus_peers.cc:487] T e59b8e736b6d4644a78a6d7570746e18 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 14:50:49.393476 9220 leader_election.cc:341] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:49.393859 9220 leader_election.cc:341] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.394179 9815 tablet_replica.cc:330] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: stopping tablet replica
I20260928 14:50:49.395108 9815 raft_consensus.cc:2229] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.396045 11498 raft_consensus.cc:482] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.396132 9815 raft_consensus.cc:2258] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.396155 11498 raft_consensus.cc:504] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.396250 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:49.396572 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6ccac2580049a5a615d8d36a44f373" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.396692 11498 leader_election.cc:288] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
W20260928 14:50:49.397672 9219 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: b6fed86d9eda45cab2083fca73825383
I20260928 14:50:49.399013 9815 ts_tablet_manager.cc:1905] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.400086 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6fed86d9eda45cab2083fca73825383" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.401229 9220 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.402582 9848 ts_tablet_manager.cc:1428] T 30d197a8ba8848d98ba0f03b2e83d3f6 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.116s user 0.004s sys 0.004s
I20260928 14:50:49.402937 9848 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.404524 9848 tablet_bootstrap.cc:654] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.410686 8954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9d64d32eb3cc4396bcd247be0b0fafcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:49.410821 8948 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_e4bc240e6f7c42949086a1f776e334a6" } new_table_name: "default.Table_f2ecda364b46440aa6f55cc2d06db9c4" modify_external_catalogs: true
I20260928 14:50:49.411423 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dd63720b8d7f42b98b0b3fc813207cf1" } new_table_name: "default.Table_40ae4f4efa4141b19249965bbeb6d39d" modify_external_catalogs: true
I20260928 14:50:49.410816 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_9430eef0b25940528b67a78d6b70c117"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.417904 8948 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 016172d46c0346c18ae26c0670613817 has no consensus state
W20260928 14:50:49.421865 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9b15696059a4e5397b27d343b448e62 consensus state has no leader
I20260928 14:50:49.421907 9855 tablet_bootstrap.cc:492] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.422348 9855 ts_tablet_manager.cc:1397] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260928 14:50:49.423740 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_057d93033f2a4d0eb2ecad97f1da758b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:49.424652 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_c8987172100d44d081837d670bf26d43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:49.424662 9855 raft_consensus.cc:348] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.425256 9855 raft_consensus.cc:374] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.425473 9855 raft_consensus.cc:729] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.425781 8953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_40b558980d564c59b1d850da28b0536a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.425978 9220 leader_election.cc:341] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:49.426334 9220 leader_election.cc:341] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.426604 9220 leader_election.cc:302] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.427206 11577 raft_consensus.cc:2726] T b6fed86d9eda45cab2083fca73825383 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.429486 9848 tablet_bootstrap.cc:492] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.429632 9848 ts_tablet_manager.cc:1397] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
I20260928 14:50:49.430394 9848 raft_consensus.cc:348] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.430593 9848 raft_consensus.cc:374] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 14:50:49.432325 8953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40b558980d564c59b1d850da28b0536a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:49.432853 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9430eef0b25940528b67a78d6b70c117 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.433400 9848 raft_consensus.cc:729] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
W20260928 14:50:49.433768 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_057d93033f2a4d0eb2ecad97f1da758b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.433661 9848 consensus_queue.cc:260] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.434198 9848 ts_tablet_manager.cc:1428] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260928 14:50:49.434443 9848 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
W20260928 14:50:49.434629 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8987172100d44d081837d670bf26d43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 14:50:49.435451 8954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d64d32eb3cc4396bcd247be0b0fafcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.442827 9855 consensus_queue.cc:260] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.444222 9855 ts_tablet_manager.cc:1428] T 440b98459fa9484fa44685126decf342 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.022s user 0.000s sys 0.002s
I20260928 14:50:49.445104 9855 tablet_bootstrap.cc:492] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.448653 11498 raft_consensus.cc:482] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.448801 11498 raft_consensus.cc:504] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.449318 11498 leader_election.cc:288] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.449424 11498 raft_consensus.cc:482] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:49.455327 9219 leader_election.cc:341] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 7a70f70162c2433aab5136514bd5fc03
I20260928 14:50:49.462669 11603 tablet.cc:1722] T 5b171a26e7e643c9bc98c580b7bae60f P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:49.470238 11567 raft_consensus.cc:482] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.470378 11567 raft_consensus.cc:504] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.470953 11567 leader_election.cc:288] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.471697 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:49.472275 9497 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.473204 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.473789 11595 raft_consensus.cc:482] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.473919 11595 raft_consensus.cc:504] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:49.474068 9498 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.474171 9498 leader_election.cc:302] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.474531 11595 leader_election.cc:288] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.474543 11567 raft_consensus.cc:2726] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:49.475288 9360 leader_election.cc:341] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:49.476083 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a70f70162c2433aab5136514bd5fc03" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.477381 9220 leader_election.cc:341] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.477568 9220 leader_election.cc:302] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.478009 11577 raft_consensus.cc:2726] T 7a70f70162c2433aab5136514bd5fc03 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.489774 9814 ts_tablet_manager.cc:1918] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.490517 9848 tablet_bootstrap.cc:654] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.491791 9855 tablet_bootstrap.cc:654] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.492421 8939 catalog_manager.cc:4841] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): tablet bda4f5da7a6b4a4e867d4e260a274d2a (table default.Table_b7be75ca96434082812ba760c0927f0c [id=0fe8de98dfb54d84912d74fec349c41b]) successfully deleted
W20260928 14:50:49.496377 9360 leader_election.cc:341] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Not found: Tablet not found: 62d6975813b744fb80dcc432cec61cb4
I20260928 14:50:49.497498 9360 leader_election.cc:302] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.497974 9814 log.cc:1196] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/666de9dd64734708b35738605204ed7d
I20260928 14:50:49.497978 11595 raft_consensus.cc:2726] T 62d6975813b744fb80dcc432cec61cb4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.499415 9814 ts_tablet_manager.cc:1939] T 666de9dd64734708b35738605204ed7d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.500782 9815 ts_tablet_manager.cc:1918] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 14:50:49.500841 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1340) took 1082 ms. Trace:
I20260928 14:50:49.500952 9815 log.cc:1196] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-2/wal/wals/d8c20a70834344c7937f96ab5fae2049
I20260928 14:50:49.501071 9814 rpcz_store.cc:276] 0928 14:50:48.418835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.419237 (+ 402us) service_pool.cc:227] Handling call
0928 14:50:49.324309 (+905072us) ts_tablet_manager.cc:1145] Deleting tablet 666de9dd64734708b35738605204ed7d
0928 14:50:49.324320 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.336187 (+ 11867us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.489677 (+153490us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.500824 (+ 11147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":904746}
I20260928 14:50:49.501376 11607 tablet.cc:1722] T 5b171a26e7e643c9bc98c580b7bae60f P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 14:50:49.504367 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1342) took 1068 ms. Trace:
I20260928 14:50:49.504496 9814 rpcz_store.cc:276] 0928 14:50:48.435793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.435841 (+ 48us) service_pool.cc:227] Handling call
0928 14:50:49.504259 (+1068418us) ts_tablet_manager.cc:1145] Deleting tablet 00b65284d7da4ee186d228c64a4013d6
0928 14:50:49.504270 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.504353 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1068155}
I20260928 14:50:49.504877 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1343) took 1067 ms. Trace:
I20260928 14:50:49.505004 9814 rpcz_store.cc:276] 0928 14:50:48.437035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.437085 (+ 50us) service_pool.cc:227] Handling call
0928 14:50:49.504782 (+1067697us) ts_tablet_manager.cc:1145] Deleting tablet e33ecd8df52d4355b187142ff61f24ef
0928 14:50:49.504791 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.504864 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067195}
I20260928 14:50:49.505342 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1344) took 1065 ms. Trace:
I20260928 14:50:49.505457 9814 rpcz_store.cc:276] 0928 14:50:48.440019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.440058 (+ 39us) service_pool.cc:227] Handling call
0928 14:50:49.505253 (+1065195us) ts_tablet_manager.cc:1145] Deleting tablet 989df9ccfce446008435161626ce4f5e
0928 14:50:49.505262 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.505328 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1065016}
I20260928 14:50:49.505824 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1345) took 1063 ms. Trace:
I20260928 14:50:49.505942 9814 rpcz_store.cc:276] 0928 14:50:48.442820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.442860 (+ 40us) service_pool.cc:227] Handling call
0928 14:50:49.505738 (+1062878us) ts_tablet_manager.cc:1145] Deleting tablet 32e609be5acd42b48b6b7423cd56401a
0928 14:50:49.505747 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.505812 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062697}
I20260928 14:50:49.506286 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1347) took 1046 ms. Trace:
I20260928 14:50:49.506403 9814 rpcz_store.cc:276] 0928 14:50:48.459657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.459899 (+ 242us) service_pool.cc:227] Handling call
0928 14:50:49.506194 (+1046295us) ts_tablet_manager.cc:1145] Deleting tablet de77b0bec60a4ebbb0a1b6f779eaaf70
0928 14:50:49.506202 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.506271 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046128}
I20260928 14:50:49.506742 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1348) took 1042 ms. Trace:
I20260928 14:50:49.507120 9814 rpcz_store.cc:276] 0928 14:50:48.464389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.464505 (+ 116us) service_pool.cc:227] Handling call
0928 14:50:49.506640 (+1042135us) ts_tablet_manager.cc:1145] Deleting tablet 72099e766c574246b38acb34ee369d2e
0928 14:50:49.506648 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.506726 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1041977}
I20260928 14:50:49.507778 9814 tablet_replica.cc:330] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.508111 9814 raft_consensus.cc:2229] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.508606 9855 tablet_bootstrap.cc:492] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.508718 9855 ts_tablet_manager.cc:1397] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.000s
I20260928 14:50:49.509418 9855 raft_consensus.cc:348] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.509845 9855 raft_consensus.cc:374] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.509961 9855 raft_consensus.cc:729] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.510251 9855 consensus_queue.cc:260] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.511102 9855 ts_tablet_manager.cc:1428] T f92d30a7102f49828227b1428e2224da P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 14:50:49.512696 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_2e363862f56142e6a082db241684308e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.513222 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e363862f56142e6a082db241684308e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.513446 8946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9c0cf19be132450eb3c9264d1a2857a9" } modify_external_catalogs: true
I20260928 14:50:49.513603 8946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_9c0cf19be132450eb3c9264d1a2857a9" } modify_external_catalogs: true
I20260928 14:50:49.514113 9848 tablet_bootstrap.cc:492] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.514107 8955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_63eaefa1d8b94d39b12e005aa93071e7" } new_table_name: "default.Table_4725e716ed37459c8be218fa538ccba7" modify_external_catalogs: true
I20260928 14:50:49.514249 9848 ts_tablet_manager.cc:1397] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.000s
I20260928 14:50:49.514739 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a7e8c7ec96a8474bbe5423784c9b0f58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.515192 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7e8c7ec96a8474bbe5423784c9b0f58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.515236 8953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6ed5cdcb675541eca4e4e659fecabc93" } modify_external_catalogs: true
I20260928 14:50:49.515358 8953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_6ed5cdcb675541eca4e4e659fecabc93" } modify_external_catalogs: true
I20260928 14:50:49.518890 8954 catalog_manager.cc:5587] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099) does not have the latest schema for tablet f4eeb2aa92a24b628156d34129f1381c (table default.Table_5aeedece8e2c413fbab21f1520e5933d [id=495273db44b54cdea41982cd676b579c]). Expected version 2 got 0
I20260928 14:50:49.519676 8954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a368bd968edb461dbc01fa01aa8027c2" } modify_external_catalogs: true
I20260928 14:50:49.519815 8954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_a368bd968edb461dbc01fa01aa8027c2" } modify_external_catalogs: true
I20260928 14:50:49.520961 8956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_6ecc6343b4744a57a5dc66ca5e0e9955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 14:50:49.521366 8956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ecc6343b4744a57a5dc66ca5e0e9955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.522549 8950 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_0dbd09e0567a4882b75ace0a5fa81d25" } new_table_name: "default.Table_888473d4f9ae44649d74ae4163f7ff76" modify_external_catalogs: true
I20260928 14:50:49.523777 8948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_656ab0d209744b68a38ca823493c2777" } modify_external_catalogs: true
I20260928 14:50:49.523931 8948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_656ab0d209744b68a38ca823493c2777" } modify_external_catalogs: true
I20260928 14:50:49.524367 9408 tablet_service.cc:1514] Processing DeleteTablet for tablet 52993ae8b63d4fbaa8cf38720af3dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:35 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.524623 9813 tablet_replica.cc:330] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: stopping tablet replica
I20260928 14:50:49.524811 9813 raft_consensus.cc:2229] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.524940 9813 raft_consensus.cc:2258] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.525434 9813 ts_tablet_manager.cc:1905] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.536312 9813 ts_tablet_manager.cc:1918] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.536512 9813 log.cc:1196] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-1/wal/wals/52993ae8b63d4fbaa8cf38720af3dea5
I20260928 14:50:49.537083 9855 tablet_bootstrap.cc:492] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.537631 9815 ts_tablet_manager.cc:1939] T d8c20a70834344c7937f96ab5fae2049 P 658e483a10314e8d93c2f6e9084f2a91: Deleting consensus metadata
W20260928 14:50:49.539987 8955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ac1562423dd45748bc9ad324f432fb7 consensus state has no leader
I20260928 14:50:49.542049 9813 ts_tablet_manager.cc:1939] T 52993ae8b63d4fbaa8cf38720af3dea5 P ae832871bd1142f7af10c084115ffc12: Deleting consensus metadata
I20260928 14:50:49.542670 8940 catalog_manager.cc:4841] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): tablet 52993ae8b63d4fbaa8cf38720af3dea5 (table default.Table_2969f92d404942518e3feadd54948444 [id=d19993a468fd4f7d994003f4977a1c59]) successfully deleted
I20260928 14:50:49.514957 9848 raft_consensus.cc:348] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.546590 9848 raft_consensus.cc:374] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.546715 9848 raft_consensus.cc:729] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.547031 9848 consensus_queue.cc:260] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.547502 8952 catalog_manager.cc:5495] T 77396c87dbe84f38967ee0d7c898fa9c P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:49.548211 9848 ts_tablet_manager.cc:1428] T 8fcc42af91c247b1b80059e95e3659cf P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260928 14:50:49.548592 9855 tablet_bootstrap.cc:654] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.557664 9814 raft_consensus.cc:2258] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.558311 9814 ts_tablet_manager.cc:1905] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.562109 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b70c9aef33fb411981402734d7eb9a14 (DEFAULT_TABLE table=default.Table_1711c965c5d349e3bc63dfe7f2f99ac1 [id=d92cbc62ff434f3ea1271104506831f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.562557 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70c9aef33fb411981402734d7eb9a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.563890 9855 tablet_bootstrap.cc:492] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.564531 9814 ts_tablet_manager.cc:1918] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 14:50:49.564858 9848 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.565102 11595 raft_consensus.cc:482] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.564891 9855 ts_tablet_manager.cc:1397] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260928 14:50:49.565207 11595 raft_consensus.cc:504] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.565898 11595 leader_election.cc:288] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.566341 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.567734 9848 tablet_bootstrap.cc:654] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.572752 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 690538f2c6e34acd80edde51acc3ffcb (DEFAULT_TABLE table=default.Table_42f0f2137f854376a68246c5f0a9ddf8 [id=a9447b2b1b1f4f90b74b571757e3c68c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.574658 9402 tablet_service.cc:1467] Processing CreateTablet for tablet aee6807147cc4e698842d9e6ee2bef9d (DEFAULT_TABLE table=default.Table_be7c0956d81c441ebf7a933d90801c93 [id=5b4600b6131d4247ba9b3c8976356240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.575712 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee6807147cc4e698842d9e6ee2bef9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.576669 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 690538f2c6e34acd80edde51acc3ffcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.573561 9855 raft_consensus.cc:348] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.578399 8955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_08d5149e88d34336b608256fcc4d3224" } modify_external_catalogs: true
I20260928 14:50:49.578575 8955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_08d5149e88d34336b608256fcc4d3224" } modify_external_catalogs: true
I20260928 14:50:49.579099 9855 raft_consensus.cc:374] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.579569 9855 raft_consensus.cc:729] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.580647 9855 consensus_queue.cc:260] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.584364 9855 ts_tablet_manager.cc:1428] T a5eb8907be064167a3739715d24c94e9 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260928 14:50:49.585120 8949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59208:
table { table_name: "default.Table_dc898131e89843239e49e12bc33e2f16" } new_table_name: "default.Table_5590d3ed84964775bda70bc98b918899" modify_external_catalogs: true
I20260928 14:50:49.588477 9855 tablet_bootstrap.cc:492] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.598591 9855 tablet_bootstrap.cc:654] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.567193 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dd1e0ebad9143e397ec4cdb9ef6fc99" candidate_uuid: "ae832871bd1142f7af10c084115ffc12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:49.571156 9220 consensus_peers.cc:487] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b -> Peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Couldn't send request to peer ae832871bd1142f7af10c084115ffc12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 14:50:49.572551 11605 consensus_queue.cc:1035] T 6aa393b1fc2b40ebb87df86180717db8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Connected to new peer: Peer: permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 14:50:49.449512 11498 raft_consensus.cc:504] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.602273 11603 tablet.cc:1722] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 9b4626c584ad47ffaf346e81daff846b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:49.603631 9360 leader_election.cc:302] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae832871bd1142f7af10c084115ffc12; no voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b
I20260928 14:50:49.603603 8951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59208:
name: "default.Table_a0c234112ddc4528b741f239b71ce715"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 14:50:49.603883 11595 raft_consensus.cc:2726] T 1dd1e0ebad9143e397ec4cdb9ef6fc99 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 14:50:49.604151 8951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0c234112ddc4528b741f239b71ce715 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 14:50:49.604296 11605 raft_consensus.cc:482] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.604404 11605 raft_consensus.cc:504] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.604875 11605 leader_election.cc:288] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.605782 11607 tablet.cc:1722] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P 658e483a10314e8d93c2f6e9084f2a91: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 14:50:49.606312 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bb9c7fc599425484fd3fc0b94f3a8c" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.607385 9220 leader_election.cc:341] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:49.608306 9219 leader_election.cc:341] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119): Not found: Tablet not found: 58bb9c7fc599425484fd3fc0b94f3a8c
I20260928 14:50:49.608409 9219 leader_election.cc:302] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b4626c584ad47ffaf346e81daff846b; no voters: 658e483a10314e8d93c2f6e9084f2a91, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.612080 11605 raft_consensus.cc:2726] T 58bb9c7fc599425484fd3fc0b94f3a8c P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.614143 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 7a2f051a09e143b8bb0ba3be81406b98 (table default.Table_b7fa9e4709af4148bbcb12a7a50eab39 [id=9104ca2227184526a6e6a3ffadd74c34]) successfully deleted
W20260928 14:50:49.614427 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet d4ff58de6c794b5ba7b44201800592d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4ff58de6c794b5ba7b44201800592d2 already in progress: creating tablet
I20260928 14:50:49.614646 9334 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
W20260928 14:50:49.614663 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e0c64096ca3c490a909131c92e0846a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0c64096ca3c490a909131c92e0846a0 already in progress: creating tablet
W20260928 14:50:49.614965 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet b8237f7d97304a98889bde6817358eda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8237f7d97304a98889bde6817358eda already in progress: creating tablet
W20260928 14:50:49.615190 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet f8b1156c1b4b437c98c07070452ee260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8b1156c1b4b437c98c07070452ee260 already in progress: creating tablet
W20260928 14:50:49.615406 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 1195380515774c9f9e004d10db9d6907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1195380515774c9f9e004d10db9d6907 already in progress: creating tablet
W20260928 14:50:49.615653 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a3c4cca0f2d148ccaa69cdfe09591cb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3c4cca0f2d148ccaa69cdfe09591cb5 already in progress: creating tablet
I20260928 14:50:49.616153 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 79f4b20a5e784d909f7297cc7f1b05e6 (table default.Table_69359a2fb5f541a5a6f13af1a82119b2 [id=796bdf7268ff407d9c87a2c0487e18ee]) successfully deleted
I20260928 14:50:49.616288 11454 raft_consensus.cc:482] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.616420 11454 raft_consensus.cc:504] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.617053 11454 leader_election.cc:288] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.617928 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 3289d501483c4a2f91a7081e47c9f61e (DEFAULT_TABLE table=default.Table_b13e44d3602a48cb8cc1c98a74ca52a2 [id=6d5b969da56b472c942d5627ec93438b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.618046 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aff7eb9a7ff4ed79305806c30c30627" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.618324 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3289d501483c4a2f91a7081e47c9f61e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.618534 9498 leader_election.cc:341] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.618768 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aff7eb9a7ff4ed79305806c30c30627" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
W20260928 14:50:49.619313 9497 leader_election.cc:341] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.619405 9497 leader_election.cc:302] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.619818 11454 raft_consensus.cc:2726] T 3aff7eb9a7ff4ed79305806c30c30627 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.624660 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.625131 9220 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.625787 9569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.625953 9569 raft_consensus.cc:2454] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.626340 9219 leader_election.cc:302] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.626603 11498 leader_election.cc:288] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.626655 11223 raft_consensus.cc:2781] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.626816 11223 raft_consensus.cc:482] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.626935 11223 raft_consensus.cc:3037] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:49.628958 8921 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.181.2:42099, user_credentials={real_user=slave}} blocked reactor thread for 319521us
I20260928 14:50:49.629307 11223 raft_consensus.cc:504] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.630371 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:49.630517 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b14339044619424c9be020fa99ad681e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.630684 9566 raft_consensus.cc:3037] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
W20260928 14:50:49.630954 9220 leader_election.cc:341] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.603001 9814 log.cc:1196] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/3b75816a9816497ca6bc6ba8e5c5eb3d
I20260928 14:50:49.631847 9848 tablet_bootstrap.cc:492] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.632022 9848 ts_tablet_manager.cc:1397] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260928 14:50:49.633136 9848 raft_consensus.cc:348] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.633373 9848 raft_consensus.cc:374] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.633440 9848 raft_consensus.cc:729] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.634002 9848 consensus_queue.cc:260] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.634479 9566 raft_consensus.cc:2454] T b14339044619424c9be020fa99ad681e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.634841 9848 ts_tablet_manager.cc:1428] T e3236b0fb0944dc0a1f0893eb8d8e3b4 P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 14:50:49.635142 9848 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.634820 9219 leader_election.cc:302] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.635465 11498 raft_consensus.cc:2781] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.639369 11498 raft_consensus.cc:686] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.641424 11606 raft_consensus.cc:482] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.641561 11606 raft_consensus.cc:504] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.642095 11606 leader_election.cc:288] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.639715 11498 consensus_queue.cc:237] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.645682 9851 tablet_bootstrap.cc:492] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:49.645798 9814 ts_tablet_manager.cc:1939] T 3b75816a9816497ca6bc6ba8e5c5eb3d P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.645807 9851 ts_tablet_manager.cc:1397] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.405s user 0.066s sys 0.088s
I20260928 14:50:49.646214 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1350) took 1077 ms. Trace:
I20260928 14:50:49.646317 9814 rpcz_store.cc:276] 0928 14:50:48.568346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.568652 (+ 306us) service_pool.cc:227] Handling call
0928 14:50:49.507741 (+939089us) ts_tablet_manager.cc:1145] Deleting tablet 3b75816a9816497ca6bc6ba8e5c5eb3d
0928 14:50:49.507749 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.561595 (+ 53846us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.564446 (+ 2851us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.646197 (+ 81751us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":938935}
I20260928 14:50:49.646659 9814 tablet_replica.cc:330] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.646533 9851 raft_consensus.cc:348] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.642699 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.646878 9851 raft_consensus.cc:374] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.646936 9851 raft_consensus.cc:729] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.644598 9475 heartbeater.cc:347] Connected to a master server at 127.8.181.61:41417
W20260928 14:50:49.647222 9220 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.647095 9851 consensus_queue.cc:260] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.647835 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd3da2b3c2940ef8c76d8366e67ec64 (DEFAULT_TABLE table=default.Table_88b2f18d021948e58d6010ac127ac782 [id=53f30f341ad34d2893586104a5ba002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.648168 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd3da2b3c2940ef8c76d8366e67ec64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.650494 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 7075c20c0af245fab67bbc5e5be24192 (DEFAULT_TABLE table=default.Table_81ba7c5a39da4e10a05e04cc6b22a618 [id=26a1c8b06c3d4bd5a2c00212ad62e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.650895 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7075c20c0af245fab67bbc5e5be24192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.651262 9566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.651527 9566 raft_consensus.cc:2454] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.652467 9397 tablet_service.cc:1467] Processing CreateTablet for tablet b7090d273be1425fa8be0952470c4034 (DEFAULT_TABLE table=default.Table_e9859aeaaec84f258169f32308e91c31 [id=17766edfcc3e49048603f5758bbcdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.652652 9219 leader_election.cc:302] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.652781 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7090d273be1425fa8be0952470c4034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.653067 11605 raft_consensus.cc:2781] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.653151 11605 raft_consensus.cc:482] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.653239 11605 raft_consensus.cc:3037] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.655571 11605 raft_consensus.cc:504] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.656090 11605 leader_election.cc:288] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.656773 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.656962 9567 raft_consensus.cc:3037] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.657742 9394 tablet_service.cc:1467] Processing CreateTablet for tablet a7c908fa3d474c9294c97da6e0076241 (DEFAULT_TABLE table=default.Table_261cbd2934a34c30938c1cefffb461ad [id=ddb2ef1a09484aa6b1a040dcee902f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.658034 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7c908fa3d474c9294c97da6e0076241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.659471 9567 raft_consensus.cc:2454] T 9ca013d1c5b44730b7163e71dc408b04 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.659801 9219 leader_election.cc:302] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.660285 11519 raft_consensus.cc:2781] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.660395 11519 raft_consensus.cc:686] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.660588 11519 consensus_queue.cc:237] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.661798 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 565d79ecae1a4cbfb4c46cac8a574b9d (DEFAULT_TABLE table=default.Table_f51f672a539a4a42bfc9deaa1f2492d4 [id=4add514184de4ba3a75fb6dd7892a6da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.662118 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 565d79ecae1a4cbfb4c46cac8a574b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.665915 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ca013d1c5b44730b7163e71dc408b04" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
W20260928 14:50:49.666338 9220 leader_election.cc:341] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.673364 9851 ts_tablet_manager.cc:1428] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.027s user 0.001s sys 0.000s
I20260928 14:50:49.673681 9851 tablet_bootstrap.cc:492] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.675148 9851 tablet_bootstrap.cc:654] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.635056 11223 leader_election.cc:288] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.646884 9814 raft_consensus.cc:2229] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.690833 9814 raft_consensus.cc:2258] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.691727 9814 ts_tablet_manager.cc:1905] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.692912 9848 tablet_bootstrap.cc:654] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.699533 9851 tablet_bootstrap.cc:492] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:49.699643 9851 ts_tablet_manager.cc:1397] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260928 14:50:49.700414 9851 raft_consensus.cc:348] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.700608 9851 raft_consensus.cc:374] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.700662 9851 raft_consensus.cc:729] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.700845 9851 consensus_queue.cc:260] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.701350 9851 ts_tablet_manager.cc:1428] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:49.701611 9851 tablet_bootstrap.cc:492] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.702924 9851 tablet_bootstrap.cc:654] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:49.680538 8950 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet affea6f5d2df43238f47fd1110b64acc consensus state has no leader
I20260928 14:50:49.682063 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 5b171a26e7e643c9bc98c580b7bae60f (table default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00]). Expected version 2 got 0
I20260928 14:50:49.707782 8956 catalog_manager.cc:5587] TS 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:49.683213 8948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a48e60d58a0940a9ba95c34f2848b922
I20260928 14:50:49.684381 8953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet 7e37fa525dd543aea4ae0f55ed2813f4
I20260928 14:50:49.684986 8946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet a9903241fd3b463094fff7bf9c76ed9b
I20260928 14:50:49.685674 8954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet e2aae21b7ed2417dafd4cca54c53de33
I20260928 14:50:49.709456 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet a48e60d58a0940a9ba95c34f2848b922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:49 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.686520 8955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: Sending DeleteTablet for 3 replicas of tablet d271c8012b634b2a816cc2360e5b2164
I20260928 14:50:49.709681 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e37fa525dd543aea4ae0f55ed2813f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:49 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.709830 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet a9903241fd3b463094fff7bf9c76ed9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:49 UTC) from {username='slave'} at 127.0.0.1:34142
W20260928 14:50:49.687345 8949 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07edb0fbdaec4ab4a1b6d15928371875 consensus state has no leader
W20260928 14:50:49.710364 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 94210.8us
W20260928 14:50:49.710465 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a48e60d58a0940a9ba95c34f2848b922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a48e60d58a0940a9ba95c34f2848b922 already in progress: creating tablet
W20260928 14:50:49.710608 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 5c53c8bd0e124a2798d2a7f1e9595f1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c53c8bd0e124a2798d2a7f1e9595f1c already in progress: creating tablet
W20260928 14:50:49.710629 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet 7e37fa525dd543aea4ae0f55ed2813f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e37fa525dd543aea4ae0f55ed2813f4 already in progress: creating tablet
W20260928 14:50:49.710799 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet a9903241fd3b463094fff7bf9c76ed9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9903241fd3b463094fff7bf9c76ed9b already in progress: creating tablet
I20260928 14:50:49.712931 9848 tablet_bootstrap.cc:492] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12: No bootstrap required, opened a new log
I20260928 14:50:49.713042 9848 ts_tablet_manager.cc:1397] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.000s
I20260928 14:50:49.713272 8954 catalog_manager.cc:5495] T 9ca013d1c5b44730b7163e71dc408b04 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:49.713698 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 9ca013d1c5b44730b7163e71dc408b04 (table default.Table_fc40bc4e324e44b79c283937cc1639f8 [id=406fbbcbe232457bbe03bfe66ec127f3]). Expected version 4 got 0
I20260928 14:50:49.713896 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 9df6b94b5aa24ff8a7fce8ba397e51e8 (table default.Table_0738d88c93774a4b91aee142a00d29df [id=bedae6fe8fc54b5098b672df96fcfdfd]). Expected version 5 got 0
I20260928 14:50:49.713814 9848 raft_consensus.cc:348] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.713989 9848 raft_consensus.cc:374] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.714028 9848 raft_consensus.cc:729] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae832871bd1142f7af10c084115ffc12, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.714059 8954 catalog_manager.cc:5495] T b14339044619424c9be020fa99ad681e P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:49.714191 9848 consensus_queue.cc:260] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.714418 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet b14339044619424c9be020fa99ad681e (table default.Table_3f7ee04cf1f44625a52bf577f216c98b [id=921a3c5cf74b41b6bde6987563b81319]). Expected version 2 got 0
I20260928 14:50:49.714579 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 8fbe74a73dda4330af8814bbba0cfc70 (table default.Table_842e5c186d154cb085e953072a42ac90 [id=4f91c41523434de1aa823294e089f5eb]). Expected version 1 got 0
I20260928 14:50:49.715462 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet e2aae21b7ed2417dafd4cca54c53de33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:49 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.715559 9397 tablet_service.cc:1467] Processing CreateTablet for tablet c72720e6b4d146fb8f9213c4550695d9 (DEFAULT_TABLE table=default.Table_2cc399c677ec4d3f99908a6af4168eed [id=6ce8bf2c4d7d4f8282049769dfadf634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.715668 9394 tablet_service.cc:1514] Processing DeleteTablet for tablet d271c8012b634b2a816cc2360e5b2164 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 14:50:49 UTC) from {username='slave'} at 127.0.0.1:34142
I20260928 14:50:49.715873 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72720e6b4d146fb8f9213c4550695d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.714823 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet e59b8e736b6d4644a78a6d7570746e18 (table default.Table_9aa2a15124ab40d682b1da19d1713074 [id=db3c037ac7784283bb5dc67c99a4b73c]). Expected version 1 got 0
W20260928 14:50:49.716156 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet e2aae21b7ed2417dafd4cca54c53de33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2aae21b7ed2417dafd4cca54c53de33 already in progress: creating tablet
W20260928 14:50:49.716375 8940 catalog_manager.cc:4821] TS ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): delete failed for tablet d271c8012b634b2a816cc2360e5b2164 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d271c8012b634b2a816cc2360e5b2164 already in progress: creating tablet
I20260928 14:50:49.716472 8954 catalog_manager.cc:5495] T ab6ccac2580049a5a615d8d36a44f373 P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:49.717097 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet ab6ccac2580049a5a615d8d36a44f373 (table default.Table_80bae2129fb24491b999a368ecb99d3f [id=9793280eca254a92865bde9e52fe4588]). Expected version 1 got 0
I20260928 14:50:49.717787 9400 tablet_service.cc:1467] Processing CreateTablet for tablet 84735331a32f4eaa8d8bf7e1e337d7e8 (DEFAULT_TABLE table=default.Table_02ba25efea3d498c91ec5c33248f0fe2 [id=e100f9d805e94b6c85e77fc8a42bd82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.718106 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84735331a32f4eaa8d8bf7e1e337d7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.718547 9855 tablet_bootstrap.cc:492] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.718665 9855 ts_tablet_manager.cc:1397] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.003s
I20260928 14:50:49.719691 9855 raft_consensus.cc:348] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
I20260928 14:50:49.719888 9855 raft_consensus.cc:374] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.719945 9855 raft_consensus.cc:729] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.720115 9855 consensus_queue.cc:260] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } }
W20260928 14:50:49.725266 8941 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 080159d2e65a4550861f4c63fb22d02e (table default.Table_bbc7f5f92c2447c1a6ba6df83536d05a [id=3ad062eda9fb4bb9ac95267ea11f413c], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 080159d2e65a4550861f4c63fb22d02e consensus state has no leader
I20260928 14:50:49.729707 9848 ts_tablet_manager.cc:1428] T f39c1da071164342aea8eab263d4eebb P ae832871bd1142f7af10c084115ffc12: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260928 14:50:49.734462 9855 ts_tablet_manager.cc:1428] T c64470c7a3154fd7b5057ce464e47326 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260928 14:50:49.734612 9851 tablet_bootstrap.cc:492] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
I20260928 14:50:49.734948 9851 ts_tablet_manager.cc:1397] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260928 14:50:49.735657 9851 raft_consensus.cc:348] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.735894 9848 tablet_bootstrap.cc:492] T 1b22c3f9578a464a96be0bac6127e56d P ae832871bd1142f7af10c084115ffc12: Bootstrap starting.
I20260928 14:50:49.735890 9851 raft_consensus.cc:374] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.736007 9851 raft_consensus.cc:729] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.736233 9851 consensus_queue.cc:260] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.736760 9851 ts_tablet_manager.cc:1428] T 3aff7eb9a7ff4ed79305806c30c30627 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:49.737022 9851 tablet_bootstrap.cc:492] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.738559 9851 tablet_bootstrap.cc:654] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.745204 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_3b55641c17274c3892109312ab176330 [id=ca80ae63ecfc45109c61f1c89e5d1713] alter complete (version 1)
I20260928 14:50:49.746708 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 5c4e78f2776c41d980b698f3fd1da040 (DEFAULT_TABLE table=default.Table_82caf77989ce41868a3a46a2a74d53e1 [id=3ad6217762db4622bb2f90459095d873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.747094 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c4e78f2776c41d980b698f3fd1da040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.749895 8954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c253b9f3f43c4b8ba7cd5c7d4edac656: default.Table_d4000cdd4f98428e8f059b33cf38b381 [id=e2ce12012fa74b0093e75a7295ad9a00] alter complete (version 2)
I20260928 14:50:49.750360 9400 tablet_service.cc:1467] Processing CreateTablet for tablet aad0051a16b54c4cb0e8fead32217514 (DEFAULT_TABLE table=default.Table_e594e1604db944939af18d3c73be5ff1 [id=ee3eeecb3aa242b5883e30b52913cacf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.750379 9394 tablet_service.cc:1467] Processing CreateTablet for tablet c4d2119e49f54b3d8edba359f98abfb5 (DEFAULT_TABLE table=default.Table_a360c09e2f3e4964a42372b6be5d8d22 [id=ef8e04a21fc347109f7440269d747850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.750716 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad0051a16b54c4cb0e8fead32217514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.751295 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d2119e49f54b3d8edba359f98abfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.753968 9390 tablet_service.cc:1467] Processing CreateTablet for tablet c3c8787553ff43c9868f44436373969f (DEFAULT_TABLE table=default.Table_9c7ece9445444dc6ab234fe2ecf2e9e1 [id=087809e7d900419b99de6cb5dd3e24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.754251 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c8787553ff43c9868f44436373969f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.758929 9855 tablet_bootstrap.cc:492] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91: Bootstrap starting.
I20260928 14:50:49.760335 9855 tablet_bootstrap.cc:654] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91: Neither blocks nor log segments found. Creating new log.
W20260928 14:50:49.761842 8939 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.181.1:44023, user_credentials={real_user=slave}} blocked reactor thread for 49339.5us
I20260928 14:50:49.761878 9408 tablet_service.cc:1467] Processing CreateTablet for tablet b6b0a134850d4637acc9e9ce47080060 (DEFAULT_TABLE table=default.Table_c8f51416c17449a9888938d0d4153f99 [id=1eff5b8e5fdc498b93b4ee75b4309ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.762262 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6b0a134850d4637acc9e9ce47080060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.762280 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 666de9dd64734708b35738605204ed7d (table default.Table_b60d5338abb24a4b8f03f655152245cb [id=fa3d7186cd7343c19f359f1ab5da6d34]) successfully deleted
W20260928 14:50:49.762548 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 00b65284d7da4ee186d228c64a4013d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00b65284d7da4ee186d228c64a4013d6 already in progress: creating tablet
W20260928 14:50:49.762811 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet e33ecd8df52d4355b187142ff61f24ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33ecd8df52d4355b187142ff61f24ef already in progress: creating tablet
I20260928 14:50:49.762898 9814 ts_tablet_manager.cc:1918] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 14:50:49.763037 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 989df9ccfce446008435161626ce4f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 989df9ccfce446008435161626ce4f5e already in progress: creating tablet
W20260928 14:50:49.763289 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 32e609be5acd42b48b6b7423cd56401a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e609be5acd42b48b6b7423cd56401a already in progress: creating tablet
W20260928 14:50:49.763559 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet de77b0bec60a4ebbb0a1b6f779eaaf70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de77b0bec60a4ebbb0a1b6f779eaaf70 already in progress: creating tablet
I20260928 14:50:49.764154 9848 tablet_bootstrap.cc:654] T 1b22c3f9578a464a96be0bac6127e56d P ae832871bd1142f7af10c084115ffc12: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.765388 9814 log.cc:1196] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Deleting WAL directory at /tmp/dist-test-taskfQx8Sg/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790607014928350-8916-0/minicluster-data/ts-0/wal/wals/e2c5877a52264f0e9ebb070792e39e55
I20260928 14:50:49.767344 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6ff596370c52465ca7c531b8760af5c8 (table default.Table_ed36dc3cdd8e4d7dbcad55d996184a4f [id=60cb5e1d86f7418b90bac3d625770081]). Expected version 2 got 0
I20260928 14:50:49.767671 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 3aff7eb9a7ff4ed79305806c30c30627 (table default.Table_15b982ba466a44da9677e93de728c4dc [id=3c7ccec83e854fe79539b979befdc62d]). Expected version 3 got 0
I20260928 14:50:49.768049 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 6aa393b1fc2b40ebb87df86180717db8 (table default.Table_0b822e5685d1472b8e5cb2ef43cd0f4d [id=a325eabc142d47b88dae65aaba6082c1]). Expected version 1 got 0
I20260928 14:50:49.769608 9814 ts_tablet_manager.cc:1939] T e2c5877a52264f0e9ebb070792e39e55 P 9b4626c584ad47ffaf346e81daff846b: Deleting consensus metadata
I20260928 14:50:49.771087 9814 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46824 (request call id 1351) took 1202 ms. Trace:
I20260928 14:50:49.771183 9814 rpcz_store.cc:276] 0928 14:50:48.568473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0928 14:50:48.568840 (+ 367us) service_pool.cc:227] Handling call
0928 14:50:49.646618 (+1077778us) ts_tablet_manager.cc:1145] Deleting tablet e2c5877a52264f0e9ebb070792e39e55
0928 14:50:49.646629 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0928 14:50:49.714471 (+ 67842us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.762808 (+ 48337us) tablet_metadata.cc:641] Metadata flushed
0928 14:50:49.771069 (+ 8261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077657}
W20260928 14:50:49.763804 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet 72099e766c574246b38acb34ee369d2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72099e766c574246b38acb34ee369d2e already in progress: creating tablet
I20260928 14:50:49.776554 11498 raft_consensus.cc:482] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 14:50:49.776677 8939 catalog_manager.cc:4821] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): delete failed for tablet a78d6d6db7a1484498c7496ddbdc29fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a78d6d6db7a1484498c7496ddbdc29fb already in progress: creating tablet
I20260928 14:50:49.776819 11498 raft_consensus.cc:504] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.777166 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet 3b75816a9816497ca6bc6ba8e5c5eb3d (table default.Table_02e5b36a67804830879c207d98f45dda [id=ad213ed249fa48f087d0f12f32893689]) successfully deleted
I20260928 14:50:49.776952 9814 tablet_replica.cc:330] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: stopping tablet replica
I20260928 14:50:49.777375 8939 catalog_manager.cc:4841] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): tablet e2c5877a52264f0e9ebb070792e39e55 (table default.Table_272ffcd346ae4b539727e6e5312c89ba [id=a2ce402620b04755ac7ff07c9f40851b]) successfully deleted
I20260928 14:50:49.777848 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
I20260928 14:50:49.778323 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.778584 9567 raft_consensus.cc:2454] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.777818 11498 leader_election.cc:288] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.778389 9851 tablet_bootstrap.cc:492] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b: No bootstrap required, opened a new log
W20260928 14:50:49.778963 9220 leader_election.cc:341] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.779583 9851 ts_tablet_manager.cc:1397] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260928 14:50:49.779588 9545 tablet_service.cc:1467] Processing CreateTablet for tablet b70c9aef33fb411981402734d7eb9a14 (DEFAULT_TABLE table=default.Table_1711c965c5d349e3bc63dfe7f2f99ac1 [id=d92cbc62ff434f3ea1271104506831f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.779958 9545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70c9aef33fb411981402734d7eb9a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.779923 9219 leader_election.cc:302] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.780593 9265 tablet_service.cc:1467] Processing CreateTablet for tablet b70c9aef33fb411981402734d7eb9a14 (DEFAULT_TABLE table=default.Table_1711c965c5d349e3bc63dfe7f2f99ac1 [id=d92cbc62ff434f3ea1271104506831f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.780579 9851 raft_consensus.cc:348] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.780823 9851 raft_consensus.cc:374] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.780875 9851 raft_consensus.cc:729] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.780968 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70c9aef33fb411981402734d7eb9a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.781049 9851 consensus_queue.cc:260] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.781325 11223 raft_consensus.cc:2781] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.781394 11223 raft_consensus.cc:482] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.781443 11223 raft_consensus.cc:3037] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.781554 9851 ts_tablet_manager.cc:1428] T d34a235b38aa4e9ba328a7f542342653 P 9b4626c584ad47ffaf346e81daff846b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260928 14:50:49.781785 9851 tablet_bootstrap.cc:492] T 43f761337edf4a0f9e5dcda0ae28cffd P 9b4626c584ad47ffaf346e81daff846b: Bootstrap starting.
I20260928 14:50:49.783802 11223 raft_consensus.cc:504] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.784577 11223 leader_election.cc:288] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.785100 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.785274 9567 raft_consensus.cc:3037] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.786773 9851 tablet_bootstrap.cc:654] T 43f761337edf4a0f9e5dcda0ae28cffd P 9b4626c584ad47ffaf346e81daff846b: Neither blocks nor log segments found. Creating new log.
I20260928 14:50:49.787603 9567 raft_consensus.cc:2454] T 67956e8ba12d4411bfca6263b84aa93e P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.792789 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67956e8ba12d4411bfca6263b84aa93e" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:49.793434 9219 leader_election.cc:302] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters:
I20260928 14:50:49.793859 11605 raft_consensus.cc:2781] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.793958 11605 raft_consensus.cc:686] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.794137 11605 consensus_queue.cc:237] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
W20260928 14:50:49.795461 9220 leader_election.cc:341] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.802572 9408 tablet_service.cc:1467] Processing CreateTablet for tablet 016172d46c0346c18ae26c0670613817 (DEFAULT_TABLE table=default.Table_f2ecda364b46440aa6f55cc2d06db9c4 [id=0a314dcf3f684c33b570a4541d4a99d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.803892 9408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016172d46c0346c18ae26c0670613817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.804270 9390 tablet_service.cc:1467] Processing CreateTablet for tablet f6850c57b17f4db89ea7e50f5f34882f (DEFAULT_TABLE table=default.Table_0d658ac8d0b744e69be107b6c5646703 [id=b8c76029b2f8456ba5fecb4fd4ab0006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.804603 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6850c57b17f4db89ea7e50f5f34882f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.810498 9402 tablet_service.cc:1467] Processing CreateTablet for tablet 1f0a76fa3db641d3b11895efd9c6a7fa (DEFAULT_TABLE table=default.Table_60c73d25d3054ca993b1265a0f1b07ea [id=f6e4ea17bc2448faad45b04e006fd828]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.810942 9402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f0a76fa3db641d3b11895efd9c6a7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.811296 9814 raft_consensus.cc:2229] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 14:50:49.811718 9814 raft_consensus.cc:2258] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 14:50:49.812800 9814 ts_tablet_manager.cc:1905] T 835ba6c803a34707b77bb8bc280b9e68 P 9b4626c584ad47ffaf346e81daff846b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 14:50:49.813117 8954 catalog_manager.cc:5495] T 67956e8ba12d4411bfca6263b84aa93e P 9b4626c584ad47ffaf346e81daff846b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b4626c584ad47ffaf346e81daff846b (127.8.181.1). New cstate: current_term: 1 leader_uuid: "9b4626c584ad47ffaf346e81daff846b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260928 14:50:49.813558 8954 catalog_manager.cc:5587] TS 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023) does not have the latest schema for tablet 67956e8ba12d4411bfca6263b84aa93e (table default.Table_36f9ea2f519041849b89dbd20ddf871e [id=8c5f014cd2f545abb221b135a4477b53]). Expected version 2 got 0
I20260928 14:50:49.818727 9545 tablet_service.cc:1467] Processing CreateTablet for tablet 690538f2c6e34acd80edde51acc3ffcb (DEFAULT_TABLE table=default.Table_42f0f2137f854376a68246c5f0a9ddf8 [id=a9447b2b1b1f4f90b74b571757e3c68c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.819231 9265 tablet_service.cc:1467] Processing CreateTablet for tablet 690538f2c6e34acd80edde51acc3ffcb (DEFAULT_TABLE table=default.Table_42f0f2137f854376a68246c5f0a9ddf8 [id=a9447b2b1b1f4f90b74b571757e3c68c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.819633 9265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 690538f2c6e34acd80edde51acc3ffcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.824535 9258 tablet_service.cc:1467] Processing CreateTablet for tablet aee6807147cc4e698842d9e6ee2bef9d (DEFAULT_TABLE table=default.Table_be7c0956d81c441ebf7a933d90801c93 [id=5b4600b6131d4247ba9b3c8976356240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.824863 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee6807147cc4e698842d9e6ee2bef9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.824883 11605 raft_consensus.cc:482] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.824999 11605 raft_consensus.cc:504] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.825834 11605 leader_election.cc:288] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.826267 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.826678 9220 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.826912 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91" is_pre_election: true
I20260928 14:50:49.827086 9567 raft_consensus.cc:2454] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 0.
I20260928 14:50:49.827412 9219 leader_election.cc:302] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.827802 11605 raft_consensus.cc:2781] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.827868 11605 raft_consensus.cc:482] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.827920 11605 raft_consensus.cc:3037] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.831478 9548 tablet_service.cc:1467] Processing CreateTablet for tablet aee6807147cc4e698842d9e6ee2bef9d (DEFAULT_TABLE table=default.Table_be7c0956d81c441ebf7a933d90801c93 [id=5b4600b6131d4247ba9b3c8976356240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.831812 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 3289d501483c4a2f91a7081e47c9f61e (DEFAULT_TABLE table=default.Table_b13e44d3602a48cb8cc1c98a74ca52a2 [id=6d5b969da56b472c942d5627ec93438b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.831887 11605 raft_consensus.cc:504] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.832446 9258 tablet_service.cc:1467] Processing CreateTablet for tablet 3289d501483c4a2f91a7081e47c9f61e (DEFAULT_TABLE table=default.Table_b13e44d3602a48cb8cc1c98a74ca52a2 [id=6d5b969da56b472c942d5627ec93438b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.832613 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12"
I20260928 14:50:49.832902 9258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3289d501483c4a2f91a7081e47c9f61e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 14:50:49.833097 9220 leader_election.cc:341] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.833731 9567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff596370c52465ca7c531b8760af5c8" candidate_uuid: "9b4626c584ad47ffaf346e81daff846b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658e483a10314e8d93c2f6e9084f2a91"
I20260928 14:50:49.833935 9567 raft_consensus.cc:3037] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.836705 9567 raft_consensus.cc:2454] T 6ff596370c52465ca7c531b8760af5c8 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b4626c584ad47ffaf346e81daff846b in term 1.
I20260928 14:50:49.837137 9219 leader_election.cc:302] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.837512 11498 raft_consensus.cc:2781] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 14:50:49.837713 11498 raft_consensus.cc:686] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [term 1 LEADER]: Becoming Leader. State: Replica: 9b4626c584ad47ffaf346e81daff846b, State: Running, Role: LEADER
I20260928 14:50:49.837960 11498 consensus_queue.cc:237] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.839308 11454 raft_consensus.cc:482] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.839375 11605 leader_election.cc:288] T 6ff596370c52465ca7c531b8760af5c8 P 9b4626c584ad47ffaf346e81daff846b [CANDIDATE]: Term 1 election: Requested vote from peers ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099), 658e483a10314e8d93c2f6e9084f2a91 (127.8.181.3:44119)
I20260928 14:50:49.839437 11454 raft_consensus.cc:504] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.840037 11454 leader_election.cc:288] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.840962 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a0117aff69403e816ff37592db935f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:49.840988 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76a0117aff69403e816ff37592db935f" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.841476 9497 leader_election.cc:341] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260928 14:50:49.841635 9498 leader_election.cc:341] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.841714 9498 leader_election.cc:302] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91; no voters: 9b4626c584ad47ffaf346e81daff846b, ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.842208 9261 tablet_service.cc:1467] Processing CreateTablet for tablet 7075c20c0af245fab67bbc5e5be24192 (DEFAULT_TABLE table=default.Table_81ba7c5a39da4e10a05e04cc6b22a618 [id=26a1c8b06c3d4bd5a2c00212ad62e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.842520 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7075c20c0af245fab67bbc5e5be24192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.843405 9267 tablet_service.cc:1467] Processing CreateTablet for tablet a7c908fa3d474c9294c97da6e0076241 (DEFAULT_TABLE table=default.Table_261cbd2934a34c30938c1cefffb461ad [id=ddb2ef1a09484aa6b1a040dcee902f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.843724 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7c908fa3d474c9294c97da6e0076241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.843832 9257 tablet_service.cc:1467] Processing CreateTablet for tablet b7090d273be1425fa8be0952470c4034 (DEFAULT_TABLE table=default.Table_e9859aeaaec84f258169f32308e91c31 [id=17766edfcc3e49048603f5758bbcdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.844146 9257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7090d273be1425fa8be0952470c4034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.845677 11567 raft_consensus.cc:2726] T 76a0117aff69403e816ff37592db935f P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 14:50:49.845813 11567 raft_consensus.cc:482] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 14:50:49.845899 11567 raft_consensus.cc:504] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.846387 11567 leader_election.cc:288] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4626c584ad47ffaf346e81daff846b (127.8.181.1:44023), ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099)
I20260928 14:50:49.849745 9262 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd3da2b3c2940ef8c76d8366e67ec64 (DEFAULT_TABLE table=default.Table_88b2f18d021948e58d6010ac127ac782 [id=53f30f341ad34d2893586104a5ba002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.850067 9262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd3da2b3c2940ef8c76d8366e67ec64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.851639 9855 tablet_bootstrap.cc:492] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91: No bootstrap required, opened a new log
I20260928 14:50:49.851760 9855 ts_tablet_manager.cc:1397] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.001s
I20260928 14:50:49.852671 9855 raft_consensus.cc:348] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.852862 9855 raft_consensus.cc:374] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 14:50:49.852910 9855 raft_consensus.cc:729] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658e483a10314e8d93c2f6e9084f2a91, State: Initialized, Role: FOLLOWER
I20260928 14:50:49.853106 9855 consensus_queue.cc:260] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3" port: 44119 } }
I20260928 14:50:49.854631 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fbe74a73dda4330af8814bbba0cfc70" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae832871bd1142f7af10c084115ffc12" is_pre_election: true
W20260928 14:50:49.855261 9498 leader_election.cc:341] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae832871bd1142f7af10c084115ffc12 (127.8.181.2:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260928 14:50:49.856097 9529 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd3da2b3c2940ef8c76d8366e67ec64 (DEFAULT_TABLE table=default.Table_88b2f18d021948e58d6010ac127ac782 [id=53f30f341ad34d2893586104a5ba002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.856160 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 7075c20c0af245fab67bbc5e5be24192 (DEFAULT_TABLE table=default.Table_81ba7c5a39da4e10a05e04cc6b22a618 [id=26a1c8b06c3d4bd5a2c00212ad62e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.856539 9538 tablet_service.cc:1467] Processing CreateTablet for tablet b7090d273be1425fa8be0952470c4034 (DEFAULT_TABLE table=default.Table_e9859aeaaec84f258169f32308e91c31 [id=17766edfcc3e49048603f5758bbcdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.856946 9284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fbe74a73dda4330af8814bbba0cfc70" candidate_uuid: "658e483a10314e8d93c2f6e9084f2a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4626c584ad47ffaf346e81daff846b" is_pre_election: true
I20260928 14:50:49.857125 9284 raft_consensus.cc:2454] T 8fbe74a73dda4330af8814bbba0cfc70 P 9b4626c584ad47ffaf346e81daff846b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 658e483a10314e8d93c2f6e9084f2a91 in term 0.
I20260928 14:50:49.859968 9855 ts_tablet_manager.cc:1428] T 58a91c01ee3c422694e08505ce64e501 P 658e483a10314e8d93c2f6e9084f2a91: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260928 14:50:49.861763 9497 leader_election.cc:302] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 658e483a10314e8d93c2f6e9084f2a91, 9b4626c584ad47ffaf346e81daff846b; no voters: ae832871bd1142f7af10c084115ffc12
I20260928 14:50:49.861747 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 04375426aa5d42528381227556d7f06d (DEFAULT_TABLE table=default.Table_209dd00793a04a1093067693bad74135 [id=fe32b488d5a940bd872c6c7dab1e2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 14:50:49.862138 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04375426aa5d42528381227556d7f06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 14:50:49.862191 11454 raft_consensus.cc:2781] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 14:50:49.862267 11454 raft_consensus.cc:482] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 14:50:49.862318 11454 raft_consensus.cc:3037] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 0 FOLLOWER]: Advancing to term 1
I20260928 14:50:49.864740 11454 raft_consensus.cc:504] T 8fbe74a73dda4330af8814bbba0cfc70 P 658e483a10314e8d93c2f6e9084f2a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4626c584ad47ffaf346e81daff846b" member_type: VOTER last_known_addr { host: "127.8.181.1" port: 44023 } } peers { permanent_uuid: "ae832871bd1142f7af10c084115ffc12" member_type: VOTER last_known_addr { host: "127.8.181.2" port: 42099 } } peers { permanent_uuid: "658e483a10314e8d93c2f6e9084f2a91" member_type: VOTER last_known_addr { host: "127.8.181.3"